Jul 28 10:30:12 devstack cinder-volume[77350]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 28 10:30:12 devstack cinder-volume[77350]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 28 10:30:12 devstack cinder-volume[77350]: we strongly recommend against using it for new projects. Jul 28 10:30:12 devstack cinder-volume[77350]: If you are already using Eventlet, we recommend migrating to a different Jul 28 10:30:12 devstack cinder-volume[77350]: framework. For more detail see Jul 28 10:30:12 devstack cinder-volume[77350]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 28 10:30:12 devstack cinder-volume[77350]: import eventlet # noqa Jul 28 10:30:15 devstack cinder-volume[77350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77350) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 28 10:30:15 devstack cinder-volume[77350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77350) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 28 10:30:15 devstack cinder-volume[77350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77350) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 28 10:30:16 devstack cinder-volume[77350]: INFO dbcounter [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] Registered counter for database cinder Jul 28 10:30:16 devstack cinder-volume[77350]: DEBUG oslo_db.sqlalchemy.engines [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77350) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 28 10:30:16 devstack cinder-volume[77350]: DEBUG dbcounter [-] [77350] Writer thread running {{(pid=77350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 28 10:30:16 devstack cinder-volume[77350]: INFO cinder.rpc [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 28 10:30:16 devstack cinder-volume[77350]: INFO cinder.rpc [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 28 10:30:16 devstack cinder-volume[77350]: DEBUG oslo_db.sqlalchemy.engines [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77350) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 28 10:30:16 devstack cinder-volume[77350]: INFO cinder.volume.manager [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] Determined volume DB was empty at startup. Jul 28 10:30:16 devstack cinder-volume[77350]: DEBUG cinder.volume.manager [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77350) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 28 10:30:16 devstack cinder-volume[77350]: INFO cinder.volume.manager [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 28 10:30:16 devstack cinder-volume[77350]: WARNING stevedore.named [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 28 10:30:16 devstack cinder-volume[77350]: WARNING castellan.key_manager [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 28 10:30:16 devstack cinder-volume[77350]: WARNING cinder.keymgr.conf_key_mgr [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 28 10:30:16 devstack cinder-volume[77350]: DEBUG cinder.volume.drivers.lvm [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77350) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 28 10:30:16 devstack cinder-volume[77350]: DEBUG oslo_concurrency.processutils [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_concurrency.processutils [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] CMD "cinder-rtstool verify" returned: 0 in 0.446s {{(pid=77350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_db.sqlalchemy.engines [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77350) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 28 10:30:17 devstack cinder-volume[77350]: INFO cinder.rpc [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 28 10:30:17 devstack cinder-volume[77350]: INFO cinder.rpc [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 28 10:30:17 devstack cinder-volume[77350]: WARNING stevedore.named [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 28 10:30:17 devstack cinder-volume[77350]: WARNING castellan.key_manager [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 28 10:30:17 devstack cinder-volume[77350]: INFO cinder.volume.manager [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_db.sqlalchemy.engines [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77350) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 28 10:30:17 devstack cinder-volume[77350]: INFO oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] Starting 1 workers Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] Started child 77498 {{(pid=77350) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] Full set of CONF: {{(pid=77350) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] ******************************************************************************** {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] Configuration options gathered from: {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] ================================================================================ {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] allow_availability_zone_fallback = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] allow_compression_on_image_upload = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] allowed_direct_url_schemes = [] {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] api_rate_limit = True {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] auth_strategy = keystone {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77498]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] az_cache_duration = 3600 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_availability_zone = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_host = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_name = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_stats_polling_interval = 60 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backup_api_class = cinder.backup.api.API {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backup_name_template = backup-%s {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backup_use_same_host = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backup_use_temp_snapshot = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] chap_password = **** {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] chap_username = {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cinder_internal_tenant_project_id = 93d72099b9c049a7a7189217d6558aa3 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cinder_internal_tenant_user_id = 2eca44d61a6b4fa4820f4464d383df8c {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cloned_volume_same_az = True {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cluster = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] compression_format = gzip {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] compute_api_class = cinder.compute.nova.API {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] config_dir = [] {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] config_source = [] {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] control_exchange = openstack {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] debug = True {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] default_availability_zone = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] default_group_type = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] default_volume_type = lvmdriver-1 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] disk_geometry = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] driver_client_cert = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] driver_client_cert_key = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] driver_data_namespace = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] driver_ssl_cert_path = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] driver_ssl_cert_verify = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] driver_use_ssl = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] enable_force_upload = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] enable_new_services = True {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] enable_unsupported_driver = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] enabled_backends = ['lvmdriver-1'] {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] enforce_multipath_for_image_xfer = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] filter_function = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] glance_api_insecure = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] glance_api_servers = ['http://192.168.122.251/image'] {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] glance_api_ssl_compression = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] glance_ca_certificates_file = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] glance_catalog_info = image:glance:publicURL {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] glance_certfile = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] glance_keyfile = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] glance_num_retries = 3 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] glance_request_timeout = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] goodness_function = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] graceful_shutdown_timeout = 5 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] group_api_class = cinder.group.api.API {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] host = devstack {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] image_compress_on_upload = True {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] image_conversion_address_space_limit = 1 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] image_conversion_cpu_limit = 60 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] image_conversion_disable = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] image_upload_use_cinder_backend = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] image_upload_use_internal_tenant = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] image_volume_cache_enabled = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] image_volume_cache_max_count = 0 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] image_volume_cache_max_size_gb = 0 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] init_host_max_objects_retrieval = 0 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] instance_format = [instance: %(uuid)s] {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] iscsi_target_flags = {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] iscsi_write_cache = on {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] iser_helper = tgtadm {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] iser_ip_address = 192.168.122.251 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] iser_port = 3260 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] log_color = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] log_config_append = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] log_dir = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] log_file = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] log_options = True {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] log_rotate_interval = 1 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] log_rotate_interval_type = days {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] log_rotation_type = none {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] max_age = 0 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] max_logfile_count = 30 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] max_logfile_size_mb = 200 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] max_over_subscription_ratio = 20.0 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] message_reap_interval = 86400 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] message_ttl = 2592000 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] migration_create_volume_timeout_secs = 300 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] monkey_patch = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] monkey_patch_modules = [] {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] my_ip = 192.168.122.251 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] no_snapshot_gb_quota = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] num_iser_scan_tries = 3 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] num_shell_tries = 3 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77498]: INFO cinder.volume.manager [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 28 10:30:17 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] num_volume_device_scan_tries = 3 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] nvmeof_conn_info_version = 1 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] nvmet_ns_id = 10 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] nvmet_port_id = 1 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] osapi_max_limit = 1000 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] osapi_volume_ext_list = [] {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] osapi_volume_listen = 0.0.0.0 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] osapi_volume_listen_port = 8776 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] osapi_volume_use_ssl = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] osapi_volume_workers = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] per_volume_size_limit = -1 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] periodic_fuzzy_delay = 60 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] periodic_interval = 60 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] project_id_regex = [0-9a-f\-]+ {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] public_endpoint = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] publish_errors = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] quota_backup_gigabytes = 1000 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] quota_backups = 10 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] quota_gigabytes = 1000 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] quota_groups = 10 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] quota_snapshots = 10 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] quota_volumes = 10 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] rate_limit_burst = 0 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] rate_limit_except_level = CRITICAL {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] rate_limit_interval = 0 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] reinit_driver_count = 3 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] replication_device = **** {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] report_discard_supported = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] report_interval = 120 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] reservation_clean_interval = 86400 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] reservation_expire = 86400 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] reserved_image_namespaces = [] {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] reserved_percentage = 0 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] rpc_response_timeout = 120 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] run_external_periodic_tasks = True {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] scst_target_driver = iscsi {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] scst_target_iqn_name = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] service_down_time = 720 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] shell_completion = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] snapshot_name_template = snapshot-%s {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] snapshot_same_host = True {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] split_loggers = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] state_path = /opt/stack/data/cinder {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] storage_availability_zone = nova {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] storage_protocol = iSCSI {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] syslog_log_facility = LOG_USER {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] target_helper = lioadm {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] target_ip_address = 192.168.122.251 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] target_port = 3260 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] target_protocol = iscsi {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] target_secondary_ip_addresses = [] {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] trace_flags = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] transfer_api_class = cinder.transfer.api.API {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] transport_url = **** {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] until_refresh = 0 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] use_chap_auth = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] use_default_quota_class = True {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] use_journal = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] use_json = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] use_multipath_for_image_xfer = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] use_stderr = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] use_syslog = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] verify_glance_signatures = enabled {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] volume_api_class = cinder.volume.api.API {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] volume_backend_name = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] volume_clear = zero {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] volume_clear_ionice = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] volume_clear_size = 0 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] volume_copy_bps_limit = 0 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] volume_dd_blocksize = 1M {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] volume_name_template = volume-%s {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] volume_service_inithost_offload = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] volume_usage_audit_period = month {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] zoning_mode = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_concurrency.disable_process_locking = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] keystone_authtoken.auth_section = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] keystone_authtoken.auth_type = password {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] keystone_authtoken.auth_version = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] keystone_authtoken.cache = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] keystone_authtoken.certfile = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] keystone_authtoken.delay_auth_decision = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] keystone_authtoken.http_connect_timeout = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] keystone_authtoken.include_service_catalog = True {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] keystone_authtoken.insecure = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] keystone_authtoken.interface = public {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] keystone_authtoken.keyfile = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] keystone_authtoken.memcache_password = {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] keystone_authtoken.memcache_username = {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] keystone_authtoken.region_name = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:30:17 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] keystone_authtoken.service_token_roles_required = True {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] keystone_authtoken.service_type = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] keystone_authtoken.token_cache_time = 300 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.251/identity {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cache.backend = dogpile.cache.null {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cache.backend_argument = **** {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cache.backend_expiration_time = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cache.config_prefix = cache.oslo {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cache.debug_cache_backend = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cache.enable_retry_client = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cache.enable_socket_keepalive = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cache.enabled = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cache.expiration_time = 600 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cache.hashclient_retry_attempts = 2 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cache.memcache_dead_retry = 300 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cache.memcache_pool_maxsize = 10 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cache.memcache_sasl_enabled = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cache.password = **** {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cache.proxies = [] {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cache.redis_db = 0 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cache.redis_sentinel_service_name = mymaster {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cache.redis_server = localhost:6379 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cache.retry_attempts = 2 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cache.retry_delay = 0.0 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cache.socket_keepalive_count = 1 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cache.socket_keepalive_idle = 1 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cache.socket_keepalive_interval = 1 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cache.socket_timeout = 1.0 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cache.tls_allowed_ciphers = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cache.tls_cafile = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cache.tls_certfile = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cache.tls_enabled = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cache.tls_keyfile = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cache.username = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] coordination.backend_url = **** {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] database.asyncio_connection = **** {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] database.asyncio_slave_connection = **** {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] database.backend = sqlalchemy {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] database.connection = **** {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] database.connection_debug = 0 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] database.connection_parameters = {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] database.connection_recycle_time = 3600 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] database.connection_trace = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] database.db_inc_retry_interval = True {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] database.db_max_retries = 20 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] database.db_max_retry_interval = 10 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] database.db_retry_interval = 1 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] database.max_overflow = 50 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] database.max_pool_size = 5 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] database.max_retries = 10 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] database.mysql_wsrep_sync_wait = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] database.pool_timeout = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] database.retry_interval = 10 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] database.slave_connection = **** {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] database.sqlite_synchronous = True {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] database.synchronous_reader = True {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] database.use_db_reconnect = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] profiler.connection_string = messaging:// {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] profiler.enabled = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] profiler.es_doc_type = notification {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] profiler.es_scroll_size = 10000 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] profiler.es_scroll_time = 2m {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] profiler.filter_error_trace = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] profiler.hmac_keys = **** {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] profiler.sentinel_service_name = mymaster {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] profiler.socket_timeout = 0.1 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] profiler.trace_requests = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] profiler.trace_sqlalchemy = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] profiler_jaeger.process_tags = {} {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] profiler_jaeger.service_name_prefix = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] profiler_otlp.service_name_prefix = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_policy.enforce_new_defaults = True {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_policy.policy_default_rule = default {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_policy.policy_file = policy.yaml {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_policy.remote_timeout = 60.0 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] privsep_osbrick.group = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] privsep_osbrick.helper_command = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] privsep_osbrick.user = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cinder_sys_admin.group = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cinder_sys_admin.helper_command = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] cinder_sys_admin.user = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] service_user.auth_section = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] service_user.auth_type = password {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] service_user.cafile = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] service_user.certfile = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] service_user.collect_timing = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] service_user.insecure = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] service_user.keyfile = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] service_user.send_service_user_token = True {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] service_user.split_loggers = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] service_user.timeout = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] glance.auth_section = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] glance.auth_type = password {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] glance.certfile = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] glance.collect_timing = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] glance.insecure = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] glance.keyfile = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] glance.region_name = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] glance.split_loggers = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] glance.timeout = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.backend_availability_zone = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.chap_password = **** {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.chap_username = {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.disk_geometry = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.driver_client_cert = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.driver_client_cert_key = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.driver_data_namespace = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack sudo[77570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.driver_use_ssl = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.enable_unsupported_driver = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.extra_capabilities = {} {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.filter_function = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack sudo[77570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.goodness_function = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.iscsi_target_flags = {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.iscsi_write_cache = on {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.iser_helper = tgtadm {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.iser_ip_address = 192.168.122.251 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.iser_port = 3260 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.lvm_mirrors = 0 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.lvm_share_target = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.lvm_type = auto {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.num_shell_tries = 3 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.nvmet_port_id = 1 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.replication_device = **** {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.report_discard_supported = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.reserved_percentage = 0 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.scst_target_driver = iscsi {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.scst_target_iqn_name = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.storage_protocol = iSCSI {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.target_helper = tgtadm {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.target_ip_address = 192.168.122.251 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.target_port = 3260 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.target_protocol = iscsi {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.trace_flags = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.unique_fqdn_network = True {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.use_chap_auth = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.volume_backend_name = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.volume_clear = zero {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.volume_clear_ionice = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.volume_clear_size = 0 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.volume_group = cinder-volumes {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_reports.file_event_handler = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_reports.log_dir = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.backend_availability_zone = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.backend_host = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.chap_password = **** {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.chap_username = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.chiscsi_conf = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.disk_geometry = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.driver_client_cert = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.driver_data_namespace = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.driver_use_ssl = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.extra_capabilities = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.filter_function = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.goodness_function = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.iser_helper = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.iser_ip_address = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.iser_port = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.iser_target_prefix = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.lvm_conf_file = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.lvm_mirrors = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.lvm_share_target = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.lvm_type = auto {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.num_shell_tries = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.nvmet_port_id = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.replication_device = **** {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.report_discard_supported = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.reserved_percentage = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.scst_target_driver = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.storage_protocol = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.target_helper = lioadm {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.target_ip_address = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.target_port = 3260 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.target_protocol = iscsi {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.trace_flags = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.use_chap_auth = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.volume_clear = zero {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.volume_clear_size = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] lvmdriver-1.volumes_dir = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_rabbit.ssl = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_rabbit.ssl_version = {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_notifications.driver = [] {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_notifications.retry = -1 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] oslo_messaging_notifications.transport_url = **** {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] key_manager.fixed_key = **** {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] barbican.barbican_api_version = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] barbican.barbican_endpoint = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] barbican.barbican_endpoint_type = public {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] barbican.barbican_region_name = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] barbican.cafile = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] barbican.certfile = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] barbican.collect_timing = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] barbican.insecure = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] barbican.keyfile = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] barbican.number_of_retries = 60 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] barbican.retry_delay = 1 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] barbican.send_service_user_token = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] barbican.split_loggers = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] barbican.timeout = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] barbican.verify_ssl = True {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] barbican.verify_ssl_path = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] barbican_service_user.auth_section = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] barbican_service_user.auth_type = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] barbican_service_user.cafile = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] barbican_service_user.certfile = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] barbican_service_user.collect_timing = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] barbican_service_user.insecure = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] barbican_service_user.keyfile = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] barbican_service_user.split_loggers = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] barbican_service_user.timeout = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] vault.approle_role_id = **** {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] vault.approle_secret_id = **** {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] vault.auth_method = approle {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] vault.auth_path = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] vault.kv_mountpoint = secret {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] vault.kv_path = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] vault.kv_version = 2 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] vault.namespace = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] vault.root_token_id = **** {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] vault.ssl_ca_crt_file = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] vault.timeout = 60.0 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] vault.token_file = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] vault.token_role = None {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] vault.use_ssl = False {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:30:17 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] ******************************************************************************** {{(pid=77350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 28 10:30:17 devstack sudo[77570]: pam_unix(sudo:session): session closed for user root Jul 28 10:30:17 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.306s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:30:17 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:30:17 devstack sudo[77674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 28 10:30:17 devstack sudo[77674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:30:18 devstack sudo[77674]: pam_unix(sudo:session): session closed for user root Jul 28 10:30:18 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.256s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:30:18 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 10:30:18 devstack cinder-volume[77498]: INFO cinder.brick.local_dev.lvm [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 28 10:30:18 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:30:18 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:30:18 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:30:18 devstack sudo[77763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 28 10:30:18 devstack sudo[77763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:30:18 devstack sudo[77763]: pam_unix(sudo:session): session closed for user root Jul 28 10:30:18 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:30:18 devstack cinder-volume[77498]: DEBUG cinder.brick.local_dev.lvm [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77498) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 28 10:30:18 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:30:18 devstack sudo[77860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 28 10:30:18 devstack sudo[77860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:30:19 devstack sudo[77860]: pam_unix(sudo:session): session closed for user root Jul 28 10:30:19 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.560s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:30:19 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:30:19 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:30:19 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:30:19 devstack sudo[78093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 28 10:30:19 devstack sudo[78093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:30:19 devstack sudo[78093]: pam_unix(sudo:session): session closed for user root Jul 28 10:30:19 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:30:19 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:30:19 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:30:19 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:30:19 devstack sudo[78097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 28 10:30:19 devstack sudo[78097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:30:19 devstack sudo[78097]: pam_unix(sudo:session): session closed for user root Jul 28 10:30:19 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.347s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:30:19 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:30:19 devstack sudo[78180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 28 10:30:19 devstack sudo[78180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:30:19 devstack sudo[78180]: pam_unix(sudo:session): session closed for user root Jul 28 10:30:19 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:30:19 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:30:19 devstack sudo[78183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 28 10:30:19 devstack sudo[78183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:30:20 devstack sudo[78183]: pam_unix(sudo:session): session closed for user root Jul 28 10:30:20 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:30:20 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:30:20 devstack sudo[78254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 10:30:20 devstack sudo[78254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:30:20 devstack sudo[78254]: pam_unix(sudo:session): session closed for user root Jul 28 10:30:20 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:30:20 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:30:20 devstack sudo[78275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 28 10:30:20 devstack sudo[78275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:30:20 devstack sudo[78275]: pam_unix(sudo:session): session closed for user root Jul 28 10:30:20 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:30:20 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:30:20 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:30:20 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:30:20 devstack sudo[78279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 28 10:30:20 devstack sudo[78279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:30:21 devstack sudo[78279]: pam_unix(sudo:session): session closed for user root Jul 28 10:30:21 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.240s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:30:21 devstack cinder-volume[77498]: INFO cinder.volume.drivers.lvm [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 28 10:30:21 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:30:21 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:30:21 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:30:21 devstack sudo[78283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 28 10:30:21 devstack sudo[78283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:30:21 devstack sudo[78283]: pam_unix(sudo:session): session closed for user root Jul 28 10:30:21 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:30:21 devstack cinder-volume[77498]: DEBUG cinder.volume.drivers.lvm [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Updating volume stats {{(pid=77498) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 28 10:30:21 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:30:21 devstack sudo[78286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 28 10:30:21 devstack sudo[78286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:30:21 devstack sudo[78286]: pam_unix(sudo:session): session closed for user root Jul 28 10:30:21 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:30:21 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:30:21 devstack sudo[78289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 10:30:21 devstack sudo[78289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:30:21 devstack sudo[78289]: pam_unix(sudo:session): session closed for user root Jul 28 10:30:21 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:30:21 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:30:21 devstack sudo[78298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 28 10:30:21 devstack sudo[78298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:30:22 devstack sudo[78298]: pam_unix(sudo:session): session closed for user root Jul 28 10:30:22 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:30:22 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:30:22 devstack sudo[78301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 10:30:22 devstack sudo[78301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:30:22 devstack sudo[78301]: pam_unix(sudo:session): session closed for user root Jul 28 10:30:22 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:30:22 devstack cinder-volume[77498]: INFO cinder.volume.driver [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Driver hasn't implemented _init_vendor_properties() Jul 28 10:30:22 devstack cinder-volume[77498]: DEBUG cinder.volume.driver [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77498) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 28 10:30:22 devstack cinder-volume[77498]: DEBUG oslo_db.sqlalchemy.engines [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77498) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 28 10:30:22 devstack cinder-volume[77498]: DEBUG dbcounter [-] [77498] Writer thread running {{(pid=77498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 28 10:30:22 devstack cinder-volume[77498]: DEBUG cinder.db.api [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Building query based on filter {{(pid=77498) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 28 10:30:22 devstack cinder-volume[77498]: DEBUG cinder.image.image_utils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77498) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 28 10:30:22 devstack cinder-volume[77498]: INFO cinder.keymgr.migration [None req-5c0e1db7-b9f3-4f1d-a37f-a7e5704ce520 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 28 10:30:22 devstack cinder-volume[77498]: DEBUG cinder.volume.drivers.lvm [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Updating volume stats {{(pid=77498) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 28 10:30:22 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:30:22 devstack sudo[78307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 28 10:30:22 devstack sudo[78307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:30:22 devstack sudo[78307]: pam_unix(sudo:session): session closed for user root Jul 28 10:30:22 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:30:22 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:30:22 devstack sudo[78310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 10:30:22 devstack sudo[78310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:30:23 devstack sudo[78310]: pam_unix(sudo:session): session closed for user root Jul 28 10:30:23 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:30:23 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:30:23 devstack sudo[78313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 28 10:30:23 devstack sudo[78313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:30:23 devstack sudo[78313]: pam_unix(sudo:session): session closed for user root Jul 28 10:30:23 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:30:23 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:30:23 devstack sudo[78318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 10:30:23 devstack sudo[78318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:30:23 devstack sudo[78318]: pam_unix(sudo:session): session closed for user root Jul 28 10:30:23 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:30:23 devstack cinder-volume[77498]: DEBUG cinder.manager [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Notifying Schedulers of capabilities ... {{(pid=77498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:30:23 devstack cinder-volume[77498]: INFO cinder.volume.manager [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Driver initialization completed successfully. Jul 28 10:30:23 devstack cinder-volume[77498]: INFO cinder.manager [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Initiating service 2 cleanup Jul 28 10:30:23 devstack cinder-volume[77498]: INFO cinder.manager [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Service 2 cleanup completed. Jul 28 10:30:23 devstack cinder-volume[77498]: DEBUG cinder.service [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Creating RPC server for service cinder-volume {{(pid=77498) start /opt/stack/cinder/cinder/service.py:231}} Jul 28 10:30:23 devstack cinder-volume[77498]: DEBUG cinder.service [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77498) start /opt/stack/cinder/cinder/service.py:237}} Jul 28 10:30:23 devstack cinder-volume[77498]: INFO cinder.volume.manager [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 28 10:30:23 devstack cinder-volume[77498]: DEBUG cinder.volume.drivers.lvm [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Updating volume stats {{(pid=77498) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 28 10:30:23 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:30:23 devstack sudo[78321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 28 10:30:23 devstack sudo[78321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:30:24 devstack sudo[78321]: pam_unix(sudo:session): session closed for user root Jul 28 10:30:24 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:30:24 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:30:24 devstack sudo[78324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 10:30:24 devstack sudo[78324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:30:24 devstack sudo[78324]: pam_unix(sudo:session): session closed for user root Jul 28 10:30:24 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:30:24 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:30:24 devstack sudo[78327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 28 10:30:24 devstack sudo[78327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:30:24 devstack sudo[78327]: pam_unix(sudo:session): session closed for user root Jul 28 10:30:24 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:30:24 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:30:24 devstack sudo[78330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 10:30:24 devstack sudo[78330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:30:24 devstack sudo[78330]: pam_unix(sudo:session): session closed for user root Jul 28 10:30:24 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:30:24 devstack cinder-volume[77498]: INFO cinder.volume.manager [None req-e3a33220-d55d-4c23-b17c-8c18e9d03e85 None None] Driver post RPC initialization completed successfully. Jul 28 10:30:27 devstack cinder-volume[77350]: DEBUG dbcounter [-] [77350] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:30:34 devstack cinder-volume[77498]: DEBUG dbcounter [-] [77498] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:30:34 devstack cinder-volume[77498]: DEBUG dbcounter [-] [77498] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=77498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:30:47 devstack cinder-volume[77498]: DEBUG oslo_service.periodic_task [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] Running periodic task VolumeManager._thread_info {{(pid=77498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:30:47 devstack cinder-volume[77498]: DEBUG cinder.volume.manager [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] thread count: 6 {{(pid=77498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 10:30:47 devstack cinder-volume[77498]: DEBUG cinder.volume.manager [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] thread info: [<_MainThread(MainThread, started 132366702186624)>, , , , , ] {{(pid=77498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 10:31:47 devstack cinder-volume[77498]: DEBUG oslo_service.periodic_task [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:31:47 devstack cinder-volume[77498]: DEBUG cinder.volume.drivers.lvm [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] Updating volume stats {{(pid=77498) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 28 10:31:47 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:31:47 devstack sudo[80965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 28 10:31:47 devstack sudo[80965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:31:48 devstack sudo[80965]: pam_unix(sudo:session): session closed for user root Jul 28 10:31:48 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:31:48 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:31:48 devstack sudo[80968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 10:31:48 devstack sudo[80968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:31:48 devstack sudo[80968]: pam_unix(sudo:session): session closed for user root Jul 28 10:31:48 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:31:48 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:31:48 devstack sudo[80971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 28 10:31:48 devstack sudo[80971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:31:48 devstack sudo[80971]: pam_unix(sudo:session): session closed for user root Jul 28 10:31:48 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:31:48 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:31:48 devstack sudo[80974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 10:31:48 devstack sudo[80974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:31:48 devstack sudo[80974]: pam_unix(sudo:session): session closed for user root Jul 28 10:31:48 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:31:48 devstack cinder-volume[77498]: DEBUG cinder.manager [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] Notifying Schedulers of capabilities ... {{(pid=77498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:31:48 devstack cinder-volume[77498]: DEBUG oslo_service.periodic_task [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] Running periodic task VolumeManager._thread_info {{(pid=77498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:31:48 devstack cinder-volume[77498]: DEBUG cinder.volume.manager [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] thread count: 6 {{(pid=77498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 10:31:48 devstack cinder-volume[77498]: DEBUG cinder.volume.manager [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] thread info: [<_MainThread(MainThread, started 132366702186624)>, , , , , ] {{(pid=77498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 10:32:34 devstack cinder-volume[77498]: DEBUG dbcounter [-] [77498] Writing DB stats cinder:SELECT=1 {{(pid=77498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:32:34 devstack cinder-volume[77498]: DEBUG dbcounter [-] [77498] Writing DB stats cinder:UPDATE=1 {{(pid=77498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:32:47 devstack cinder-volume[77498]: DEBUG oslo_service.periodic_task [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:32:47 devstack cinder-volume[77498]: DEBUG cinder.volume.drivers.lvm [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] Updating volume stats {{(pid=77498) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 28 10:32:47 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:32:47 devstack sudo[83958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 28 10:32:47 devstack sudo[83958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:32:48 devstack sudo[83958]: pam_unix(sudo:session): session closed for user root Jul 28 10:32:48 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:32:48 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:32:48 devstack sudo[83961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 10:32:48 devstack sudo[83961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:32:48 devstack sudo[83961]: pam_unix(sudo:session): session closed for user root Jul 28 10:32:48 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:32:48 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:32:48 devstack sudo[83964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 28 10:32:48 devstack sudo[83964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:32:48 devstack sudo[83964]: pam_unix(sudo:session): session closed for user root Jul 28 10:32:48 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:32:48 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:32:48 devstack sudo[83968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 10:32:48 devstack sudo[83968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:32:48 devstack sudo[83968]: pam_unix(sudo:session): session closed for user root Jul 28 10:32:48 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:32:48 devstack cinder-volume[77498]: DEBUG cinder.manager [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] Notifying Schedulers of capabilities ... {{(pid=77498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:32:48 devstack cinder-volume[77498]: DEBUG oslo_service.periodic_task [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] Running periodic task VolumeManager._thread_info {{(pid=77498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:32:48 devstack cinder-volume[77498]: DEBUG cinder.volume.manager [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] thread count: 6 {{(pid=77498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 10:32:48 devstack cinder-volume[77498]: DEBUG cinder.volume.manager [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] thread info: [<_MainThread(MainThread, started 132366702186624)>, , , , , ] {{(pid=77498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 10:33:47 devstack cinder-volume[77498]: DEBUG oslo_service.periodic_task [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:33:47 devstack cinder-volume[77498]: DEBUG cinder.volume.drivers.lvm [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] Updating volume stats {{(pid=77498) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 28 10:33:47 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:33:47 devstack sudo[86202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 28 10:33:47 devstack sudo[86202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:33:48 devstack sudo[86202]: pam_unix(sudo:session): session closed for user root Jul 28 10:33:48 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:33:48 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:33:48 devstack sudo[86205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 10:33:48 devstack sudo[86205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:33:48 devstack sudo[86205]: pam_unix(sudo:session): session closed for user root Jul 28 10:33:48 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:33:48 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:33:48 devstack sudo[86208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 28 10:33:48 devstack sudo[86208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:33:48 devstack sudo[86208]: pam_unix(sudo:session): session closed for user root Jul 28 10:33:48 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:33:48 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:33:48 devstack sudo[86214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 10:33:48 devstack sudo[86214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:33:48 devstack sudo[86214]: pam_unix(sudo:session): session closed for user root Jul 28 10:33:48 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:33:48 devstack cinder-volume[77498]: DEBUG cinder.manager [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] Notifying Schedulers of capabilities ... {{(pid=77498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:33:48 devstack cinder-volume[77498]: DEBUG oslo_service.periodic_task [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] Running periodic task VolumeManager._thread_info {{(pid=77498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:33:48 devstack cinder-volume[77498]: DEBUG cinder.volume.manager [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] thread count: 6 {{(pid=77498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 10:33:48 devstack cinder-volume[77498]: DEBUG cinder.volume.manager [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] thread info: [<_MainThread(MainThread, started 132366702186624)>, , , , , ] {{(pid=77498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 10:34:34 devstack cinder-volume[77498]: DEBUG dbcounter [-] [77498] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=77498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:34:47 devstack cinder-volume[77498]: DEBUG oslo_service.periodic_task [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:34:47 devstack cinder-volume[77498]: DEBUG cinder.volume.drivers.lvm [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] Updating volume stats {{(pid=77498) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 28 10:34:47 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:34:47 devstack sudo[87464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 28 10:34:47 devstack sudo[87464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:34:48 devstack sudo[87464]: pam_unix(sudo:session): session closed for user root Jul 28 10:34:48 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:34:48 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:34:48 devstack sudo[87467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 10:34:48 devstack sudo[87467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:34:48 devstack sudo[87467]: pam_unix(sudo:session): session closed for user root Jul 28 10:34:48 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:34:48 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:34:48 devstack sudo[87548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 28 10:34:48 devstack sudo[87548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:34:48 devstack sudo[87548]: pam_unix(sudo:session): session closed for user root Jul 28 10:34:48 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:34:48 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:34:48 devstack sudo[87551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 10:34:48 devstack sudo[87551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:34:48 devstack cinder-volume[77350]: INFO oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] Caught SIGTERM, stopping children Jul 28 10:34:48 devstack cinder-volume[77350]: DEBUG oslo_concurrency.lockutils [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] Acquiring lock "singleton_lock" {{(pid=77350) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 28 10:34:48 devstack cinder-volume[77350]: DEBUG oslo_concurrency.lockutils [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] Acquired lock "singleton_lock" {{(pid=77350) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 28 10:34:48 devstack cinder-volume[77350]: DEBUG oslo_concurrency.lockutils [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] Releasing lock "singleton_lock" {{(pid=77350) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 28 10:34:48 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] Stop services. {{(pid=77350) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 28 10:34:48 devstack cinder-volume[77350]: DEBUG oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] Killing children. {{(pid=77350) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 28 10:34:48 devstack cinder-volume[77350]: INFO oslo_service.backend._eventlet.service [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] Waiting on 1 children to exit Jul 28 10:34:48 devstack sudo[87551]: pam_unix(sudo:session): session closed for user root Jul 28 10:34:48 devstack cinder-volume[77498]: DEBUG oslo_concurrency.processutils [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=77498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:34:48 devstack cinder-volume[77498]: DEBUG cinder.manager [None req-a2000794-be0a-4ec7-a40c-3aa75d292ca9 None None] Notifying Schedulers of capabilities ... {{(pid=77498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:34:53 devstack cinder-volume[77498]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 28 10:34:54 devstack cinder-volume[87561]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 28 10:34:54 devstack cinder-volume[87561]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 28 10:34:54 devstack cinder-volume[87561]: we strongly recommend against using it for new projects. Jul 28 10:34:54 devstack cinder-volume[87561]: If you are already using Eventlet, we recommend migrating to a different Jul 28 10:34:54 devstack cinder-volume[87561]: framework. For more detail see Jul 28 10:34:54 devstack cinder-volume[87561]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 28 10:34:54 devstack cinder-volume[87561]: import eventlet # noqa Jul 28 10:34:56 devstack cinder-volume[87561]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87561) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 28 10:34:56 devstack cinder-volume[87561]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87561) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 28 10:34:56 devstack cinder-volume[87561]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87561) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 28 10:34:56 devstack cinder-volume[87561]: INFO dbcounter [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] Registered counter for database cinder Jul 28 10:34:56 devstack cinder-volume[87561]: DEBUG oslo_db.sqlalchemy.engines [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87561) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG dbcounter [-] [87561] Writer thread running {{(pid=87561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 28 10:34:57 devstack cinder-volume[87561]: INFO cinder.rpc [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 28 10:34:57 devstack cinder-volume[87561]: INFO cinder.rpc [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_db.sqlalchemy.engines [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87561) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 28 10:34:57 devstack cinder-volume[87561]: INFO cinder.volume.manager [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] Determined volume DB was empty at startup. Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG cinder.volume.manager [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87561) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 28 10:34:57 devstack cinder-volume[87561]: INFO cinder.volume.manager [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 28 10:34:57 devstack cinder-volume[87561]: WARNING stevedore.named [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 28 10:34:57 devstack cinder-volume[87561]: WARNING castellan.key_manager [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 28 10:34:57 devstack cinder-volume[87561]: WARNING cinder.keymgr.conf_key_mgr [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 28 10:34:57 devstack cinder-volume[87561]: INFO cinder.volume.manager [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_db.sqlalchemy.engines [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87561) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 28 10:34:57 devstack cinder-volume[87561]: INFO oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] Starting 1 workers Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] Started child 87777 {{(pid=87561) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] Full set of CONF: {{(pid=87561) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] ******************************************************************************** {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] Configuration options gathered from: {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] ================================================================================ {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] allow_availability_zone_fallback = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] allow_compression_on_image_upload = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] allowed_direct_url_schemes = [] {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] api_rate_limit = True {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] auth_strategy = keystone {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_availability_zone = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_host = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_name = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_stats_polling_interval = 60 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backup_api_class = cinder.backup.api.API {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backup_name_template = backup-%s {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backup_use_same_host = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backup_use_temp_snapshot = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] chap_password = **** {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] chap_username = {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cinder_internal_tenant_project_id = 93d72099b9c049a7a7189217d6558aa3 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cinder_internal_tenant_user_id = 2eca44d61a6b4fa4820f4464d383df8c {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cluster = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] compression_format = gzip {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] compute_api_class = cinder.compute.nova.API {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] config_dir = [] {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] config_source = [] {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] control_exchange = openstack {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] debug = True {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] default_availability_zone = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] default_group_type = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] default_volume_type = QuobyteHD {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87777]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] disk_geometry = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] driver_client_cert = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] driver_client_cert_key = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] driver_data_namespace = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] driver_ssl_cert_path = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] driver_ssl_cert_verify = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] driver_use_ssl = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] enable_new_services = True {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] enable_unsupported_driver = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] enabled_backends = ['QuobyteHD'] {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] enforce_multipath_for_image_xfer = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] filter_function = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] glance_api_insecure = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] glance_api_servers = ['http://192.168.122.251/image'] {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] glance_api_ssl_compression = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] glance_ca_certificates_file = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] glance_catalog_info = image:glance:publicURL {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] glance_certfile = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] glance_keyfile = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] glance_num_retries = 3 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] glance_request_timeout = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] goodness_function = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] graceful_shutdown_timeout = 5 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] group_api_class = cinder.group.api.API {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] host = devstack {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] image_compress_on_upload = True {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] image_conversion_address_space_limit = 1 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] image_conversion_cpu_limit = 60 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] image_conversion_disable = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] image_upload_use_cinder_backend = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] image_upload_use_internal_tenant = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] image_volume_cache_enabled = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] image_volume_cache_max_count = 0 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] image_volume_cache_max_size_gb = 0 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] init_host_max_objects_retrieval = 0 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] instance_format = [instance: %(uuid)s] {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] iscsi_target_flags = {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] iscsi_write_cache = on {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] iser_helper = tgtadm {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] iser_ip_address = 192.168.122.251 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] iser_port = 3260 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] log_color = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] log_config_append = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] log_dir = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] log_file = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] log_options = True {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] log_rotate_interval = 1 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] log_rotate_interval_type = days {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] log_rotation_type = none {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] max_age = 0 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] max_logfile_count = 30 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] max_logfile_size_mb = 200 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] max_over_subscription_ratio = 20.0 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] message_reap_interval = 86400 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] message_ttl = 2592000 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] migration_create_volume_timeout_secs = 300 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] monkey_patch = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] monkey_patch_modules = [] {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] my_ip = 192.168.122.251 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] no_snapshot_gb_quota = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] num_iser_scan_tries = 3 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] num_shell_tries = 3 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] num_volume_device_scan_tries = 3 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] nvmeof_conn_info_version = 1 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] nvmet_ns_id = 10 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] nvmet_port_id = 1 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] osapi_max_limit = 1000 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] osapi_volume_ext_list = [] {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] osapi_volume_listen_port = 8776 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] osapi_volume_use_ssl = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] osapi_volume_workers = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] per_volume_size_limit = -1 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] periodic_fuzzy_delay = 60 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] periodic_interval = 60 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] public_endpoint = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] publish_errors = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] quota_backup_gigabytes = 1000 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] quota_backups = 10 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] quota_gigabytes = 1000 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] quota_groups = 10 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] quota_snapshots = 10 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] quota_volumes = 10 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] rate_limit_burst = 0 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] rate_limit_except_level = CRITICAL {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] rate_limit_interval = 0 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] reinit_driver_count = 3 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] replication_device = **** {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] report_discard_supported = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] report_interval = 120 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] reservation_clean_interval = 86400 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] reservation_expire = 86400 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] reserved_image_namespaces = [] {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] reserved_percentage = 0 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] rpc_response_timeout = 120 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] run_external_periodic_tasks = True {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] scst_target_driver = iscsi {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] scst_target_iqn_name = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] service_down_time = 720 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] shell_completion = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] snapshot_name_template = snapshot-%s {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] split_loggers = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] state_path = /opt/stack/data/cinder {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] storage_availability_zone = nova {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] storage_protocol = iSCSI {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] syslog_log_facility = LOG_USER {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] target_helper = lioadm {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] target_ip_address = 192.168.122.251 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] target_port = 3260 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] target_protocol = iscsi {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] target_secondary_ip_addresses = [] {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] trace_flags = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] transport_url = **** {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] until_refresh = 0 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] use_chap_auth = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] use_default_quota_class = True {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] use_journal = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] use_json = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] use_multipath_for_image_xfer = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] use_stderr = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] use_syslog = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] verify_glance_signatures = enabled {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] volume_api_class = cinder.volume.api.API {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] volume_backend_name = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] volume_clear = zero {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] volume_clear_ionice = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] volume_clear_size = 0 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] volume_copy_bps_limit = 0 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] volume_dd_blocksize = 1M {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] volume_name_template = volume-%s {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] volume_service_inithost_offload = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] volume_usage_audit_period = month {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] zoning_mode = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_concurrency.disable_process_locking = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87777]: INFO cinder.volume.manager [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] Starting volume driver QuobyteDriver (1.2) Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87777]: DEBUG cinder.volume.drivers.remotefs [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87777) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] keystone_authtoken.auth_section = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] keystone_authtoken.auth_type = password {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] keystone_authtoken.auth_version = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] keystone_authtoken.cache = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] keystone_authtoken.certfile = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] keystone_authtoken.include_service_catalog = True {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] keystone_authtoken.insecure = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] keystone_authtoken.interface = public {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] keystone_authtoken.keyfile = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] keystone_authtoken.memcache_password = {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] keystone_authtoken.memcache_username = {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] keystone_authtoken.region_name = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] keystone_authtoken.service_type = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.251/identity {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cache.backend = dogpile.cache.null {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cache.backend_argument = **** {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cache.backend_expiration_time = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cache.config_prefix = cache.oslo {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cache.debug_cache_backend = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cache.enable_retry_client = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cache.enable_socket_keepalive = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cache.enabled = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cache.expiration_time = 600 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cache.hashclient_retry_attempts = 2 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cache.memcache_dead_retry = 300 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cache.memcache_pool_maxsize = 10 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cache.memcache_sasl_enabled = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cache.password = **** {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cache.proxies = [] {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cache.redis_db = 0 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cache.redis_server = localhost:6379 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cache.retry_attempts = 2 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cache.retry_delay = 0.0 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cache.socket_keepalive_count = 1 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cache.socket_keepalive_idle = 1 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cache.socket_keepalive_interval = 1 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cache.socket_timeout = 1.0 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cache.tls_allowed_ciphers = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cache.tls_cafile = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cache.tls_certfile = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cache.tls_enabled = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cache.tls_keyfile = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cache.username = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] coordination.backend_url = **** {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] database.asyncio_connection = **** {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] database.asyncio_slave_connection = **** {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] database.backend = sqlalchemy {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] database.connection = **** {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] database.connection_debug = 0 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] database.connection_parameters = {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] database.connection_recycle_time = 3600 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] database.connection_trace = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] database.db_inc_retry_interval = True {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] database.db_max_retries = 20 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] database.db_max_retry_interval = 10 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] database.db_retry_interval = 1 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] database.max_overflow = 50 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] database.max_pool_size = 5 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] database.max_retries = 10 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] database.mysql_wsrep_sync_wait = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] database.pool_timeout = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] database.retry_interval = 10 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] database.slave_connection = **** {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] database.sqlite_synchronous = True {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] database.synchronous_reader = True {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] database.use_db_reconnect = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] profiler.connection_string = messaging:// {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] profiler.enabled = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] profiler.es_doc_type = notification {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] profiler.es_scroll_size = 10000 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] profiler.es_scroll_time = 2m {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] profiler.filter_error_trace = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] profiler.hmac_keys = **** {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] profiler.sentinel_service_name = mymaster {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] profiler.socket_timeout = 0.1 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] profiler.trace_requests = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] profiler.trace_sqlalchemy = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] profiler_jaeger.process_tags = {} {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] profiler_jaeger.service_name_prefix = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] profiler_otlp.service_name_prefix = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_policy.enforce_new_defaults = True {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_policy.policy_default_rule = default {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_policy.policy_file = policy.yaml {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] privsep_osbrick.group = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] privsep_osbrick.helper_command = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] privsep_osbrick.user = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cinder_sys_admin.group = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cinder_sys_admin.helper_command = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] cinder_sys_admin.user = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] service_user.auth_section = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] service_user.auth_type = password {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] service_user.cafile = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] service_user.certfile = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] service_user.collect_timing = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] service_user.insecure = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] service_user.keyfile = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] service_user.send_service_user_token = True {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] service_user.split_loggers = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] service_user.timeout = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] glance.auth_section = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] glance.auth_type = password {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] glance.certfile = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] glance.collect_timing = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] glance.insecure = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] glance.keyfile = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] glance.region_name = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] glance.split_loggers = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] glance.timeout = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.backend_availability_zone = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.chap_password = **** {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.chap_username = {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.disk_geometry = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.driver_client_cert = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.driver_client_cert_key = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.driver_data_namespace = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.driver_use_ssl = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87777]: DEBUG cinder.volume.drivers.quobyte [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87777) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 28 10:34:57 devstack cinder-volume[87777]: WARNING cinder.volume.drivers.quobyte [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 28 10:34:57 devstack cinder-volume[87777]: WARNING cinder.volume.drivers.quobyte [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.extra_capabilities = {} {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.filter_function = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.goodness_function = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87777]: DEBUG oslo_concurrency.processutils [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] Running cmd (subprocess): mount.quobyte {{(pid=87777) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.iscsi_target_flags = {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.iscsi_write_cache = on {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.iser_helper = tgtadm {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.iser_ip_address = 192.168.122.251 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.iser_port = 3260 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.nas_host = {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.nas_login = admin {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.nas_mount_options = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.nas_password = **** {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.nas_private_key = {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.nas_share_path = {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.num_shell_tries = 3 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.quobyte_volume_url = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.replication_device = **** {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.report_discard_supported = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.reserved_percentage = 0 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.target_helper = tgtadm {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.target_ip_address = 192.168.122.251 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.target_port = 3260 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.target_protocol = iscsi {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.trace_flags = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.unique_fqdn_network = True {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.use_chap_auth = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.volume_backend_name = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.volume_clear = zero {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.volume_clear_ionice = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.volume_clear_size = 0 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_reports.file_event_handler = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_reports.log_dir = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.backend_availability_zone = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.backend_host = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.chap_password = **** {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.chap_username = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.chiscsi_conf = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.disk_geometry = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.driver_client_cert = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.driver_data_namespace = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.driver_use_ssl = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.extra_capabilities = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.filter_function = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.goodness_function = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.iser_helper = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.iser_ip_address = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.iser_port = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.iser_target_prefix = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.nas_host = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack quobyte-client[87783]: Reading configuration file: /etc/quobyte/client.cfg Jul 28 10:34:57 devstack quobyte-client[87783]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.nas_login = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.nas_mount_options = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87777]: DEBUG oslo_concurrency.processutils [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] CMD "mount.quobyte" returned: 1 in 0.064s {{(pid=87777) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.nas_password = **** {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.nas_private_key = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:57 devstack cinder-volume[87777]: DEBUG oslo_concurrency.lockutils [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87777) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:34:57 devstack cinder-volume[87777]: DEBUG oslo_concurrency.lockutils [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87777) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:34:57 devstack cinder-volume[87777]: DEBUG cinder.volume.drivers.quobyte [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=87777) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87777]: INFO cinder.volume.drivers.quobyte [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 ... Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.nas_share_path = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.nas_ssh_port = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87777]: DEBUG oslo_concurrency.processutils [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f -c /etc/quobyte/client-cinder.cfg {{(pid=87777) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.num_shell_tries = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.nvmet_port_id = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.replication_device = **** {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.report_discard_supported = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.reserved_percentage = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.scst_target_driver = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.storage_protocol = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.target_helper = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.target_ip_address = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.target_port = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.target_prefix = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.target_protocol = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.trace_flags = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.use_chap_auth = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.volume_clear = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.volume_clear_size = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] QuobyteHD.volumes_dir = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack sudo[87784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f -c /etc/quobyte/client-cinder.cfg Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack sudo[87784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_rabbit.ssl = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_notifications.driver = [] {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_notifications.retry = -1 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] key_manager.fixed_key = **** {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] barbican.barbican_api_version = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] barbican.barbican_endpoint = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] barbican.barbican_endpoint_type = public {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] barbican.barbican_region_name = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] barbican.cafile = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] barbican.certfile = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] barbican.collect_timing = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] barbican.insecure = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] barbican.keyfile = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] barbican.number_of_retries = 60 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] barbican.retry_delay = 1 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] barbican.send_service_user_token = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] barbican.split_loggers = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] barbican.timeout = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] barbican.verify_ssl = True {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] barbican.verify_ssl_path = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] barbican_service_user.auth_section = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] barbican_service_user.auth_type = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] barbican_service_user.cafile = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] barbican_service_user.certfile = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] barbican_service_user.collect_timing = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] barbican_service_user.insecure = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] barbican_service_user.keyfile = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] barbican_service_user.split_loggers = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] barbican_service_user.timeout = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] vault.approle_role_id = **** {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] vault.approle_secret_id = **** {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] vault.auth_method = approle {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] vault.auth_path = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] vault.kv_mountpoint = secret {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] vault.kv_path = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] vault.kv_version = 2 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] vault.namespace = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] vault.root_token_id = **** {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] vault.ssl_ca_crt_file = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] vault.timeout = 60.0 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] vault.token_file = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] vault.token_role = None {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] vault.use_ssl = False {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:34:58 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] ******************************************************************************** {{(pid=87561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 28 10:34:58 devstack sudo[87784]: pam_unix(sudo:session): session closed for user root Jul 28 10:34:58 devstack cinder-volume[87777]: DEBUG oslo_concurrency.processutils [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.383s {{(pid=87777) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:34:58 devstack cinder-volume[87777]: INFO cinder.volume.drivers.quobyte [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 succeeded Jul 28 10:34:58 devstack cinder-volume[87777]: DEBUG cinder.volume.drivers.quobyte [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=87777) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:34:58 devstack cinder-volume[87777]: DEBUG oslo_concurrency.lockutils [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.396s {{(pid=87777) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:34:58 devstack cinder-volume[87777]: DEBUG oslo_concurrency.processutils [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=87777) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:34:58 devstack sudo[87853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:34:58 devstack sudo[87853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:34:58 devstack sudo[87853]: pam_unix(sudo:session): session closed for user root Jul 28 10:34:58 devstack cinder-volume[87777]: DEBUG oslo_concurrency.processutils [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.248s {{(pid=87777) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:34:58 devstack cinder-volume[87777]: INFO cinder.volume.driver [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] Driver hasn't implemented _init_vendor_properties() Jul 28 10:34:58 devstack cinder-volume[87777]: DEBUG cinder.volume.driver [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577056884766, 'free_capacity_gb': 1775.7577056884766, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87777) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 28 10:34:58 devstack cinder-volume[87777]: DEBUG oslo_db.sqlalchemy.engines [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87777) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 28 10:34:58 devstack cinder-volume[87777]: DEBUG dbcounter [-] [87777] Writer thread running {{(pid=87777) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 28 10:34:58 devstack cinder-volume[87777]: DEBUG cinder.db.api [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] Building query based on filter {{(pid=87777) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 28 10:34:58 devstack cinder-volume[87777]: DEBUG cinder.image.image_utils [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87777) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 28 10:34:58 devstack cinder-volume[77498]: DEBUG oslo_concurrency.lockutils [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] Acquiring lock "singleton_lock" {{(pid=77498) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 28 10:34:58 devstack cinder-volume[77498]: DEBUG oslo_concurrency.lockutils [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] Acquired lock "singleton_lock" {{(pid=77498) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 28 10:34:58 devstack cinder-volume[77498]: DEBUG oslo_concurrency.lockutils [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] Releasing lock "singleton_lock" {{(pid=77498) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 28 10:34:58 devstack cinder-volume[87777]: INFO cinder.keymgr.migration [None req-6ea3883f-c6db-48e7-b86d-5689e1da9353 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 28 10:34:58 devstack cinder-volume[87777]: DEBUG oslo_concurrency.lockutils [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87777) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:34:58 devstack cinder-volume[87777]: DEBUG oslo_concurrency.lockutils [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87777) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:34:58 devstack cinder-volume[87777]: DEBUG cinder.volume.drivers.quobyte [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=87777) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:34:58 devstack cinder-volume[77498]: WARNING amqp [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 28 10:34:58 devstack cinder-volume[87777]: DEBUG cinder.volume.drivers.quobyte [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=87777) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:34:58 devstack cinder-volume[87777]: DEBUG oslo_concurrency.lockutils [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87777) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:34:58 devstack cinder-volume[87777]: DEBUG oslo_concurrency.processutils [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=87777) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:34:58 devstack cinder-volume[77498]: WARNING amqp [None req-4b3c1529-1390-48f6-9ac1-4c808cc33b58 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 28 10:34:58 devstack sudo[87857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:34:58 devstack sudo[87857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:34:59 devstack sudo[87857]: pam_unix(sudo:session): session closed for user root Jul 28 10:34:59 devstack cinder-volume[87777]: DEBUG oslo_concurrency.processutils [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.228s {{(pid=87777) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:34:59 devstack cinder-volume[87777]: DEBUG cinder.manager [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] Notifying Schedulers of capabilities ... {{(pid=87777) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:34:59 devstack cinder-volume[87777]: INFO cinder.volume.manager [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] Driver initialization completed successfully. Jul 28 10:34:59 devstack cinder-volume[87777]: INFO cinder.manager [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] Initiating service 3 cleanup Jul 28 10:34:59 devstack cinder-volume[87777]: INFO cinder.manager [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] Service 3 cleanup completed. Jul 28 10:34:59 devstack cinder-volume[87777]: DEBUG cinder.service [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] Creating RPC server for service cinder-volume {{(pid=87777) start /opt/stack/cinder/cinder/service.py:231}} Jul 28 10:34:59 devstack cinder-volume[87777]: DEBUG cinder.service [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87777) start /opt/stack/cinder/cinder/service.py:237}} Jul 28 10:34:59 devstack cinder-volume[87777]: INFO cinder.volume.manager [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 28 10:34:59 devstack cinder-volume[87777]: DEBUG oslo_concurrency.lockutils [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87777) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:34:59 devstack cinder-volume[87777]: DEBUG oslo_concurrency.lockutils [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87777) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:34:59 devstack cinder-volume[87777]: DEBUG cinder.volume.drivers.quobyte [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=87777) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:34:59 devstack cinder-volume[87777]: DEBUG cinder.volume.drivers.quobyte [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=87777) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:34:59 devstack cinder-volume[87777]: DEBUG oslo_concurrency.lockutils [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87777) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:34:59 devstack cinder-volume[87777]: DEBUG oslo_concurrency.processutils [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=87777) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:34:59 devstack sudo[87864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:34:59 devstack sudo[87864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:34:59 devstack sudo[87864]: pam_unix(sudo:session): session closed for user root Jul 28 10:34:59 devstack cinder-volume[87777]: DEBUG oslo_concurrency.processutils [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.252s {{(pid=87777) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:34:59 devstack cinder-volume[87777]: INFO cinder.volume.manager [None req-d432cf66-f921-4251-b32f-f4f97819c6f2 None None] Driver post RPC initialization completed successfully. Jul 28 10:35:00 devstack cinder-volume[87777]: DEBUG oslo_service.periodic_task [None req-1abcef8b-4871-45a2-b567-a8c2696fd2b0 None None] Running periodic task VolumeManager._thread_info {{(pid=87777) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:35:00 devstack cinder-volume[87777]: DEBUG cinder.volume.manager [None req-1abcef8b-4871-45a2-b567-a8c2696fd2b0 None None] thread count: 6 {{(pid=87777) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 10:35:00 devstack cinder-volume[87777]: DEBUG cinder.volume.manager [None req-1abcef8b-4871-45a2-b567-a8c2696fd2b0 None None] thread info: [<_MainThread(MainThread, started 139805357531264)>, , , , , ] {{(pid=87777) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 10:35:03 devstack cinder-volume[87561]: INFO oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] Caught SIGTERM, stopping children Jul 28 10:35:03 devstack cinder-volume[87561]: DEBUG oslo_concurrency.lockutils [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] Acquiring lock "singleton_lock" {{(pid=87561) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 28 10:35:03 devstack cinder-volume[87561]: DEBUG oslo_concurrency.lockutils [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] Acquired lock "singleton_lock" {{(pid=87561) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 28 10:35:03 devstack cinder-volume[87561]: DEBUG oslo_concurrency.lockutils [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] Releasing lock "singleton_lock" {{(pid=87561) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 28 10:35:03 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] Stop services. {{(pid=87561) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 28 10:35:03 devstack cinder-volume[87561]: DEBUG oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] Killing children. {{(pid=87561) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 28 10:35:03 devstack cinder-volume[87561]: INFO oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] Waiting on 1 children to exit Jul 28 10:35:07 devstack cinder-volume[87777]: DEBUG oslo_concurrency.lockutils [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] Acquiring lock "singleton_lock" {{(pid=87777) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 28 10:35:07 devstack cinder-volume[87777]: DEBUG oslo_concurrency.lockutils [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] Acquired lock "singleton_lock" {{(pid=87777) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 28 10:35:07 devstack cinder-volume[87777]: DEBUG oslo_concurrency.lockutils [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] Releasing lock "singleton_lock" {{(pid=87777) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 28 10:35:07 devstack cinder-volume[87777]: WARNING amqp [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 28 10:35:07 devstack cinder-volume[87777]: WARNING amqp [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 28 10:35:07 devstack cinder-volume[87561]: INFO oslo_service.backend._eventlet.service [None req-031dd638-722e-4f46-bd5f-e20851cc04a0 None None] Child 87777 exited with status 0 Jul 28 10:35:07 devstack cinder-volume[88070]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 28 10:35:07 devstack cinder-volume[88070]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 28 10:35:07 devstack cinder-volume[88070]: we strongly recommend against using it for new projects. Jul 28 10:35:07 devstack cinder-volume[88070]: If you are already using Eventlet, we recommend migrating to a different Jul 28 10:35:07 devstack cinder-volume[88070]: framework. For more detail see Jul 28 10:35:07 devstack cinder-volume[88070]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 28 10:35:07 devstack cinder-volume[88070]: import eventlet # noqa Jul 28 10:35:10 devstack cinder-volume[88070]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88070) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 28 10:35:10 devstack cinder-volume[88070]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88070) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 28 10:35:10 devstack cinder-volume[88070]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88070) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 28 10:35:11 devstack cinder-volume[88070]: INFO dbcounter [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] Registered counter for database cinder Jul 28 10:35:11 devstack cinder-volume[88070]: DEBUG oslo_db.sqlalchemy.engines [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88070) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 28 10:35:11 devstack cinder-volume[88070]: DEBUG dbcounter [-] [88070] Writer thread running {{(pid=88070) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 28 10:35:11 devstack cinder-volume[88070]: INFO cinder.rpc [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 28 10:35:11 devstack cinder-volume[88070]: INFO cinder.rpc [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 28 10:35:11 devstack cinder-volume[88070]: DEBUG oslo_db.sqlalchemy.engines [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88070) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 28 10:35:12 devstack cinder-volume[88070]: INFO cinder.volume.manager [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] Determined volume DB was empty at startup. Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG cinder.volume.manager [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88070) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 28 10:35:12 devstack cinder-volume[88070]: WARNING stevedore.named [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 28 10:35:12 devstack cinder-volume[88070]: WARNING castellan.key_manager [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 28 10:35:12 devstack cinder-volume[88070]: WARNING cinder.keymgr.conf_key_mgr [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 28 10:35:12 devstack cinder-volume[88070]: INFO cinder.volume.manager [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_db.sqlalchemy.engines [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88070) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 28 10:35:12 devstack cinder-volume[88070]: INFO oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] Starting 1 workers Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] Started child 88413 {{(pid=88070) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] Full set of CONF: {{(pid=88070) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] ******************************************************************************** {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] Configuration options gathered from: {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] ================================================================================ {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] allow_availability_zone_fallback = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] allow_compression_on_image_upload = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] allowed_direct_url_schemes = [] {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] api_rate_limit = True {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] auth_strategy = keystone {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_availability_zone = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_host = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_name = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_stats_polling_interval = 60 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backup_api_class = cinder.backup.api.API {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backup_name_template = backup-%s {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backup_use_same_host = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backup_use_temp_snapshot = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] chap_password = **** {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88413]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] chap_username = {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cinder_internal_tenant_project_id = 93d72099b9c049a7a7189217d6558aa3 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cinder_internal_tenant_user_id = 2eca44d61a6b4fa4820f4464d383df8c {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cluster = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] compression_format = gzip {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] compute_api_class = cinder.compute.nova.API {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] config_dir = [] {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] config_source = [] {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] control_exchange = openstack {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] debug = True {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] default_availability_zone = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] default_group_type = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] default_volume_type = QuobyteHD {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] disk_geometry = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] driver_client_cert = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] driver_client_cert_key = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] driver_data_namespace = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] driver_ssl_cert_path = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] driver_ssl_cert_verify = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] driver_use_ssl = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] enable_new_services = True {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] enable_unsupported_driver = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] enabled_backends = ['QuobyteHD'] {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] enforce_multipath_for_image_xfer = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] filter_function = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] glance_api_insecure = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] glance_api_servers = ['http://192.168.122.251/image'] {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] glance_api_ssl_compression = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] glance_ca_certificates_file = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] glance_catalog_info = image:glance:publicURL {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] glance_certfile = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] glance_keyfile = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] glance_num_retries = 3 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] glance_request_timeout = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] goodness_function = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] graceful_shutdown_timeout = 5 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] group_api_class = cinder.group.api.API {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] host = devstack {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] image_compress_on_upload = True {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] image_conversion_address_space_limit = 1 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] image_conversion_cpu_limit = 60 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] image_conversion_disable = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] image_upload_use_cinder_backend = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] image_upload_use_internal_tenant = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] image_volume_cache_enabled = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] image_volume_cache_max_count = 0 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] image_volume_cache_max_size_gb = 0 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] init_host_max_objects_retrieval = 0 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] instance_format = [instance: %(uuid)s] {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] iscsi_target_flags = {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] iscsi_write_cache = on {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] iser_helper = tgtadm {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] iser_ip_address = 192.168.122.251 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] iser_port = 3260 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] log_color = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] log_config_append = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] log_dir = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] log_file = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] log_options = True {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] log_rotate_interval = 1 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] log_rotate_interval_type = days {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] log_rotation_type = none {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] max_age = 0 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] max_logfile_count = 30 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] max_logfile_size_mb = 200 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] max_over_subscription_ratio = 20.0 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] message_reap_interval = 86400 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] message_ttl = 2592000 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] migration_create_volume_timeout_secs = 300 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] monkey_patch = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] monkey_patch_modules = [] {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] my_ip = 192.168.122.251 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] no_snapshot_gb_quota = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] num_iser_scan_tries = 3 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] num_shell_tries = 3 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] num_volume_device_scan_tries = 3 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] nvmeof_conn_info_version = 1 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] nvmet_ns_id = 10 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] nvmet_port_id = 1 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] osapi_max_limit = 1000 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] osapi_volume_ext_list = [] {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] osapi_volume_listen = 0.0.0.0 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] osapi_volume_listen_port = 8776 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] osapi_volume_use_ssl = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] osapi_volume_workers = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] per_volume_size_limit = -1 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] periodic_fuzzy_delay = 60 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] periodic_interval = 60 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] project_id_regex = [0-9a-f\-]+ {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] public_endpoint = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] publish_errors = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] quota_backup_gigabytes = 1000 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] quota_backups = 10 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] quota_gigabytes = 1000 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] quota_groups = 10 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] quota_snapshots = 10 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] quota_volumes = 10 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] rate_limit_burst = 0 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] rate_limit_except_level = CRITICAL {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] rate_limit_interval = 0 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] reinit_driver_count = 3 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] replication_device = **** {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] Starting volume driver QuobyteDriver (1.2) Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] report_discard_supported = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88413) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] report_interval = 120 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] reservation_clean_interval = 86400 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] reservation_expire = 86400 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] reserved_image_namespaces = [] {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] reserved_percentage = 0 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] rpc_response_timeout = 120 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] run_external_periodic_tasks = True {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] scst_target_driver = iscsi {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] scst_target_iqn_name = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] service_down_time = 720 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] shell_completion = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] snapshot_name_template = snapshot-%s {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] split_loggers = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] state_path = /opt/stack/data/cinder {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] storage_availability_zone = nova {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] storage_protocol = iSCSI {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] syslog_log_facility = LOG_USER {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] target_helper = lioadm {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] target_ip_address = 192.168.122.251 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] target_port = 3260 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] target_protocol = iscsi {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] target_secondary_ip_addresses = [] {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] trace_flags = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] transfer_api_class = cinder.transfer.api.API {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] transport_url = **** {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] until_refresh = 0 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] use_chap_auth = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] use_default_quota_class = True {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] use_journal = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] use_json = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] use_multipath_for_image_xfer = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] use_stderr = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] use_syslog = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] verify_glance_signatures = enabled {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] volume_api_class = cinder.volume.api.API {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] volume_backend_name = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] volume_clear = zero {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] volume_clear_ionice = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] volume_clear_size = 0 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] volume_copy_bps_limit = 0 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] volume_dd_blocksize = 1M {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] volume_name_template = volume-%s {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] volume_service_inithost_offload = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] volume_usage_audit_period = month {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] zoning_mode = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_concurrency.disable_process_locking = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] keystone_authtoken.auth_section = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] keystone_authtoken.auth_type = password {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] keystone_authtoken.auth_version = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] keystone_authtoken.cache = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] keystone_authtoken.certfile = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] keystone_authtoken.include_service_catalog = True {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] keystone_authtoken.insecure = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] keystone_authtoken.interface = public {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] keystone_authtoken.keyfile = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] keystone_authtoken.memcache_password = {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] keystone_authtoken.memcache_username = {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] keystone_authtoken.region_name = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] keystone_authtoken.service_token_roles_required = True {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] keystone_authtoken.service_type = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.251/identity {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cache.backend = dogpile.cache.null {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cache.backend_argument = **** {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cache.backend_expiration_time = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cache.config_prefix = cache.oslo {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cache.debug_cache_backend = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cache.enable_retry_client = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cache.enable_socket_keepalive = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cache.enabled = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cache.expiration_time = 600 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cache.hashclient_retry_attempts = 2 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cache.memcache_dead_retry = 300 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cache.memcache_pool_maxsize = 10 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cache.memcache_sasl_enabled = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cache.password = **** {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cache.proxies = [] {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cache.redis_db = 0 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cache.redis_server = localhost:6379 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cache.retry_attempts = 2 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cache.retry_delay = 0.0 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cache.socket_keepalive_count = 1 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cache.socket_keepalive_idle = 1 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cache.socket_keepalive_interval = 1 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cache.socket_timeout = 1.0 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cache.tls_allowed_ciphers = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cache.tls_cafile = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cache.tls_certfile = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cache.tls_enabled = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cache.tls_keyfile = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cache.username = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] coordination.backend_url = **** {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] database.asyncio_connection = **** {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] database.asyncio_slave_connection = **** {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] database.backend = sqlalchemy {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] database.connection = **** {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] database.connection_debug = 0 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] database.connection_parameters = {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] database.connection_recycle_time = 3600 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] database.connection_trace = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] database.db_inc_retry_interval = True {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] database.db_max_retries = 20 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] database.db_max_retry_interval = 10 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] database.db_retry_interval = 1 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] database.max_overflow = 50 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] database.max_pool_size = 5 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] database.max_retries = 10 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] database.mysql_wsrep_sync_wait = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] database.pool_timeout = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] database.retry_interval = 10 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] database.slave_connection = **** {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] database.sqlite_synchronous = True {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] database.synchronous_reader = True {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] database.use_db_reconnect = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] profiler.connection_string = messaging:// {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] profiler.enabled = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] profiler.es_doc_type = notification {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] profiler.es_scroll_size = 10000 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] profiler.es_scroll_time = 2m {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] profiler.filter_error_trace = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] profiler.hmac_keys = **** {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] profiler.sentinel_service_name = mymaster {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] profiler.socket_timeout = 0.1 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] profiler.trace_requests = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] profiler.trace_sqlalchemy = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] profiler_jaeger.process_tags = {} {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] profiler_jaeger.service_name_prefix = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] profiler_otlp.service_name_prefix = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_policy.enforce_new_defaults = True {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_policy.policy_default_rule = default {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_policy.policy_file = policy.yaml {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_policy.remote_timeout = 60.0 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] privsep_osbrick.group = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] privsep_osbrick.helper_command = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] privsep_osbrick.user = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cinder_sys_admin.group = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cinder_sys_admin.helper_command = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] cinder_sys_admin.user = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] service_user.auth_section = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] service_user.auth_type = password {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] service_user.cafile = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] service_user.certfile = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] service_user.collect_timing = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] service_user.insecure = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] service_user.keyfile = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] service_user.send_service_user_token = True {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] service_user.split_loggers = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] service_user.timeout = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] glance.auth_section = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] glance.auth_type = password {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] glance.certfile = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] glance.collect_timing = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] glance.insecure = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] glance.keyfile = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] glance.region_name = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88413) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 28 10:35:12 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.quobyte [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 28 10:35:12 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.quobyte [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] glance.split_loggers = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] glance.timeout = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.backend_availability_zone = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.chap_password = **** {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.chap_username = {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.disk_geometry = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.driver_client_cert = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.driver_client_cert_key = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.driver_data_namespace = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.driver_use_ssl = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.extra_capabilities = {} {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.filter_function = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.goodness_function = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] Running cmd (subprocess): mount.quobyte {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.iscsi_target_flags = {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.iscsi_write_cache = on {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.iser_helper = tgtadm {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.iser_ip_address = 192.168.122.251 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.iser_port = 3260 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.nas_host = {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.nas_login = admin {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.nas_mount_options = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.nas_password = **** {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.nas_private_key = {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.nas_share_path = {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.nas_ssh_port = 22 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.num_shell_tries = 3 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.quobyte_client_cfg = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.quobyte_volume_url = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.replication_device = **** {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.report_discard_supported = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.reserved_percentage = 0 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.target_helper = tgtadm {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.target_ip_address = 192.168.122.251 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.target_port = 3260 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.target_protocol = iscsi {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.trace_flags = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.unique_fqdn_network = True {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.use_chap_auth = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.volume_backend_name = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.volume_clear = zero {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.volume_clear_ionice = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.volume_clear_size = 0 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_reports.file_event_handler = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_reports.log_dir = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.backend_availability_zone = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.backend_host = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.chap_password = **** {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.chap_username = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.chiscsi_conf = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.disk_geometry = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.driver_client_cert = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.driver_client_cert_key = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.driver_data_namespace = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.driver_use_ssl = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.extra_capabilities = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.filter_function = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.goodness_function = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.iscsi_target_flags = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.iscsi_write_cache = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.iser_helper = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.iser_ip_address = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.iser_port = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.iser_target_prefix = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.nas_host = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.nas_login = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.nas_mount_options = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.nas_password = **** {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.nas_private_key = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack quobyte-client[88416]: Reading configuration file: /etc/quobyte/client.cfg Jul 28 10:35:12 devstack quobyte-client[88416]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.nas_share_path = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.nas_ssh_port = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.num_shell_tries = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.nvmet_ns_id = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.nvmet_port_id = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] CMD "mount.quobyte" returned: 1 in 0.065s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:35:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.replication_device = **** {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.report_discard_supported = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.reserved_percentage = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.scst_target_driver = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.storage_protocol = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.target_helper = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.target_ip_address = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.target_port = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.target_prefix = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.target_protocol = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.trace_flags = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.unique_fqdn_network = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.use_chap_auth = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.volume_clear = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.volume_clear_ionice = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.volume_clear_size = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] QuobyteHD.volumes_dir = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_rabbit.ssl = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_rabbit.ssl_version = {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_notifications.driver = [] {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_notifications.retry = -1 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] key_manager.fixed_key = **** {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] barbican.barbican_api_version = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] barbican.barbican_endpoint = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] barbican.barbican_endpoint_type = public {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] barbican.barbican_region_name = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] barbican.cafile = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] barbican.certfile = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] barbican.collect_timing = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] barbican.insecure = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] barbican.keyfile = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] barbican.number_of_retries = 60 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] barbican.retry_delay = 1 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] barbican.send_service_user_token = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] barbican.split_loggers = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] barbican.timeout = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] barbican.verify_ssl = True {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] barbican.verify_ssl_path = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] barbican_service_user.auth_section = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] barbican_service_user.auth_type = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] barbican_service_user.cafile = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] barbican_service_user.certfile = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] barbican_service_user.collect_timing = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] barbican_service_user.insecure = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] barbican_service_user.keyfile = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] barbican_service_user.split_loggers = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] barbican_service_user.timeout = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] vault.approle_role_id = **** {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] vault.approle_secret_id = **** {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] vault.auth_method = approle {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] vault.auth_path = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack sudo[88423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] vault.kv_mountpoint = secret {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] vault.kv_path = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] vault.kv_version = 2 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack sudo[88423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] vault.namespace = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] vault.root_token_id = **** {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] vault.ssl_ca_crt_file = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] vault.timeout = 60.0 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] vault.token_file = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] vault.token_role = None {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] vault.use_ssl = False {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 10:35:12 devstack cinder-volume[88070]: DEBUG oslo_service.backend._eventlet.service [None req-bf39921e-21f8-40b4-8c0e-860469ebe4c1 None None] ******************************************************************************** {{(pid=88070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 28 10:35:12 devstack sudo[88423]: pam_unix(sudo:session): session closed for user root Jul 28 10:35:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.253s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:35:12 devstack cinder-volume[88413]: INFO cinder.volume.driver [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] Driver hasn't implemented _init_vendor_properties() Jul 28 10:35:12 devstack cinder-volume[88413]: DEBUG cinder.volume.driver [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577056884766, 'free_capacity_gb': 1775.7577056884766, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88413) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 28 10:35:12 devstack cinder-volume[88413]: DEBUG oslo_db.sqlalchemy.engines [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 28 10:35:12 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writer thread running {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 28 10:35:12 devstack cinder-volume[88413]: DEBUG cinder.db.api [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] Building query based on filter {{(pid=88413) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 28 10:35:12 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88413) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 28 10:35:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:35:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:35:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:35:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:35:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:35:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:35:12 devstack cinder-volume[88413]: INFO cinder.keymgr.migration [None req-9dcebe5d-c545-4500-a744-cb87909cc141 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 28 10:35:12 devstack sudo[88434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:35:12 devstack sudo[88434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:35:12 devstack sudo[88434]: pam_unix(sudo:session): session closed for user root Jul 28 10:35:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.240s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:35:12 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:35:13 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] Driver initialization completed successfully. Jul 28 10:35:13 devstack cinder-volume[88413]: INFO cinder.manager [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] Initiating service 3 cleanup Jul 28 10:35:13 devstack cinder-volume[88413]: INFO cinder.manager [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] Service 3 cleanup completed. Jul 28 10:35:13 devstack cinder-volume[88413]: DEBUG cinder.service [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] Creating RPC server for service cinder-volume {{(pid=88413) start /opt/stack/cinder/cinder/service.py:231}} Jul 28 10:35:13 devstack cinder-volume[88413]: DEBUG cinder.service [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88413) start /opt/stack/cinder/cinder/service.py:237}} Jul 28 10:35:13 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 28 10:35:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:35:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:35:13 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:35:13 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:35:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:35:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:35:13 devstack sudo[88442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:35:13 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:35:13 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root Jul 28 10:35:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.250s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:35:13 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-b9daa560-89d8-484b-910b-a86b1ccd9979 None None] Driver post RPC initialization completed successfully. Jul 28 10:35:22 devstack cinder-volume[88070]: DEBUG dbcounter [-] [88070] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88070) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:35:23 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=2 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:35:23 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:35:28 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager._thread_info {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:35:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread count: 6 {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 10:35:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread info: [<_MainThread(MainThread, started 137939890385024)>, , , , , ] {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 10:36:09 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-124ad7fc-7013-4f3c-af48-ae93893886be tempest-TaggedAttachmentsTest-423993782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:36:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-124ad7fc-7013-4f3c-af48-ae93893886be tempest-TaggedAttachmentsTest-423993782 None] Flow 'volume_create_manager' (36b66f05-bbe7-47f5-b684-c10d388fa0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:36:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-124ad7fc-7013-4f3c-af48-ae93893886be tempest-TaggedAttachmentsTest-423993782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abc8fdfa-0a14-43f9-bfed-d7ef0b621fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:36:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-124ad7fc-7013-4f3c-af48-ae93893886be tempest-TaggedAttachmentsTest-423993782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abc8fdfa-0a14-43f9-bfed-d7ef0b621fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1580626474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52c2ba12-d568-4c56-98cc-84ea2344d4fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81f96b4d8cbb40b39c955434967b9600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:36:10Z,use_quota=True,user_id='577394c3c95f4586a2e1660b5f256f90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:36:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-124ad7fc-7013-4f3c-af48-ae93893886be tempest-TaggedAttachmentsTest-423993782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57dd06be-aa03-4e88-abf3-853e0403f9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:36:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-124ad7fc-7013-4f3c-af48-ae93893886be tempest-TaggedAttachmentsTest-423993782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57dd06be-aa03-4e88-abf3-853e0403f9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:36:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-124ad7fc-7013-4f3c-af48-ae93893886be tempest-TaggedAttachmentsTest-423993782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f3d71eb-468b-4934-9c03-51c844cdb0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:36:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-124ad7fc-7013-4f3c-af48-ae93893886be tempest-TaggedAttachmentsTest-423993782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f3d71eb-468b-4934-9c03-51c844cdb0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52c2ba12-d568-4c56-98cc-84ea2344d4fb', 'volume_name': 'volume-52c2ba12-d568-4c56-98cc-84ea2344d4fb', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:36:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-124ad7fc-7013-4f3c-af48-ae93893886be tempest-TaggedAttachmentsTest-423993782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3feb053-6ee7-4282-b738-7049773944a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:36:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-124ad7fc-7013-4f3c-af48-ae93893886be tempest-TaggedAttachmentsTest-423993782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3feb053-6ee7-4282-b738-7049773944a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:36:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-124ad7fc-7013-4f3c-af48-ae93893886be tempest-TaggedAttachmentsTest-423993782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c24f454-f1dc-4033-9f2c-d706e63873f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:36:10 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-124ad7fc-7013-4f3c-af48-ae93893886be tempest-TaggedAttachmentsTest-423993782 None] Volume 52c2ba12-d568-4c56-98cc-84ea2344d4fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52c2ba12-d568-4c56-98cc-84ea2344d4fb', 'volume_size': 1} Jul 28 10:36:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-124ad7fc-7013-4f3c-af48-ae93893886be tempest-TaggedAttachmentsTest-423993782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:36:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-124ad7fc-7013-4f3c-af48-ae93893886be tempest-TaggedAttachmentsTest-423993782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:36:10 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-124ad7fc-7013-4f3c-af48-ae93893886be tempest-TaggedAttachmentsTest-423993782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1580626474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52c2ba12-d568-4c56-98cc-84ea2344d4fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81f96b4d8cbb40b39c955434967b9600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:36:10Z,use_quota=True,user_id='577394c3c95f4586a2e1660b5f256f90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:36:10 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-124ad7fc-7013-4f3c-af48-ae93893886be tempest-TaggedAttachmentsTest-423993782 None] Creating volume 52c2ba12-d568-4c56-98cc-84ea2344d4fb {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:36:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-124ad7fc-7013-4f3c-af48-ae93893886be tempest-TaggedAttachmentsTest-423993782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:36:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-124ad7fc-7013-4f3c-af48-ae93893886be tempest-TaggedAttachmentsTest-423993782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:36:10 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-124ad7fc-7013-4f3c-af48-ae93893886be tempest-TaggedAttachmentsTest-423993782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:36:10 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-124ad7fc-7013-4f3c-af48-ae93893886be tempest-TaggedAttachmentsTest-423993782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:36:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-124ad7fc-7013-4f3c-af48-ae93893886be tempest-TaggedAttachmentsTest-423993782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:36:10 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-124ad7fc-7013-4f3c-af48-ae93893886be tempest-TaggedAttachmentsTest-423993782 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:36:10 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-124ad7fc-7013-4f3c-af48-ae93893886be tempest-TaggedAttachmentsTest-423993782 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:36:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-124ad7fc-7013-4f3c-af48-ae93893886be tempest-TaggedAttachmentsTest-423993782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-52c2ba12-d568-4c56-98cc-84ea2344d4fb 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:36:10 devstack sudo[88742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-52c2ba12-d568-4c56-98cc-84ea2344d4fb 1073741824 Jul 28 10:36:10 devstack sudo[88742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:36:11 devstack sudo[88742]: pam_unix(sudo:session): session closed for user root Jul 28 10:36:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-124ad7fc-7013-4f3c-af48-ae93893886be tempest-TaggedAttachmentsTest-423993782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-52c2ba12-d568-4c56-98cc-84ea2344d4fb 1073741824" returned: 0 in 1.178s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:36:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-124ad7fc-7013-4f3c-af48-ae93893886be tempest-TaggedAttachmentsTest-423993782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-52c2ba12-d568-4c56-98cc-84ea2344d4fb {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:36:11 devstack sudo[89090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-52c2ba12-d568-4c56-98cc-84ea2344d4fb Jul 28 10:36:11 devstack sudo[89090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:36:11 devstack sudo[89090]: pam_unix(sudo:session): session closed for user root Jul 28 10:36:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-124ad7fc-7013-4f3c-af48-ae93893886be tempest-TaggedAttachmentsTest-423993782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-52c2ba12-d568-4c56-98cc-84ea2344d4fb" returned: 0 in 0.395s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:36:11 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-124ad7fc-7013-4f3c-af48-ae93893886be tempest-TaggedAttachmentsTest-423993782 None] <== create_volume: return (1709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:36:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-124ad7fc-7013-4f3c-af48-ae93893886be tempest-TaggedAttachmentsTest-423993782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:36:11 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-124ad7fc-7013-4f3c-af48-ae93893886be tempest-TaggedAttachmentsTest-423993782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c24f454-f1dc-4033-9f2c-d706e63873f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52c2ba12-d568-4c56-98cc-84ea2344d4fb', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:36:11 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-124ad7fc-7013-4f3c-af48-ae93893886be tempest-TaggedAttachmentsTest-423993782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15928f95-fa8e-4fc2-b744-e3e812914fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:36:11 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-124ad7fc-7013-4f3c-af48-ae93893886be tempest-TaggedAttachmentsTest-423993782 None] Volume volume-52c2ba12-d568-4c56-98cc-84ea2344d4fb (52c2ba12-d568-4c56-98cc-84ea2344d4fb): created successfully Jul 28 10:36:11 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-124ad7fc-7013-4f3c-af48-ae93893886be tempest-TaggedAttachmentsTest-423993782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15928f95-fa8e-4fc2-b744-e3e812914fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:36:11 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-124ad7fc-7013-4f3c-af48-ae93893886be tempest-TaggedAttachmentsTest-423993782 None] Flow 'volume_create_manager' (36b66f05-bbe7-47f5-b684-c10d388fa0f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:36:11 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-124ad7fc-7013-4f3c-af48-ae93893886be tempest-TaggedAttachmentsTest-423993782 None] Created volume successfully. Jul 28 10:36:21 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:36:21 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:DELETE=1 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:36:27 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aa7180f-ef6a-467e-a5d3-9a772d4c9cc5 tempest-DeleteServersTestJSON-1364497409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:36:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7aa7180f-ef6a-467e-a5d3-9a772d4c9cc5 tempest-DeleteServersTestJSON-1364497409 None] Flow 'volume_create_manager' (5b25d088-e011-4d50-a966-0055e497cdbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:36:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7aa7180f-ef6a-467e-a5d3-9a772d4c9cc5 tempest-DeleteServersTestJSON-1364497409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (becca056-df10-4438-a3e2-3ecc6ad72967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:36:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7aa7180f-ef6a-467e-a5d3-9a772d4c9cc5 tempest-DeleteServersTestJSON-1364497409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (becca056-df10-4438-a3e2-3ecc6ad72967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1841919266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ece5f2ed-fac6-4578-9d35-ca98f41caead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='238c14e2856f43dc9957790c312df21f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:36:28Z,use_quota=True,user_id='d12a42ff659b4afb94c7fa249eab25b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:36:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7aa7180f-ef6a-467e-a5d3-9a772d4c9cc5 tempest-DeleteServersTestJSON-1364497409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e94bd6f3-2e36-4a37-ba8d-e2216b52a994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:36:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7aa7180f-ef6a-467e-a5d3-9a772d4c9cc5 tempest-DeleteServersTestJSON-1364497409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e94bd6f3-2e36-4a37-ba8d-e2216b52a994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:36:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7aa7180f-ef6a-467e-a5d3-9a772d4c9cc5 tempest-DeleteServersTestJSON-1364497409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9fd55b3-c91f-4ed3-9382-1bd6eb758171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:36:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7aa7180f-ef6a-467e-a5d3-9a772d4c9cc5 tempest-DeleteServersTestJSON-1364497409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9fd55b3-c91f-4ed3-9382-1bd6eb758171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ece5f2ed-fac6-4578-9d35-ca98f41caead', 'volume_name': 'volume-ece5f2ed-fac6-4578-9d35-ca98f41caead', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:36:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7aa7180f-ef6a-467e-a5d3-9a772d4c9cc5 tempest-DeleteServersTestJSON-1364497409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (068acf88-a67f-41ff-8a37-57738063d999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:36:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7aa7180f-ef6a-467e-a5d3-9a772d4c9cc5 tempest-DeleteServersTestJSON-1364497409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (068acf88-a67f-41ff-8a37-57738063d999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:36:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7aa7180f-ef6a-467e-a5d3-9a772d4c9cc5 tempest-DeleteServersTestJSON-1364497409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09c309c8-5987-4f08-b787-899d28a3ca50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:36:28 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-7aa7180f-ef6a-467e-a5d3-9a772d4c9cc5 tempest-DeleteServersTestJSON-1364497409 None] Volume ece5f2ed-fac6-4578-9d35-ca98f41caead: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ece5f2ed-fac6-4578-9d35-ca98f41caead', 'volume_size': 1} Jul 28 10:36:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7aa7180f-ef6a-467e-a5d3-9a772d4c9cc5 tempest-DeleteServersTestJSON-1364497409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:36:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7aa7180f-ef6a-467e-a5d3-9a772d4c9cc5 tempest-DeleteServersTestJSON-1364497409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:36:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7aa7180f-ef6a-467e-a5d3-9a772d4c9cc5 tempest-DeleteServersTestJSON-1364497409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1841919266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ece5f2ed-fac6-4578-9d35-ca98f41caead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='238c14e2856f43dc9957790c312df21f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:36:28Z,use_quota=True,user_id='d12a42ff659b4afb94c7fa249eab25b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:36:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-7aa7180f-ef6a-467e-a5d3-9a772d4c9cc5 tempest-DeleteServersTestJSON-1364497409 None] Creating volume ece5f2ed-fac6-4578-9d35-ca98f41caead {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:36:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7aa7180f-ef6a-467e-a5d3-9a772d4c9cc5 tempest-DeleteServersTestJSON-1364497409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:36:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7aa7180f-ef6a-467e-a5d3-9a772d4c9cc5 tempest-DeleteServersTestJSON-1364497409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:36:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7aa7180f-ef6a-467e-a5d3-9a772d4c9cc5 tempest-DeleteServersTestJSON-1364497409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:36:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7aa7180f-ef6a-467e-a5d3-9a772d4c9cc5 tempest-DeleteServersTestJSON-1364497409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:36:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7aa7180f-ef6a-467e-a5d3-9a772d4c9cc5 tempest-DeleteServersTestJSON-1364497409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:36:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7aa7180f-ef6a-467e-a5d3-9a772d4c9cc5 tempest-DeleteServersTestJSON-1364497409 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:36:28 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-7aa7180f-ef6a-467e-a5d3-9a772d4c9cc5 tempest-DeleteServersTestJSON-1364497409 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:36:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7aa7180f-ef6a-467e-a5d3-9a772d4c9cc5 tempest-DeleteServersTestJSON-1364497409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ece5f2ed-fac6-4578-9d35-ca98f41caead 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:36:28 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:36:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:36:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:36:28 devstack sudo[89371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ece5f2ed-fac6-4578-9d35-ca98f41caead 1073741824 Jul 28 10:36:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:36:28 devstack sudo[89371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:36:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:36:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:36:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:36:28 devstack sudo[89378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:36:28 devstack sudo[89378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:36:29 devstack sudo[89378]: pam_unix(sudo:session): session closed for user root Jul 28 10:36:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.722s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:36:29 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:36:29 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager._thread_info {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:36:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread count: 6 {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 10:36:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread info: [<_MainThread(MainThread, started 137939890385024)>, , , , , ] {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 10:36:29 devstack sudo[89371]: pam_unix(sudo:session): session closed for user root Jul 28 10:36:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7aa7180f-ef6a-467e-a5d3-9a772d4c9cc5 tempest-DeleteServersTestJSON-1364497409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ece5f2ed-fac6-4578-9d35-ca98f41caead 1073741824" returned: 0 in 1.543s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:36:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7aa7180f-ef6a-467e-a5d3-9a772d4c9cc5 tempest-DeleteServersTestJSON-1364497409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ece5f2ed-fac6-4578-9d35-ca98f41caead {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:36:29 devstack sudo[89432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ece5f2ed-fac6-4578-9d35-ca98f41caead Jul 28 10:36:29 devstack sudo[89432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:36:30 devstack sudo[89432]: pam_unix(sudo:session): session closed for user root Jul 28 10:36:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7aa7180f-ef6a-467e-a5d3-9a772d4c9cc5 tempest-DeleteServersTestJSON-1364497409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ece5f2ed-fac6-4578-9d35-ca98f41caead" returned: 0 in 0.647s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:36:30 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7aa7180f-ef6a-467e-a5d3-9a772d4c9cc5 tempest-DeleteServersTestJSON-1364497409 None] <== create_volume: return (2315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:36:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7aa7180f-ef6a-467e-a5d3-9a772d4c9cc5 tempest-DeleteServersTestJSON-1364497409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.318s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:36:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7aa7180f-ef6a-467e-a5d3-9a772d4c9cc5 tempest-DeleteServersTestJSON-1364497409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09c309c8-5987-4f08-b787-899d28a3ca50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ece5f2ed-fac6-4578-9d35-ca98f41caead', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:36:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7aa7180f-ef6a-467e-a5d3-9a772d4c9cc5 tempest-DeleteServersTestJSON-1364497409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff9fa64d-8f30-48fc-9882-bf2675f9709c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:36:30 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-7aa7180f-ef6a-467e-a5d3-9a772d4c9cc5 tempest-DeleteServersTestJSON-1364497409 None] Volume volume-ece5f2ed-fac6-4578-9d35-ca98f41caead (ece5f2ed-fac6-4578-9d35-ca98f41caead): created successfully Jul 28 10:36:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7aa7180f-ef6a-467e-a5d3-9a772d4c9cc5 tempest-DeleteServersTestJSON-1364497409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff9fa64d-8f30-48fc-9882-bf2675f9709c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:36:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7aa7180f-ef6a-467e-a5d3-9a772d4c9cc5 tempest-DeleteServersTestJSON-1364497409 None] Flow 'volume_create_manager' (5b25d088-e011-4d50-a966-0055e497cdbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:36:30 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-7aa7180f-ef6a-467e-a5d3-9a772d4c9cc5 tempest-DeleteServersTestJSON-1364497409 None] Created volume successfully. Jul 28 10:36:34 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-3db547b8-6b51-4dad-8708-58d5e8716d21 tempest-VolumesAdminNegativeTest-1637598500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:36:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3db547b8-6b51-4dad-8708-58d5e8716d21 tempest-VolumesAdminNegativeTest-1637598500 None] Flow 'volume_create_manager' (477cb7eb-d7de-4c54-813d-9852e7c95d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:36:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3db547b8-6b51-4dad-8708-58d5e8716d21 tempest-VolumesAdminNegativeTest-1637598500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a7943f-aa92-43c8-b400-8c36c1ad953f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:36:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3db547b8-6b51-4dad-8708-58d5e8716d21 tempest-VolumesAdminNegativeTest-1637598500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a7943f-aa92-43c8-b400-8c36c1ad953f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-875190115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad2ac132-b7a0-4a46-9c6c-c5e1c2a10fe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd7882ec4865470b903bb6ca056ddde6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:36:34Z,use_quota=True,user_id='850f52bbe7b84d51934d54727401e481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:36:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3db547b8-6b51-4dad-8708-58d5e8716d21 tempest-VolumesAdminNegativeTest-1637598500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c47e6e9d-ffb3-41f7-8a87-0e6359765bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:36:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3db547b8-6b51-4dad-8708-58d5e8716d21 tempest-VolumesAdminNegativeTest-1637598500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c47e6e9d-ffb3-41f7-8a87-0e6359765bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:36:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3db547b8-6b51-4dad-8708-58d5e8716d21 tempest-VolumesAdminNegativeTest-1637598500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62a971c-23e7-4863-87ab-2f3d172cbeeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:36:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3db547b8-6b51-4dad-8708-58d5e8716d21 tempest-VolumesAdminNegativeTest-1637598500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62a971c-23e7-4863-87ab-2f3d172cbeeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad2ac132-b7a0-4a46-9c6c-c5e1c2a10fe7', 'volume_name': 'volume-ad2ac132-b7a0-4a46-9c6c-c5e1c2a10fe7', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:36:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3db547b8-6b51-4dad-8708-58d5e8716d21 tempest-VolumesAdminNegativeTest-1637598500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70d8c7c4-8621-4070-8012-b1154975d176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:36:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3db547b8-6b51-4dad-8708-58d5e8716d21 tempest-VolumesAdminNegativeTest-1637598500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70d8c7c4-8621-4070-8012-b1154975d176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:36:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3db547b8-6b51-4dad-8708-58d5e8716d21 tempest-VolumesAdminNegativeTest-1637598500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca2d0b1b-deb1-4fbb-a2c0-c37bd8fb38f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:36:34 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-3db547b8-6b51-4dad-8708-58d5e8716d21 tempest-VolumesAdminNegativeTest-1637598500 None] Volume ad2ac132-b7a0-4a46-9c6c-c5e1c2a10fe7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad2ac132-b7a0-4a46-9c6c-c5e1c2a10fe7', 'volume_size': 1} Jul 28 10:36:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3db547b8-6b51-4dad-8708-58d5e8716d21 tempest-VolumesAdminNegativeTest-1637598500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:36:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3db547b8-6b51-4dad-8708-58d5e8716d21 tempest-VolumesAdminNegativeTest-1637598500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:36:34 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3db547b8-6b51-4dad-8708-58d5e8716d21 tempest-VolumesAdminNegativeTest-1637598500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-875190115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad2ac132-b7a0-4a46-9c6c-c5e1c2a10fe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd7882ec4865470b903bb6ca056ddde6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:36:34Z,use_quota=True,user_id='850f52bbe7b84d51934d54727401e481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:36:34 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-3db547b8-6b51-4dad-8708-58d5e8716d21 tempest-VolumesAdminNegativeTest-1637598500 None] Creating volume ad2ac132-b7a0-4a46-9c6c-c5e1c2a10fe7 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:36:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3db547b8-6b51-4dad-8708-58d5e8716d21 tempest-VolumesAdminNegativeTest-1637598500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:36:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3db547b8-6b51-4dad-8708-58d5e8716d21 tempest-VolumesAdminNegativeTest-1637598500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:36:34 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3db547b8-6b51-4dad-8708-58d5e8716d21 tempest-VolumesAdminNegativeTest-1637598500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:36:34 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3db547b8-6b51-4dad-8708-58d5e8716d21 tempest-VolumesAdminNegativeTest-1637598500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:36:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3db547b8-6b51-4dad-8708-58d5e8716d21 tempest-VolumesAdminNegativeTest-1637598500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:36:34 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3db547b8-6b51-4dad-8708-58d5e8716d21 tempest-VolumesAdminNegativeTest-1637598500 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:36:34 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-3db547b8-6b51-4dad-8708-58d5e8716d21 tempest-VolumesAdminNegativeTest-1637598500 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:36:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3db547b8-6b51-4dad-8708-58d5e8716d21 tempest-VolumesAdminNegativeTest-1637598500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ad2ac132-b7a0-4a46-9c6c-c5e1c2a10fe7 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:36:34 devstack sudo[89466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ad2ac132-b7a0-4a46-9c6c-c5e1c2a10fe7 1073741824 Jul 28 10:36:34 devstack sudo[89466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:36:35 devstack sudo[89466]: pam_unix(sudo:session): session closed for user root Jul 28 10:36:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3db547b8-6b51-4dad-8708-58d5e8716d21 tempest-VolumesAdminNegativeTest-1637598500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ad2ac132-b7a0-4a46-9c6c-c5e1c2a10fe7 1073741824" returned: 0 in 0.998s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:36:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3db547b8-6b51-4dad-8708-58d5e8716d21 tempest-VolumesAdminNegativeTest-1637598500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ad2ac132-b7a0-4a46-9c6c-c5e1c2a10fe7 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:36:35 devstack sudo[89479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ad2ac132-b7a0-4a46-9c6c-c5e1c2a10fe7 Jul 28 10:36:35 devstack sudo[89479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:36:36 devstack sudo[89479]: pam_unix(sudo:session): session closed for user root Jul 28 10:36:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3db547b8-6b51-4dad-8708-58d5e8716d21 tempest-VolumesAdminNegativeTest-1637598500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ad2ac132-b7a0-4a46-9c6c-c5e1c2a10fe7" returned: 0 in 0.716s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:36:36 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3db547b8-6b51-4dad-8708-58d5e8716d21 tempest-VolumesAdminNegativeTest-1637598500 None] <== create_volume: return (1847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:36:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3db547b8-6b51-4dad-8708-58d5e8716d21 tempest-VolumesAdminNegativeTest-1637598500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:36:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3db547b8-6b51-4dad-8708-58d5e8716d21 tempest-VolumesAdminNegativeTest-1637598500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca2d0b1b-deb1-4fbb-a2c0-c37bd8fb38f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad2ac132-b7a0-4a46-9c6c-c5e1c2a10fe7', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:36:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3db547b8-6b51-4dad-8708-58d5e8716d21 tempest-VolumesAdminNegativeTest-1637598500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb0551f3-4e0a-47c8-a90d-4ffff75d58d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:36:36 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-3db547b8-6b51-4dad-8708-58d5e8716d21 tempest-VolumesAdminNegativeTest-1637598500 None] Volume volume-ad2ac132-b7a0-4a46-9c6c-c5e1c2a10fe7 (ad2ac132-b7a0-4a46-9c6c-c5e1c2a10fe7): created successfully Jul 28 10:36:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3db547b8-6b51-4dad-8708-58d5e8716d21 tempest-VolumesAdminNegativeTest-1637598500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb0551f3-4e0a-47c8-a90d-4ffff75d58d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:36:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3db547b8-6b51-4dad-8708-58d5e8716d21 tempest-VolumesAdminNegativeTest-1637598500 None] Flow 'volume_create_manager' (477cb7eb-d7de-4c54-813d-9852e7c95d27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:36:36 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-3db547b8-6b51-4dad-8708-58d5e8716d21 tempest-VolumesAdminNegativeTest-1637598500 None] Created volume successfully. Jul 28 10:36:38 devstack cinder-volume[88413]: WARNING py.warnings [req-82f6d0f4-5de6-49f1-a5e2-727d697f3772 req-6771db28-5dfa-4b82-9ddb-a883b3785a70 tempest-DeleteServersTestJSON-1364497409 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 28 10:36:38 devstack cinder-volume[88413]: .first() Jul 28 10:36:38 devstack cinder-volume[88413]: Jul 28 10:36:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-82f6d0f4-5de6-49f1-a5e2-727d697f3772 req-6771db28-5dfa-4b82-9ddb-a883b3785a70 tempest-DeleteServersTestJSON-1364497409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:36:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-82f6d0f4-5de6-49f1-a5e2-727d697f3772 req-6771db28-5dfa-4b82-9ddb-a883b3785a70 tempest-DeleteServersTestJSON-1364497409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:36:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-82f6d0f4-5de6-49f1-a5e2-727d697f3772 req-6771db28-5dfa-4b82-9ddb-a883b3785a70 tempest-DeleteServersTestJSON-1364497409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:36:38 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-19dc0a37-5adb-49a3-87fa-96f19f87280d tempest-VolumesAdminNegativeTest-1637598500 None] Acquiring lock "cinder-ad2ac132-b7a0-4a46-9c6c-c5e1c2a10fe7-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:36:38 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-19dc0a37-5adb-49a3-87fa-96f19f87280d tempest-VolumesAdminNegativeTest-1637598500 None] Lock "cinder-ad2ac132-b7a0-4a46-9c6c-c5e1c2a10fe7-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:36:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-82f6d0f4-5de6-49f1-a5e2-727d697f3772 req-6771db28-5dfa-4b82-9ddb-a883b3785a70 tempest-DeleteServersTestJSON-1364497409 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7', 'name': 'volume-ece5f2ed-fac6-4578-9d35-ca98f41caead', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8ee4f181-fc52-415d-b652-b93e7c38cecb', 'enforce_multipath': True} {{(pid=88413) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 10:36:38 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-19dc0a37-5adb-49a3-87fa-96f19f87280d tempest-VolumesAdminNegativeTest-1637598500 None] Acquiring lock "cinder-quobyte-ad2ac132-b7a0-4a46-9c6c-c5e1c2a10fe7" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:36:38 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-19dc0a37-5adb-49a3-87fa-96f19f87280d tempest-VolumesAdminNegativeTest-1637598500 None] Lock "cinder-quobyte-ad2ac132-b7a0-4a46-9c6c-c5e1c2a10fe7" acquired by "delete_volume" :: waited 0.026s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:36:38 devstack cinder-volume[88413]: INFO oslo.privsep.daemon [None req-19dc0a37-5adb-49a3-87fa-96f19f87280d tempest-VolumesAdminNegativeTest-1637598500 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpjenekd8n/privsep.sock'] Jul 28 10:36:38 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-82f6d0f4-5de6-49f1-a5e2-727d697f3772 req-6771db28-5dfa-4b82-9ddb-a883b3785a70 tempest-DeleteServersTestJSON-1364497409 None] attachment_update completed successfully. Jul 28 10:36:38 devstack sudo[89566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpjenekd8n/privsep.sock Jul 28 10:36:38 devstack sudo[89566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:36:40 devstack cinder-volume[88413]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 28 10:36:40 devstack cinder-volume[88413]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 28 10:36:40 devstack cinder-volume[88413]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 28 10:36:40 devstack cinder-volume[88413]: WARNING oslo.privsep.daemon [-] privsep log: Jul 28 10:36:40 devstack cinder-volume[88413]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 28 10:36:40 devstack cinder-volume[88413]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 28 10:36:40 devstack cinder-volume[88413]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 28 10:36:40 devstack cinder-volume[88413]: WARNING oslo.privsep.daemon [-] privsep log: Jul 28 10:36:40 devstack cinder-volume[88413]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 28 10:36:40 devstack sudo[89566]: pam_unix(sudo:session): session closed for user root Jul 28 10:36:40 devstack cinder-volume[88413]: INFO oslo.privsep.daemon [None req-19dc0a37-5adb-49a3-87fa-96f19f87280d tempest-VolumesAdminNegativeTest-1637598500 None] Spawned new privsep daemon via rootwrap Jul 28 10:36:40 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [None req-19dc0a37-5adb-49a3-87fa-96f19f87280d tempest-VolumesAdminNegativeTest-1637598500 None] Accepted privsep connection to /tmp/tmpjenekd8n/privsep.sock {{(pid=88413) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 28 10:36:40 devstack cinder-volume[88413]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 28 10:36:40 devstack cinder-volume[88413]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 28 10:36:40 devstack cinder-volume[88413]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 28 10:36:40 devstack cinder-volume[88413]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89968 Jul 28 10:36:40 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d9094f-6bb3-4d19-a54e-e3601c0486a9]: (2,) {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:36:41 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9ed8d3-1f16-4230-a23e-c9f6e81f6e73]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:36:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-19dc0a37-5adb-49a3-87fa-96f19f87280d tempest-VolumesAdminNegativeTest-1637598500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ad2ac132-b7a0-4a46-9c6c-c5e1c2a10fe7 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:36:41 devstack sudo[89978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ad2ac132-b7a0-4a46-9c6c-c5e1c2a10fe7 Jul 28 10:36:41 devstack sudo[89978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:36:41 devstack sudo[89978]: pam_unix(sudo:session): session closed for user root Jul 28 10:36:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-19dc0a37-5adb-49a3-87fa-96f19f87280d tempest-VolumesAdminNegativeTest-1637598500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ad2ac132-b7a0-4a46-9c6c-c5e1c2a10fe7" returned: 0 in 0.588s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:36:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-19dc0a37-5adb-49a3-87fa-96f19f87280d tempest-VolumesAdminNegativeTest-1637598500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ad2ac132-b7a0-4a46-9c6c-c5e1c2a10fe7 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:36:41 devstack sudo[89999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ad2ac132-b7a0-4a46-9c6c-c5e1c2a10fe7 Jul 28 10:36:41 devstack sudo[89999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:36:42 devstack sudo[89999]: pam_unix(sudo:session): session closed for user root Jul 28 10:36:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-19dc0a37-5adb-49a3-87fa-96f19f87280d tempest-VolumesAdminNegativeTest-1637598500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ad2ac132-b7a0-4a46-9c6c-c5e1c2a10fe7" returned: 0 in 0.427s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:36:42 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-19dc0a37-5adb-49a3-87fa-96f19f87280d tempest-VolumesAdminNegativeTest-1637598500 None] Lock "cinder-quobyte-ad2ac132-b7a0-4a46-9c6c-c5e1c2a10fe7" released by "delete_volume" :: held 3.203s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:36:42 devstack cinder-volume[88413]: WARNING cinder.quota [None req-19dc0a37-5adb-49a3-87fa-96f19f87280d tempest-VolumesAdminNegativeTest-1637598500 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 28 10:36:42 devstack cinder-volume[88413]: WARNING cinder.quota [None req-19dc0a37-5adb-49a3-87fa-96f19f87280d tempest-VolumesAdminNegativeTest-1637598500 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 28 10:36:42 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-19dc0a37-5adb-49a3-87fa-96f19f87280d tempest-VolumesAdminNegativeTest-1637598500 None] Created reservations ['1a5af402-360c-43f9-a734-fce03afea014', '16b1b7f0-d593-438b-a82a-2dcea095f5c3', 'd3123e7e-5d9b-4922-91d6-b8504e4920f1', '4845c046-7c94-4ee3-b4d6-da3aee144092'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:36:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-19dc0a37-5adb-49a3-87fa-96f19f87280d tempest-VolumesAdminNegativeTest-1637598500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:36:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-19dc0a37-5adb-49a3-87fa-96f19f87280d tempest-VolumesAdminNegativeTest-1637598500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:36:42 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-19dc0a37-5adb-49a3-87fa-96f19f87280d tempest-VolumesAdminNegativeTest-1637598500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:36:42 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-19dc0a37-5adb-49a3-87fa-96f19f87280d tempest-VolumesAdminNegativeTest-1637598500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:36:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-19dc0a37-5adb-49a3-87fa-96f19f87280d tempest-VolumesAdminNegativeTest-1637598500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:36:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-19dc0a37-5adb-49a3-87fa-96f19f87280d tempest-VolumesAdminNegativeTest-1637598500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:36:42 devstack sudo[90003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:36:42 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:36:43 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root Jul 28 10:36:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-19dc0a37-5adb-49a3-87fa-96f19f87280d tempest-VolumesAdminNegativeTest-1637598500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.675s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:36:43 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-19dc0a37-5adb-49a3-87fa-96f19f87280d tempest-VolumesAdminNegativeTest-1637598500 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:36:43 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-19dc0a37-5adb-49a3-87fa-96f19f87280d tempest-VolumesAdminNegativeTest-1637598500 None] Deleted volume successfully. Jul 28 10:36:43 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-19dc0a37-5adb-49a3-87fa-96f19f87280d tempest-VolumesAdminNegativeTest-1637598500 None] Lock "cinder-ad2ac132-b7a0-4a46-9c6c-c5e1c2a10fe7-delete_volume" released by "delete_volume" :: held 4.652s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:36:46 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-8863b877-c5bd-4442-99f5-3487892ce894 req-62872f43-94ae-45bd-8ac5-f93cb969350d tempest-DeleteServersTestJSON-1364497409 None] Terminate volume connection completed successfully. Jul 28 10:36:46 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-8863b877-c5bd-4442-99f5-3487892ce894 req-62872f43-94ae-45bd-8ac5-f93cb969350d tempest-DeleteServersTestJSON-1364497409 None] Deleting attachment 8ee4f181-fc52-415d-b652-b93e7c38cecb. {{(pid=88413) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 10:36:49 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e9445811-f1e2-4310-af68-022f9b866741 tempest-DeleteServersTestJSON-1364497409 None] Acquiring lock "cinder-ece5f2ed-fac6-4578-9d35-ca98f41caead-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:36:49 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e9445811-f1e2-4310-af68-022f9b866741 tempest-DeleteServersTestJSON-1364497409 None] Lock "cinder-ece5f2ed-fac6-4578-9d35-ca98f41caead-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:36:49 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e9445811-f1e2-4310-af68-022f9b866741 tempest-DeleteServersTestJSON-1364497409 None] Acquiring lock "cinder-quobyte-ece5f2ed-fac6-4578-9d35-ca98f41caead" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:36:49 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e9445811-f1e2-4310-af68-022f9b866741 tempest-DeleteServersTestJSON-1364497409 None] Lock "cinder-quobyte-ece5f2ed-fac6-4578-9d35-ca98f41caead" acquired by "delete_volume" :: waited 0.023s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:36:49 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[2192e4b3-3840-472f-8b61-5fff84c65b91]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:36:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e9445811-f1e2-4310-af68-022f9b866741 tempest-DeleteServersTestJSON-1364497409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ece5f2ed-fac6-4578-9d35-ca98f41caead {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:36:49 devstack sudo[90094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ece5f2ed-fac6-4578-9d35-ca98f41caead Jul 28 10:36:49 devstack sudo[90094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:36:50 devstack sudo[90094]: pam_unix(sudo:session): session closed for user root Jul 28 10:36:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e9445811-f1e2-4310-af68-022f9b866741 tempest-DeleteServersTestJSON-1364497409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ece5f2ed-fac6-4578-9d35-ca98f41caead" returned: 0 in 0.674s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:36:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e9445811-f1e2-4310-af68-022f9b866741 tempest-DeleteServersTestJSON-1364497409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ece5f2ed-fac6-4578-9d35-ca98f41caead {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:36:50 devstack sudo[90100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ece5f2ed-fac6-4578-9d35-ca98f41caead Jul 28 10:36:50 devstack sudo[90100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:36:50 devstack sudo[90100]: pam_unix(sudo:session): session closed for user root Jul 28 10:36:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e9445811-f1e2-4310-af68-022f9b866741 tempest-DeleteServersTestJSON-1364497409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ece5f2ed-fac6-4578-9d35-ca98f41caead" returned: 0 in 0.272s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:36:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e9445811-f1e2-4310-af68-022f9b866741 tempest-DeleteServersTestJSON-1364497409 None] Lock "cinder-quobyte-ece5f2ed-fac6-4578-9d35-ca98f41caead" released by "delete_volume" :: held 1.013s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:36:50 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-e9445811-f1e2-4310-af68-022f9b866741 tempest-DeleteServersTestJSON-1364497409 None] Created reservations ['3ba3d478-8eda-46f0-9635-3fdf427cf25b', '96dce074-dea4-4e7b-9659-946ec1440385', '8edca80f-fe72-49c8-b804-a9d249237aca', 'f53b708b-98a7-4ecd-b034-f940e6d1da5e'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:36:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e9445811-f1e2-4310-af68-022f9b866741 tempest-DeleteServersTestJSON-1364497409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:36:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e9445811-f1e2-4310-af68-022f9b866741 tempest-DeleteServersTestJSON-1364497409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:36:50 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e9445811-f1e2-4310-af68-022f9b866741 tempest-DeleteServersTestJSON-1364497409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:36:50 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e9445811-f1e2-4310-af68-022f9b866741 tempest-DeleteServersTestJSON-1364497409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:36:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e9445811-f1e2-4310-af68-022f9b866741 tempest-DeleteServersTestJSON-1364497409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:36:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e9445811-f1e2-4310-af68-022f9b866741 tempest-DeleteServersTestJSON-1364497409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:36:50 devstack sudo[90103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:36:50 devstack sudo[90103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:36:51 devstack sudo[90103]: pam_unix(sudo:session): session closed for user root Jul 28 10:36:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e9445811-f1e2-4310-af68-022f9b866741 tempest-DeleteServersTestJSON-1364497409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.519s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:36:51 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-e9445811-f1e2-4310-af68-022f9b866741 tempest-DeleteServersTestJSON-1364497409 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:36:51 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-e9445811-f1e2-4310-af68-022f9b866741 tempest-DeleteServersTestJSON-1364497409 None] Deleted volume successfully. Jul 28 10:36:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e9445811-f1e2-4310-af68-022f9b866741 tempest-DeleteServersTestJSON-1364497409 None] Lock "cinder-ece5f2ed-fac6-4578-9d35-ca98f41caead-delete_volume" released by "delete_volume" :: held 1.891s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:37:00 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=22,cinder:UPDATE=24,cinder:DELETE=2,cinder:INSERT=3 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:37:01 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:UPDATE=23,cinder:SELECT=21,cinder:INSERT=7,cinder:DELETE=2 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:37:03 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-abd5221f-5dd8-418b-8fe9-09c87a5e5710 tempest-GroupSnapshotsTest-2102677433 None] Group tempest-GroupSnapshotsTest-Group-240619830: creating Jul 28 10:37:03 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-abd5221f-5dd8-418b-8fe9-09c87a5e5710 tempest-GroupSnapshotsTest-2102677433 None] Group tempest-GroupSnapshotsTest-Group-240619830: created successfully Jul 28 10:37:03 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-abd5221f-5dd8-418b-8fe9-09c87a5e5710 tempest-GroupSnapshotsTest-2102677433 None] Create group completed successfully. Jul 28 10:37:05 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-19770a26-e8f9-4088-a3fd-2239a3e63bc3 tempest-GroupSnapshotsTest-2102677433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:37:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-19770a26-e8f9-4088-a3fd-2239a3e63bc3 tempest-GroupSnapshotsTest-2102677433 None] Flow 'volume_create_manager' (65587547-d301-4d4e-be37-484675f6a038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:37:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-19770a26-e8f9-4088-a3fd-2239a3e63bc3 tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3644bd33-9ba9-4eed-b2c3-2da61109a931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:37:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-19770a26-e8f9-4088-a3fd-2239a3e63bc3 tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3644bd33-9ba9-4eed-b2c3-2da61109a931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1102032005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4169c602-1f49-40a5-83af-739862b45895,host='devstack@QuobyteHD#QuobyteHD',id=102363ca-be08-4f3f-b4a5-ec75ab413a8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1ff79c74ff64e49b423d6225b236f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:37:05Z,use_quota=True,user_id='2a8b504e38ed480a917411d62f6c9bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78e19acb-bbc5-4c51-9865-17e866e8b713),volume_type_id=78e19acb-bbc5-4c51-9865-17e866e8b713)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:37:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-19770a26-e8f9-4088-a3fd-2239a3e63bc3 tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50851a6c-8a70-40cb-a4c3-1edb58116c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:37:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-19770a26-e8f9-4088-a3fd-2239a3e63bc3 tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50851a6c-8a70-40cb-a4c3-1edb58116c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:37:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-19770a26-e8f9-4088-a3fd-2239a3e63bc3 tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace25764-2fd0-44d7-977e-c4721e87804f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:37:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-19770a26-e8f9-4088-a3fd-2239a3e63bc3 tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace25764-2fd0-44d7-977e-c4721e87804f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '102363ca-be08-4f3f-b4a5-ec75ab413a8d', 'volume_name': 'volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:37:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-19770a26-e8f9-4088-a3fd-2239a3e63bc3 tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ab00fac-45d9-4c7a-ada6-05998834579c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:37:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-19770a26-e8f9-4088-a3fd-2239a3e63bc3 tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ab00fac-45d9-4c7a-ada6-05998834579c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:37:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-19770a26-e8f9-4088-a3fd-2239a3e63bc3 tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08e9140f-2d61-4baa-a357-3d06c2d14471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:37:05 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-19770a26-e8f9-4088-a3fd-2239a3e63bc3 tempest-GroupSnapshotsTest-2102677433 None] Volume 102363ca-be08-4f3f-b4a5-ec75ab413a8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d', 'volume_size': 1} Jul 28 10:37:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-19770a26-e8f9-4088-a3fd-2239a3e63bc3 tempest-GroupSnapshotsTest-2102677433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:37:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-19770a26-e8f9-4088-a3fd-2239a3e63bc3 tempest-GroupSnapshotsTest-2102677433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:37:05 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-19770a26-e8f9-4088-a3fd-2239a3e63bc3 tempest-GroupSnapshotsTest-2102677433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4169c602-1f49-40a5-83af-739862b45895,created_at=2026-07-28T08:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1102032005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4169c602-1f49-40a5-83af-739862b45895,host='devstack@QuobyteHD#QuobyteHD',id=102363ca-be08-4f3f-b4a5-ec75ab413a8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1ff79c74ff64e49b423d6225b236f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:37:05Z,use_quota=True,user_id='2a8b504e38ed480a917411d62f6c9bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78e19acb-bbc5-4c51-9865-17e866e8b713),volume_type_id=78e19acb-bbc5-4c51-9865-17e866e8b713)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:37:05 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-19770a26-e8f9-4088-a3fd-2239a3e63bc3 tempest-GroupSnapshotsTest-2102677433 None] Creating volume 102363ca-be08-4f3f-b4a5-ec75ab413a8d {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:37:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-19770a26-e8f9-4088-a3fd-2239a3e63bc3 tempest-GroupSnapshotsTest-2102677433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:37:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-19770a26-e8f9-4088-a3fd-2239a3e63bc3 tempest-GroupSnapshotsTest-2102677433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:37:05 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-19770a26-e8f9-4088-a3fd-2239a3e63bc3 tempest-GroupSnapshotsTest-2102677433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:37:05 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-19770a26-e8f9-4088-a3fd-2239a3e63bc3 tempest-GroupSnapshotsTest-2102677433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:37:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-19770a26-e8f9-4088-a3fd-2239a3e63bc3 tempest-GroupSnapshotsTest-2102677433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:37:05 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-19770a26-e8f9-4088-a3fd-2239a3e63bc3 tempest-GroupSnapshotsTest-2102677433 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:37:05 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-19770a26-e8f9-4088-a3fd-2239a3e63bc3 tempest-GroupSnapshotsTest-2102677433 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:37:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-19770a26-e8f9-4088-a3fd-2239a3e63bc3 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:05 devstack sudo[90134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d 1073741824 Jul 28 10:37:05 devstack sudo[90134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:05 devstack sudo[90134]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-19770a26-e8f9-4088-a3fd-2239a3e63bc3 tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d 1073741824" returned: 0 in 0.696s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-19770a26-e8f9-4088-a3fd-2239a3e63bc3 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:05 devstack sudo[90141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d Jul 28 10:37:06 devstack sudo[90141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:06 devstack sudo[90141]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-19770a26-e8f9-4088-a3fd-2239a3e63bc3 tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d" returned: 0 in 0.292s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:06 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-19770a26-e8f9-4088-a3fd-2239a3e63bc3 tempest-GroupSnapshotsTest-2102677433 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:37:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-19770a26-e8f9-4088-a3fd-2239a3e63bc3 tempest-GroupSnapshotsTest-2102677433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:37:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-19770a26-e8f9-4088-a3fd-2239a3e63bc3 tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08e9140f-2d61-4baa-a357-3d06c2d14471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:37:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-19770a26-e8f9-4088-a3fd-2239a3e63bc3 tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (016bed41-7b56-41e8-b8ac-2a22075bbb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:37:06 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-19770a26-e8f9-4088-a3fd-2239a3e63bc3 tempest-GroupSnapshotsTest-2102677433 None] Volume volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d (102363ca-be08-4f3f-b4a5-ec75ab413a8d): created successfully Jul 28 10:37:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-19770a26-e8f9-4088-a3fd-2239a3e63bc3 tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (016bed41-7b56-41e8-b8ac-2a22075bbb43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:37:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-19770a26-e8f9-4088-a3fd-2239a3e63bc3 tempest-GroupSnapshotsTest-2102677433 None] Flow 'volume_create_manager' (65587547-d301-4d4e-be37-484675f6a038) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:37:06 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-19770a26-e8f9-4088-a3fd-2239a3e63bc3 tempest-GroupSnapshotsTest-2102677433 None] Created volume successfully. Jul 28 10:37:08 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-7a673aa3-0040-4411-819b-f9b9937fd405 tempest-GroupSnapshotsTest-2102677433 None] GroupSnapshot 6864c477-8912-484d-86ed-4c7cba499763: creating. Jul 28 10:37:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7a673aa3-0040-4411-819b-f9b9937fd405 tempest-GroupSnapshotsTest-2102677433 None] Group snapshot 6864c477-8912-484d-86ed-4c7cba499763: creating. {{(pid=88413) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 28 10:37:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7a673aa3-0040-4411-819b-f9b9937fd405 tempest-GroupSnapshotsTest-2102677433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:37:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7a673aa3-0040-4411-819b-f9b9937fd405 tempest-GroupSnapshotsTest-2102677433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:37:08 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-7a673aa3-0040-4411-819b-f9b9937fd405 tempest-GroupSnapshotsTest-2102677433 None] Creating offline snapshot c3e6b525-359a-4afa-9171-9dc86be00141 of volume 102363ca-be08-4f3f-b4a5-ec75ab413a8d {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:37:08 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0b078a-69dc-4256-8e9a-59b4b5e6f0b9]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:37:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7a673aa3-0040-4411-819b-f9b9937fd405 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:08 devstack sudo[90152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d Jul 28 10:37:08 devstack sudo[90152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:08 devstack sudo[90152]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7a673aa3-0040-4411-819b-f9b9937fd405 tempest-GroupSnapshotsTest-2102677433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d" returned: 0 in 0.547s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7a673aa3-0040-4411-819b-f9b9937fd405 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d.c3e6b525-359a-4afa-9171-9dc86be00141 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:08 devstack sudo[90160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d.c3e6b525-359a-4afa-9171-9dc86be00141 1G Jul 28 10:37:08 devstack sudo[90160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:09 devstack sudo[90160]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7a673aa3-0040-4411-819b-f9b9937fd405 tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d.c3e6b525-359a-4afa-9171-9dc86be00141 1G" returned: 0 in 0.603s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7a673aa3-0040-4411-819b-f9b9937fd405 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d.c3e6b525-359a-4afa-9171-9dc86be00141 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:09 devstack sudo[90169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d.c3e6b525-359a-4afa-9171-9dc86be00141 Jul 28 10:37:09 devstack sudo[90169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:09 devstack sudo[90169]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7a673aa3-0040-4411-819b-f9b9937fd405 tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d.c3e6b525-359a-4afa-9171-9dc86be00141" returned: 0 in 0.445s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:09 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-7a673aa3-0040-4411-819b-f9b9937fd405 tempest-GroupSnapshotsTest-2102677433 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d.c3e6b525-359a-4afa-9171-9dc86be00141 is being set with open permissions: ugo+rw: NotImplementedError Jul 28 10:37:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7a673aa3-0040-4411-819b-f9b9937fd405 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d.c3e6b525-359a-4afa-9171-9dc86be00141 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:09 devstack sudo[90174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d.c3e6b525-359a-4afa-9171-9dc86be00141 Jul 28 10:37:09 devstack sudo[90174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:10 devstack sudo[90174]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7a673aa3-0040-4411-819b-f9b9937fd405 tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d.c3e6b525-359a-4afa-9171-9dc86be00141" returned: 0 in 0.255s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7a673aa3-0040-4411-819b-f9b9937fd405 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:10 devstack sudo[90177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d.info Jul 28 10:37:10 devstack sudo[90177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:10 devstack sudo[90177]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7a673aa3-0040-4411-819b-f9b9937fd405 tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d.info" returned: 0 in 0.364s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:10 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-7a673aa3-0040-4411-819b-f9b9937fd405 tempest-GroupSnapshotsTest-2102677433 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d.info is being set with open permissions: ugo+rw: NotImplementedError Jul 28 10:37:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7a673aa3-0040-4411-819b-f9b9937fd405 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:10 devstack sudo[90180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d.info Jul 28 10:37:10 devstack sudo[90180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:10 devstack sudo[90180]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7a673aa3-0040-4411-819b-f9b9937fd405 tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d.info" returned: 0 in 0.311s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7a673aa3-0040-4411-819b-f9b9937fd405 tempest-GroupSnapshotsTest-2102677433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.636s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:37:10 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-7a673aa3-0040-4411-819b-f9b9937fd405 tempest-GroupSnapshotsTest-2102677433 None] group_snapshot 6864c477-8912-484d-86ed-4c7cba499763: created successfully Jul 28 10:37:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0ce9c159-ad5b-4bad-a98c-1aff6420460e tempest-GroupSnapshotsTest-2102677433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:37:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0ce9c159-ad5b-4bad-a98c-1aff6420460e tempest-GroupSnapshotsTest-2102677433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:37:12 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0ce9c159-ad5b-4bad-a98c-1aff6420460e tempest-GroupSnapshotsTest-2102677433 None] Acquiring lock "cinder-quobyte-c3e6b525-359a-4afa-9171-9dc86be00141-a27fc5ba-590b-46e5-ad31-61f73abe3875" by "_create_volume_from_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:37:12 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0ce9c159-ad5b-4bad-a98c-1aff6420460e tempest-GroupSnapshotsTest-2102677433 None] Lock "cinder-quobyte-c3e6b525-359a-4afa-9171-9dc86be00141-a27fc5ba-590b-46e5-ad31-61f73abe3875" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:37:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0ce9c159-ad5b-4bad-a98c-1aff6420460e tempest-GroupSnapshotsTest-2102677433 None] Creating volume a27fc5ba-590b-46e5-ad31-61f73abe3875 from snapshot c3e6b525-359a-4afa-9171-9dc86be00141 {{(pid=88413) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 28 10:37:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0ce9c159-ad5b-4bad-a98c-1aff6420460e tempest-GroupSnapshotsTest-2102677433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:37:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0ce9c159-ad5b-4bad-a98c-1aff6420460e tempest-GroupSnapshotsTest-2102677433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:37:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0ce9c159-ad5b-4bad-a98c-1aff6420460e tempest-GroupSnapshotsTest-2102677433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:37:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0ce9c159-ad5b-4bad-a98c-1aff6420460e tempest-GroupSnapshotsTest-2102677433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:37:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0ce9c159-ad5b-4bad-a98c-1aff6420460e tempest-GroupSnapshotsTest-2102677433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:37:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0ce9c159-ad5b-4bad-a98c-1aff6420460e tempest-GroupSnapshotsTest-2102677433 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:37:12 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0ce9c159-ad5b-4bad-a98c-1aff6420460e tempest-GroupSnapshotsTest-2102677433 None] Acquiring lock "cinder-quobyte-a27fc5ba-590b-46e5-ad31-61f73abe3875" by "_copy_volume_from_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:37:12 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0ce9c159-ad5b-4bad-a98c-1aff6420460e tempest-GroupSnapshotsTest-2102677433 None] Lock "cinder-quobyte-a27fc5ba-590b-46e5-ad31-61f73abe3875" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:37:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0ce9c159-ad5b-4bad-a98c-1aff6420460e tempest-GroupSnapshotsTest-2102677433 None] snapshot: c3e6b525-359a-4afa-9171-9dc86be00141, volume: a27fc5ba-590b-46e5-ad31-61f73abe3875, {{(pid=88413) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 28 10:37:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0ce9c159-ad5b-4bad-a98c-1aff6420460e tempest-GroupSnapshotsTest-2102677433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:37:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0ce9c159-ad5b-4bad-a98c-1aff6420460e tempest-GroupSnapshotsTest-2102677433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:37:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0ce9c159-ad5b-4bad-a98c-1aff6420460e tempest-GroupSnapshotsTest-2102677433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:37:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0ce9c159-ad5b-4bad-a98c-1aff6420460e tempest-GroupSnapshotsTest-2102677433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:37:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0ce9c159-ad5b-4bad-a98c-1aff6420460e tempest-GroupSnapshotsTest-2102677433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:37:12 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[267df75a-9f96-4799-89e0-68ade44176a0]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:37:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0ce9c159-ad5b-4bad-a98c-1aff6420460e tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d.c3e6b525-359a-4afa-9171-9dc86be00141 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:12 devstack sudo[90224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d.c3e6b525-359a-4afa-9171-9dc86be00141 Jul 28 10:37:12 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:13 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0ce9c159-ad5b-4bad-a98c-1aff6420460e tempest-GroupSnapshotsTest-2102677433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d.c3e6b525-359a-4afa-9171-9dc86be00141" returned: 0 in 0.530s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:13 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-0ce9c159-ad5b-4bad-a98c-1aff6420460e tempest-GroupSnapshotsTest-2102677433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:37:13 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0ce9c159-ad5b-4bad-a98c-1aff6420460e tempest-GroupSnapshotsTest-2102677433 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d {{(pid=88413) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 28 10:37:13 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0ce9c159-ad5b-4bad-a98c-1aff6420460e tempest-GroupSnapshotsTest-2102677433 None] Creating direct copy from snapshot {{(pid=88413) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 28 10:37:13 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51b91a8-36c5-48e7-9c43-ed08f7ee9a4b]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:37:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0ce9c159-ad5b-4bad-a98c-1aff6420460e tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:13 devstack sudo[90230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d Jul 28 10:37:13 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:14 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0ce9c159-ad5b-4bad-a98c-1aff6420460e tempest-GroupSnapshotsTest-2102677433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d" returned: 0 in 1.016s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:14 devstack cinder-volume[88413]: DEBUG cinder.utils [None req-0ce9c159-ad5b-4bad-a98c-1aff6420460e tempest-GroupSnapshotsTest-2102677433 None] Path /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a27fc5ba-590b-46e5-ad31-61f73abe3875 not found in is_blk_device check {{(pid=88413) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 28 10:37:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0ce9c159-ad5b-4bad-a98c-1aff6420460e tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a27fc5ba-590b-46e5-ad31-61f73abe3875 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:14 devstack sudo[90274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a27fc5ba-590b-46e5-ad31-61f73abe3875 Jul 28 10:37:14 devstack sudo[90274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-840cdd7e-bb62-4dd0-8d49-f52053bb8ddd req-034ea683-847d-4b33-8ae5-1be6192ba65d tempest-TaggedAttachmentsTest-423993782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:37:20 devstack sudo[90274]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0ce9c159-ad5b-4bad-a98c-1aff6420460e tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a27fc5ba-590b-46e5-ad31-61f73abe3875" returned: 0 in 6.675s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:20 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[207c2887-e2bc-430b-bcb1-39ce04b6a93e]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:37:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0ce9c159-ad5b-4bad-a98c-1aff6420460e tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:21 devstack sudo[90350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d Jul 28 10:37:21 devstack sudo[90350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:21 devstack sudo[90350]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0ce9c159-ad5b-4bad-a98c-1aff6420460e tempest-GroupSnapshotsTest-2102677433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d" returned: 0 in 0.936s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:21 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-0ce9c159-ad5b-4bad-a98c-1aff6420460e tempest-GroupSnapshotsTest-2102677433 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d, size 1024.00 MB, duration 6.68 sec, destination /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a27fc5ba-590b-46e5-ad31-61f73abe3875 {{(pid=88413) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 10:37:21 devstack cinder-volume[88413]: INFO cinder.image.image_utils [None req-0ce9c159-ad5b-4bad-a98c-1aff6420460e tempest-GroupSnapshotsTest-2102677433 None] Converted 1024.00 MB image at 153.39 MB/s Jul 28 10:37:21 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-0ce9c159-ad5b-4bad-a98c-1aff6420460e tempest-GroupSnapshotsTest-2102677433 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a27fc5ba-590b-46e5-ad31-61f73abe3875 is being set with open permissions: ugo+rw: NotImplementedError Jul 28 10:37:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0ce9c159-ad5b-4bad-a98c-1aff6420460e tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a27fc5ba-590b-46e5-ad31-61f73abe3875 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:21 devstack sudo[90399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a27fc5ba-590b-46e5-ad31-61f73abe3875 Jul 28 10:37:21 devstack sudo[90399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:22 devstack sudo[90399]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0ce9c159-ad5b-4bad-a98c-1aff6420460e tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a27fc5ba-590b-46e5-ad31-61f73abe3875" returned: 0 in 0.367s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:22 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0ce9c159-ad5b-4bad-a98c-1aff6420460e tempest-GroupSnapshotsTest-2102677433 None] Lock "cinder-quobyte-a27fc5ba-590b-46e5-ad31-61f73abe3875" released by "_copy_volume_from_snapshot" :: held 9.757s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:37:22 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0ce9c159-ad5b-4bad-a98c-1aff6420460e tempest-GroupSnapshotsTest-2102677433 None] Lock "cinder-quobyte-c3e6b525-359a-4afa-9171-9dc86be00141-a27fc5ba-590b-46e5-ad31-61f73abe3875" released by "_create_volume_from_snapshot" :: held 9.816s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:37:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0ce9c159-ad5b-4bad-a98c-1aff6420460e tempest-GroupSnapshotsTest-2102677433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.839s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:37:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-840cdd7e-bb62-4dd0-8d49-f52053bb8ddd req-034ea683-847d-4b33-8ae5-1be6192ba65d tempest-TaggedAttachmentsTest-423993782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.916s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:37:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-840cdd7e-bb62-4dd0-8d49-f52053bb8ddd req-034ea683-847d-4b33-8ae5-1be6192ba65d tempest-TaggedAttachmentsTest-423993782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:37:22 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-840cdd7e-bb62-4dd0-8d49-f52053bb8ddd req-034ea683-847d-4b33-8ae5-1be6192ba65d tempest-TaggedAttachmentsTest-423993782 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7', 'name': 'volume-52c2ba12-d568-4c56-98cc-84ea2344d4fb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3958b12c-f23f-4f4d-bec6-9bb0b95fd14c', 'enforce_multipath': True} {{(pid=88413) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 10:37:22 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-0ce9c159-ad5b-4bad-a98c-1aff6420460e tempest-GroupSnapshotsTest-2102677433 None] Create group from source-snapshot-6864c477-8912-484d-86ed-4c7cba499763 completed successfully. Jul 28 10:37:22 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-840cdd7e-bb62-4dd0-8d49-f52053bb8ddd req-034ea683-847d-4b33-8ae5-1be6192ba65d tempest-TaggedAttachmentsTest-423993782 None] attachment_update completed successfully. Jul 28 10:37:23 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e0711937-76a3-402a-808f-8be0ed8a5dea tempest-GroupSnapshotsTest-2102677433 None] Acquiring lock "cinder-quobyte-a27fc5ba-590b-46e5-ad31-61f73abe3875" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:37:23 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e0711937-76a3-402a-808f-8be0ed8a5dea tempest-GroupSnapshotsTest-2102677433 None] Lock "cinder-quobyte-a27fc5ba-590b-46e5-ad31-61f73abe3875" acquired by "delete_volume" :: waited 0.045s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:37:23 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fffc0d-0efa-44ac-8484-9445aa0ea290]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:37:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e0711937-76a3-402a-808f-8be0ed8a5dea tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a27fc5ba-590b-46e5-ad31-61f73abe3875 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:23 devstack sudo[90822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a27fc5ba-590b-46e5-ad31-61f73abe3875 Jul 28 10:37:23 devstack sudo[90822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:24 devstack sudo[90822]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e0711937-76a3-402a-808f-8be0ed8a5dea tempest-GroupSnapshotsTest-2102677433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a27fc5ba-590b-46e5-ad31-61f73abe3875" returned: 0 in 0.549s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e0711937-76a3-402a-808f-8be0ed8a5dea tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a27fc5ba-590b-46e5-ad31-61f73abe3875 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:24 devstack sudo[90827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a27fc5ba-590b-46e5-ad31-61f73abe3875 Jul 28 10:37:24 devstack sudo[90827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:24 devstack sudo[90827]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e0711937-76a3-402a-808f-8be0ed8a5dea tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a27fc5ba-590b-46e5-ad31-61f73abe3875" returned: 0 in 0.305s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:24 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e0711937-76a3-402a-808f-8be0ed8a5dea tempest-GroupSnapshotsTest-2102677433 None] Lock "cinder-quobyte-a27fc5ba-590b-46e5-ad31-61f73abe3875" released by "delete_volume" :: held 0.918s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:37:24 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-e0711937-76a3-402a-808f-8be0ed8a5dea tempest-GroupSnapshotsTest-2102677433 None] Created reservations ['8eb59636-bd43-4629-9886-250160d95035'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:37:24 devstack cinder-volume[88413]: WARNING cinder.quota [None req-e0711937-76a3-402a-808f-8be0ed8a5dea tempest-GroupSnapshotsTest-2102677433 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-109293013 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-109293013, it is now deprecated. Please use the default quota class for default quota. Jul 28 10:37:24 devstack cinder-volume[88413]: WARNING cinder.quota [None req-e0711937-76a3-402a-808f-8be0ed8a5dea tempest-GroupSnapshotsTest-2102677433 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-109293013 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-109293013, it is now deprecated. Please use the default quota class for default quota. Jul 28 10:37:24 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-e0711937-76a3-402a-808f-8be0ed8a5dea tempest-GroupSnapshotsTest-2102677433 None] Created reservations ['05a7bb91-bc4f-43c6-b02b-4187e745dff3', '2f3c314d-eba6-4a17-b087-491c15ef8610', '98f695be-d571-4314-afe6-5b104fe59c77', '66fa2cb3-77d6-4ebc-91a5-d55c09f9c723'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:37:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e0711937-76a3-402a-808f-8be0ed8a5dea tempest-GroupSnapshotsTest-2102677433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:37:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e0711937-76a3-402a-808f-8be0ed8a5dea tempest-GroupSnapshotsTest-2102677433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:37:24 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e0711937-76a3-402a-808f-8be0ed8a5dea tempest-GroupSnapshotsTest-2102677433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:37:24 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e0711937-76a3-402a-808f-8be0ed8a5dea tempest-GroupSnapshotsTest-2102677433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:37:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e0711937-76a3-402a-808f-8be0ed8a5dea tempest-GroupSnapshotsTest-2102677433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:37:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e0711937-76a3-402a-808f-8be0ed8a5dea tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:24 devstack sudo[90831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:37:24 devstack sudo[90831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:24 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-72b2ad74-a84c-4f4b-bf7c-01ff4dff51c9 tempest-GroupSnapshotsTest-2102677433 None] group_snapshot 6864c477-8912-484d-86ed-4c7cba499763: deleting Jul 28 10:37:24 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-72b2ad74-a84c-4f4b-bf7c-01ff4dff51c9 tempest-GroupSnapshotsTest-2102677433 None] group_snapshot 6864c477-8912-484d-86ed-4c7cba499763: deleting {{(pid=88413) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 28 10:37:24 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-72b2ad74-a84c-4f4b-bf7c-01ff4dff51c9 tempest-GroupSnapshotsTest-2102677433 None] Acquiring lock "cinder-quobyte-102363ca-be08-4f3f-b4a5-ec75ab413a8d" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:37:24 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-72b2ad74-a84c-4f4b-bf7c-01ff4dff51c9 tempest-GroupSnapshotsTest-2102677433 None] Lock "cinder-quobyte-102363ca-be08-4f3f-b4a5-ec75ab413a8d" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:37:24 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-72b2ad74-a84c-4f4b-bf7c-01ff4dff51c9 tempest-GroupSnapshotsTest-2102677433 None] Acquiring lock "cinder-quobyte-c3e6b525-359a-4afa-9171-9dc86be00141" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:37:24 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-72b2ad74-a84c-4f4b-bf7c-01ff4dff51c9 tempest-GroupSnapshotsTest-2102677433 None] Lock "cinder-quobyte-c3e6b525-359a-4afa-9171-9dc86be00141" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:37:24 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-72b2ad74-a84c-4f4b-bf7c-01ff4dff51c9 tempest-GroupSnapshotsTest-2102677433 None] Deleting offline snapshot c3e6b525-359a-4afa-9171-9dc86be00141 of volume 102363ca-be08-4f3f-b4a5-ec75ab413a8d {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:37:24 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-72b2ad74-a84c-4f4b-bf7c-01ff4dff51c9 tempest-GroupSnapshotsTest-2102677433 None] snapshot_file for this snap is: volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d.c3e6b525-359a-4afa-9171-9dc86be00141 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:37:24 devstack sudo[90831]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e0711937-76a3-402a-808f-8be0ed8a5dea tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.312s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:24 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-e0711937-76a3-402a-808f-8be0ed8a5dea tempest-GroupSnapshotsTest-2102677433 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:37:24 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[01662ecd-6f1d-4e2c-ba84-8050bd85659a]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:37:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-72b2ad74-a84c-4f4b-bf7c-01ff4dff51c9 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d.c3e6b525-359a-4afa-9171-9dc86be00141 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:24 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-e0711937-76a3-402a-808f-8be0ed8a5dea tempest-GroupSnapshotsTest-2102677433 None] Delete group completed successfully. Jul 28 10:37:25 devstack sudo[90834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d.c3e6b525-359a-4afa-9171-9dc86be00141 Jul 28 10:37:25 devstack sudo[90834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:25 devstack sudo[90834]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-72b2ad74-a84c-4f4b-bf7c-01ff4dff51c9 tempest-GroupSnapshotsTest-2102677433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d.c3e6b525-359a-4afa-9171-9dc86be00141" returned: 0 in 0.702s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:25 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-72b2ad74-a84c-4f4b-bf7c-01ff4dff51c9 tempest-GroupSnapshotsTest-2102677433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:37:25 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[28840ede-409b-4c25-b53c-fc80145a6e7d]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:37:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-72b2ad74-a84c-4f4b-bf7c-01ff4dff51c9 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:25 devstack sudo[90849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d Jul 28 10:37:25 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:26 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-72b2ad74-a84c-4f4b-bf7c-01ff4dff51c9 tempest-GroupSnapshotsTest-2102677433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d" returned: 0 in 0.716s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-72b2ad74-a84c-4f4b-bf7c-01ff4dff51c9 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d.c3e6b525-359a-4afa-9171-9dc86be00141 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:26 devstack sudo[90854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d.c3e6b525-359a-4afa-9171-9dc86be00141 Jul 28 10:37:26 devstack sudo[90854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:27 devstack sudo[90854]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-72b2ad74-a84c-4f4b-bf7c-01ff4dff51c9 tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d.c3e6b525-359a-4afa-9171-9dc86be00141" returned: 0 in 0.553s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-72b2ad74-a84c-4f4b-bf7c-01ff4dff51c9 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d.c3e6b525-359a-4afa-9171-9dc86be00141 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:27 devstack sudo[90861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d.c3e6b525-359a-4afa-9171-9dc86be00141 Jul 28 10:37:27 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:27 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-72b2ad74-a84c-4f4b-bf7c-01ff4dff51c9 tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d.c3e6b525-359a-4afa-9171-9dc86be00141" returned: 0 in 0.432s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:27 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-72b2ad74-a84c-4f4b-bf7c-01ff4dff51c9 tempest-GroupSnapshotsTest-2102677433 None] Lock "cinder-quobyte-c3e6b525-359a-4afa-9171-9dc86be00141" released by "_delete_snapshot" :: held 2.593s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:37:27 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-72b2ad74-a84c-4f4b-bf7c-01ff4dff51c9 tempest-GroupSnapshotsTest-2102677433 None] Lock "cinder-quobyte-102363ca-be08-4f3f-b4a5-ec75ab413a8d" released by "delete_snapshot" :: held 2.632s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:37:27 devstack cinder-volume[88413]: WARNING cinder.quota [None req-72b2ad74-a84c-4f4b-bf7c-01ff4dff51c9 tempest-GroupSnapshotsTest-2102677433 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-109293013 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-109293013, it is now deprecated. Please use the default quota class for default quota. Jul 28 10:37:27 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-72b2ad74-a84c-4f4b-bf7c-01ff4dff51c9 tempest-GroupSnapshotsTest-2102677433 None] Created reservations ['a84868dd-9219-4523-af1b-8663bfb7744e', '2476fff7-075e-464b-9073-ed51dd046a14', '4b2cf4bb-a305-4cda-964b-3e227d8e412f', 'a43434ce-85a6-487c-bdd8-701aaa70bdd3'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:37:27 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-72b2ad74-a84c-4f4b-bf7c-01ff4dff51c9 tempest-GroupSnapshotsTest-2102677433 None] group_snapshot 6864c477-8912-484d-86ed-4c7cba499763: deleted successfully Jul 28 10:37:28 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:37:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:37:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:37:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:37:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:37:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:37:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:28 devstack sudo[90865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:37:28 devstack sudo[90865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:28 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-cc862fc7-0355-4136-9166-fb062a8c5851 tempest-GroupSnapshotsTest-2102677433 None] Acquiring lock "cinder-quobyte-102363ca-be08-4f3f-b4a5-ec75ab413a8d" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:37:28 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-cc862fc7-0355-4136-9166-fb062a8c5851 tempest-GroupSnapshotsTest-2102677433 None] Lock "cinder-quobyte-102363ca-be08-4f3f-b4a5-ec75ab413a8d" acquired by "delete_volume" :: waited 0.043s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:37:28 devstack sudo[90865]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.598s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:28 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:37:29 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fd76f4-4727-437a-baf7-fb0caf7c0554]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:37:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cc862fc7-0355-4136-9166-fb062a8c5851 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:29 devstack sudo[90869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d Jul 28 10:37:29 devstack sudo[90869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:29 devstack sudo[90869]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cc862fc7-0355-4136-9166-fb062a8c5851 tempest-GroupSnapshotsTest-2102677433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d" returned: 0 in 0.844s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cc862fc7-0355-4136-9166-fb062a8c5851 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:29 devstack sudo[90877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d Jul 28 10:37:29 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cc862fc7-0355-4136-9166-fb062a8c5851 tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-102363ca-be08-4f3f-b4a5-ec75ab413a8d" returned: 0 in 0.554s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:30 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:30 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-cc862fc7-0355-4136-9166-fb062a8c5851 tempest-GroupSnapshotsTest-2102677433 None] Lock "cinder-quobyte-102363ca-be08-4f3f-b4a5-ec75ab413a8d" released by "delete_volume" :: held 1.582s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:37:30 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-f8ec7088-5e27-4c58-b921-db661f994947 req-f004ff0a-6d7d-4b51-b45d-633cd404a327 tempest-TaggedAttachmentsTest-423993782 None] Terminate volume connection completed successfully. Jul 28 10:37:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-f8ec7088-5e27-4c58-b921-db661f994947 req-f004ff0a-6d7d-4b51-b45d-633cd404a327 tempest-TaggedAttachmentsTest-423993782 None] Deleting attachment 3958b12c-f23f-4f4d-bec6-9bb0b95fd14c. {{(pid=88413) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 10:37:30 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-cc862fc7-0355-4136-9166-fb062a8c5851 tempest-GroupSnapshotsTest-2102677433 None] Created reservations ['398dd705-4429-40b9-8c0f-c6f407a2a3ba'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:37:30 devstack cinder-volume[88413]: WARNING cinder.db.api [None req-cc862fc7-0355-4136-9166-fb062a8c5851 tempest-GroupSnapshotsTest-2102677433 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-109293013'] Jul 28 10:37:30 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-cc862fc7-0355-4136-9166-fb062a8c5851 tempest-GroupSnapshotsTest-2102677433 None] Created reservations ['6f2c299b-b063-4f97-856b-561346c7ea27', '69830d50-94bd-4932-911c-6b8ce75e59d0', '58131231-5301-4e37-bef3-706a10b756f9', '25bac227-95d4-4a7f-9c61-133b6b656fe9'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:37:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-cc862fc7-0355-4136-9166-fb062a8c5851 tempest-GroupSnapshotsTest-2102677433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:37:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-cc862fc7-0355-4136-9166-fb062a8c5851 tempest-GroupSnapshotsTest-2102677433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:37:31 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-cc862fc7-0355-4136-9166-fb062a8c5851 tempest-GroupSnapshotsTest-2102677433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:37:31 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-cc862fc7-0355-4136-9166-fb062a8c5851 tempest-GroupSnapshotsTest-2102677433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:37:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-cc862fc7-0355-4136-9166-fb062a8c5851 tempest-GroupSnapshotsTest-2102677433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:37:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cc862fc7-0355-4136-9166-fb062a8c5851 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:31 devstack sudo[90912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:37:31 devstack sudo[90912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:31 devstack sudo[90912]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cc862fc7-0355-4136-9166-fb062a8c5851 tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.326s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:31 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-cc862fc7-0355-4136-9166-fb062a8c5851 tempest-GroupSnapshotsTest-2102677433 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:37:31 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-cc862fc7-0355-4136-9166-fb062a8c5851 tempest-GroupSnapshotsTest-2102677433 None] Delete group completed successfully. Jul 28 10:37:32 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-5a99d720-0bf2-4c2a-b52a-c362eb9491c5 tempest-GroupSnapshotsTest-2102677433 None] Group tempest-GroupSnapshotsTest-Group-1149415154: creating Jul 28 10:37:32 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-5a99d720-0bf2-4c2a-b52a-c362eb9491c5 tempest-GroupSnapshotsTest-2102677433 None] Group tempest-GroupSnapshotsTest-Group-1149415154: created successfully Jul 28 10:37:32 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-5a99d720-0bf2-4c2a-b52a-c362eb9491c5 tempest-GroupSnapshotsTest-2102677433 None] Create group completed successfully. Jul 28 10:37:34 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-f86a252d-2bc8-4a37-a28d-049f2ff7e0db tempest-GroupSnapshotsTest-2102677433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:37:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f86a252d-2bc8-4a37-a28d-049f2ff7e0db tempest-GroupSnapshotsTest-2102677433 None] Flow 'volume_create_manager' (6f75daa1-b239-40f6-aeb8-6fa096ea5016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:37:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f86a252d-2bc8-4a37-a28d-049f2ff7e0db tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfb9d91a-bc63-41c5-ad36-a6c50e056127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:37:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f86a252d-2bc8-4a37-a28d-049f2ff7e0db tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfb9d91a-bc63-41c5-ad36-a6c50e056127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1265014084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=41803b22-1d95-4796-b866-3fd4b38d537d,host='devstack@QuobyteHD#QuobyteHD',id=1be3a24b-4b8d-4c4a-86fe-098b38647b3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1ff79c74ff64e49b423d6225b236f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:37:34Z,use_quota=True,user_id='2a8b504e38ed480a917411d62f6c9bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41d73a08-efc0-49f6-bf9c-9375816cb5b6),volume_type_id=41d73a08-efc0-49f6-bf9c-9375816cb5b6)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:37:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f86a252d-2bc8-4a37-a28d-049f2ff7e0db tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb8e3ef7-654b-42cc-a91b-85b3c37b4a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:37:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f86a252d-2bc8-4a37-a28d-049f2ff7e0db tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb8e3ef7-654b-42cc-a91b-85b3c37b4a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:37:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f86a252d-2bc8-4a37-a28d-049f2ff7e0db tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ed11d7-be76-4538-8248-38999ce33a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:37:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f86a252d-2bc8-4a37-a28d-049f2ff7e0db tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ed11d7-be76-4538-8248-38999ce33a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1be3a24b-4b8d-4c4a-86fe-098b38647b3c', 'volume_name': 'volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:37:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f86a252d-2bc8-4a37-a28d-049f2ff7e0db tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d63426c-45e3-4762-b20c-950ae8d2afdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:37:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f86a252d-2bc8-4a37-a28d-049f2ff7e0db tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d63426c-45e3-4762-b20c-950ae8d2afdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:37:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f86a252d-2bc8-4a37-a28d-049f2ff7e0db tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea14fb59-dee5-4dbf-9496-55061e2a353b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:37:34 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-f86a252d-2bc8-4a37-a28d-049f2ff7e0db tempest-GroupSnapshotsTest-2102677433 None] Volume 1be3a24b-4b8d-4c4a-86fe-098b38647b3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c', 'volume_size': 1} Jul 28 10:37:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f86a252d-2bc8-4a37-a28d-049f2ff7e0db tempest-GroupSnapshotsTest-2102677433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:37:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f86a252d-2bc8-4a37-a28d-049f2ff7e0db tempest-GroupSnapshotsTest-2102677433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:37:34 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f86a252d-2bc8-4a37-a28d-049f2ff7e0db tempest-GroupSnapshotsTest-2102677433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=41803b22-1d95-4796-b866-3fd4b38d537d,created_at=2026-07-28T08:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1265014084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=41803b22-1d95-4796-b866-3fd4b38d537d,host='devstack@QuobyteHD#QuobyteHD',id=1be3a24b-4b8d-4c4a-86fe-098b38647b3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1ff79c74ff64e49b423d6225b236f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:37:34Z,use_quota=True,user_id='2a8b504e38ed480a917411d62f6c9bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41d73a08-efc0-49f6-bf9c-9375816cb5b6),volume_type_id=41d73a08-efc0-49f6-bf9c-9375816cb5b6)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:37:34 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-f86a252d-2bc8-4a37-a28d-049f2ff7e0db tempest-GroupSnapshotsTest-2102677433 None] Creating volume 1be3a24b-4b8d-4c4a-86fe-098b38647b3c {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:37:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f86a252d-2bc8-4a37-a28d-049f2ff7e0db tempest-GroupSnapshotsTest-2102677433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:37:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f86a252d-2bc8-4a37-a28d-049f2ff7e0db tempest-GroupSnapshotsTest-2102677433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:37:34 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f86a252d-2bc8-4a37-a28d-049f2ff7e0db tempest-GroupSnapshotsTest-2102677433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:37:34 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f86a252d-2bc8-4a37-a28d-049f2ff7e0db tempest-GroupSnapshotsTest-2102677433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:37:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f86a252d-2bc8-4a37-a28d-049f2ff7e0db tempest-GroupSnapshotsTest-2102677433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:37:34 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f86a252d-2bc8-4a37-a28d-049f2ff7e0db tempest-GroupSnapshotsTest-2102677433 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:37:34 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-f86a252d-2bc8-4a37-a28d-049f2ff7e0db tempest-GroupSnapshotsTest-2102677433 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:37:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f86a252d-2bc8-4a37-a28d-049f2ff7e0db tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:34 devstack sudo[90942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c 1073741824 Jul 28 10:37:34 devstack sudo[90942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:34 devstack sudo[90942]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f86a252d-2bc8-4a37-a28d-049f2ff7e0db tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c 1073741824" returned: 0 in 0.579s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f86a252d-2bc8-4a37-a28d-049f2ff7e0db tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:34 devstack sudo[90949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c Jul 28 10:37:34 devstack sudo[90949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:35 devstack sudo[90949]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f86a252d-2bc8-4a37-a28d-049f2ff7e0db tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c" returned: 0 in 0.356s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:35 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f86a252d-2bc8-4a37-a28d-049f2ff7e0db tempest-GroupSnapshotsTest-2102677433 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:37:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f86a252d-2bc8-4a37-a28d-049f2ff7e0db tempest-GroupSnapshotsTest-2102677433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:37:35 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f86a252d-2bc8-4a37-a28d-049f2ff7e0db tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea14fb59-dee5-4dbf-9496-55061e2a353b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:37:35 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f86a252d-2bc8-4a37-a28d-049f2ff7e0db tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b56f7e5a-3b14-40b1-9274-4f39402dece2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:37:35 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-f86a252d-2bc8-4a37-a28d-049f2ff7e0db tempest-GroupSnapshotsTest-2102677433 None] Volume volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c (1be3a24b-4b8d-4c4a-86fe-098b38647b3c): created successfully Jul 28 10:37:35 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f86a252d-2bc8-4a37-a28d-049f2ff7e0db tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b56f7e5a-3b14-40b1-9274-4f39402dece2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:37:35 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f86a252d-2bc8-4a37-a28d-049f2ff7e0db tempest-GroupSnapshotsTest-2102677433 None] Flow 'volume_create_manager' (6f75daa1-b239-40f6-aeb8-6fa096ea5016) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:37:35 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-f86a252d-2bc8-4a37-a28d-049f2ff7e0db tempest-GroupSnapshotsTest-2102677433 None] Created volume successfully. Jul 28 10:37:38 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb22b8b8-ef11-4eb8-974f-fcab60de6483 tempest-GroupSnapshotsTest-2102677433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:37:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fb22b8b8-ef11-4eb8-974f-fcab60de6483 tempest-GroupSnapshotsTest-2102677433 None] Flow 'volume_create_manager' (4c734cfe-ecef-4e35-a20f-bc7ab6ede1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:37:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fb22b8b8-ef11-4eb8-974f-fcab60de6483 tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b700675-87f0-4495-9196-5207904e6571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:37:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fb22b8b8-ef11-4eb8-974f-fcab60de6483 tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b700675-87f0-4495-9196-5207904e6571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-191945370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=41803b22-1d95-4796-b866-3fd4b38d537d,host='devstack@QuobyteHD#QuobyteHD',id=b2439ae4-e527-4f89-b37c-115ea55ccaf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1ff79c74ff64e49b423d6225b236f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:37:38Z,use_quota=True,user_id='2a8b504e38ed480a917411d62f6c9bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41d73a08-efc0-49f6-bf9c-9375816cb5b6),volume_type_id=41d73a08-efc0-49f6-bf9c-9375816cb5b6)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:37:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fb22b8b8-ef11-4eb8-974f-fcab60de6483 tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7693f698-60c9-40d9-aa9a-bcf0e805169b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:37:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fb22b8b8-ef11-4eb8-974f-fcab60de6483 tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7693f698-60c9-40d9-aa9a-bcf0e805169b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:37:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fb22b8b8-ef11-4eb8-974f-fcab60de6483 tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c6f2981-7f24-410b-8d1e-e4e7a7374dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:37:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fb22b8b8-ef11-4eb8-974f-fcab60de6483 tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c6f2981-7f24-410b-8d1e-e4e7a7374dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2439ae4-e527-4f89-b37c-115ea55ccaf2', 'volume_name': 'volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:37:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fb22b8b8-ef11-4eb8-974f-fcab60de6483 tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d22a350-2258-4a02-a571-1883df5ca338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:37:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fb22b8b8-ef11-4eb8-974f-fcab60de6483 tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d22a350-2258-4a02-a571-1883df5ca338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:37:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fb22b8b8-ef11-4eb8-974f-fcab60de6483 tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56a8750e-40a3-4633-944d-4148c2e2ed2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:37:38 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-fb22b8b8-ef11-4eb8-974f-fcab60de6483 tempest-GroupSnapshotsTest-2102677433 None] Volume b2439ae4-e527-4f89-b37c-115ea55ccaf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2', 'volume_size': 1} Jul 28 10:37:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fb22b8b8-ef11-4eb8-974f-fcab60de6483 tempest-GroupSnapshotsTest-2102677433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:37:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fb22b8b8-ef11-4eb8-974f-fcab60de6483 tempest-GroupSnapshotsTest-2102677433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:37:38 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-fb22b8b8-ef11-4eb8-974f-fcab60de6483 tempest-GroupSnapshotsTest-2102677433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=41803b22-1d95-4796-b866-3fd4b38d537d,created_at=2026-07-28T08:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-191945370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=41803b22-1d95-4796-b866-3fd4b38d537d,host='devstack@QuobyteHD#QuobyteHD',id=b2439ae4-e527-4f89-b37c-115ea55ccaf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1ff79c74ff64e49b423d6225b236f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:37:38Z,use_quota=True,user_id='2a8b504e38ed480a917411d62f6c9bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41d73a08-efc0-49f6-bf9c-9375816cb5b6),volume_type_id=41d73a08-efc0-49f6-bf9c-9375816cb5b6)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:37:38 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-fb22b8b8-ef11-4eb8-974f-fcab60de6483 tempest-GroupSnapshotsTest-2102677433 None] Creating volume b2439ae4-e527-4f89-b37c-115ea55ccaf2 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:37:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fb22b8b8-ef11-4eb8-974f-fcab60de6483 tempest-GroupSnapshotsTest-2102677433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:37:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fb22b8b8-ef11-4eb8-974f-fcab60de6483 tempest-GroupSnapshotsTest-2102677433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:37:38 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-fb22b8b8-ef11-4eb8-974f-fcab60de6483 tempest-GroupSnapshotsTest-2102677433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:37:38 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-fb22b8b8-ef11-4eb8-974f-fcab60de6483 tempest-GroupSnapshotsTest-2102677433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:37:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fb22b8b8-ef11-4eb8-974f-fcab60de6483 tempest-GroupSnapshotsTest-2102677433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:37:38 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-fb22b8b8-ef11-4eb8-974f-fcab60de6483 tempest-GroupSnapshotsTest-2102677433 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:37:38 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-fb22b8b8-ef11-4eb8-974f-fcab60de6483 tempest-GroupSnapshotsTest-2102677433 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:37:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fb22b8b8-ef11-4eb8-974f-fcab60de6483 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:38 devstack sudo[91017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2 1073741824 Jul 28 10:37:38 devstack sudo[91017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:38 devstack sudo[91017]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fb22b8b8-ef11-4eb8-974f-fcab60de6483 tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2 1073741824" returned: 0 in 0.695s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fb22b8b8-ef11-4eb8-974f-fcab60de6483 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:38 devstack sudo[91025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2 Jul 28 10:37:38 devstack sudo[91025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:39 devstack sudo[91025]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fb22b8b8-ef11-4eb8-974f-fcab60de6483 tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2" returned: 0 in 0.270s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:39 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-fb22b8b8-ef11-4eb8-974f-fcab60de6483 tempest-GroupSnapshotsTest-2102677433 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:37:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fb22b8b8-ef11-4eb8-974f-fcab60de6483 tempest-GroupSnapshotsTest-2102677433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:37:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fb22b8b8-ef11-4eb8-974f-fcab60de6483 tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56a8750e-40a3-4633-944d-4148c2e2ed2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:37:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fb22b8b8-ef11-4eb8-974f-fcab60de6483 tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45bc4ecd-e8a9-4b51-ad98-c7a6bf159ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:37:39 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-fb22b8b8-ef11-4eb8-974f-fcab60de6483 tempest-GroupSnapshotsTest-2102677433 None] Volume volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2 (b2439ae4-e527-4f89-b37c-115ea55ccaf2): created successfully Jul 28 10:37:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fb22b8b8-ef11-4eb8-974f-fcab60de6483 tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45bc4ecd-e8a9-4b51-ad98-c7a6bf159ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:37:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fb22b8b8-ef11-4eb8-974f-fcab60de6483 tempest-GroupSnapshotsTest-2102677433 None] Flow 'volume_create_manager' (4c734cfe-ecef-4e35-a20f-bc7ab6ede1aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:37:39 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-fb22b8b8-ef11-4eb8-974f-fcab60de6483 tempest-GroupSnapshotsTest-2102677433 None] Created volume successfully. Jul 28 10:37:41 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-26eea1fb-8fe9-4ea3-a056-cf08a55682a1 tempest-GroupSnapshotsTest-2102677433 None] Update group completed successfully. Jul 28 10:37:42 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-60a032ad-103a-4465-acfe-2a925f508976 tempest-GroupSnapshotsTest-2102677433 None] Update group completed successfully. Jul 28 10:37:43 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-40ca6079-d5e4-4477-bdb5-99625f7f859c tempest-GroupSnapshotsTest-2102677433 None] Update group completed successfully. Jul 28 10:37:43 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fcc9016d-3d64-465f-a33f-4f765892dbcb tempest-TaggedAttachmentsTest-423993782 None] Acquiring lock "cinder-52c2ba12-d568-4c56-98cc-84ea2344d4fb-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:37:43 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fcc9016d-3d64-465f-a33f-4f765892dbcb tempest-TaggedAttachmentsTest-423993782 None] Lock "cinder-52c2ba12-d568-4c56-98cc-84ea2344d4fb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:37:43 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fcc9016d-3d64-465f-a33f-4f765892dbcb tempest-TaggedAttachmentsTest-423993782 None] Acquiring lock "cinder-quobyte-52c2ba12-d568-4c56-98cc-84ea2344d4fb" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:37:43 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fcc9016d-3d64-465f-a33f-4f765892dbcb tempest-TaggedAttachmentsTest-423993782 None] Lock "cinder-quobyte-52c2ba12-d568-4c56-98cc-84ea2344d4fb" acquired by "delete_volume" :: waited 0.015s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:37:43 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bf7655-3c97-4e30-88e9-9a58c85151d9]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:37:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fcc9016d-3d64-465f-a33f-4f765892dbcb tempest-TaggedAttachmentsTest-423993782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-52c2ba12-d568-4c56-98cc-84ea2344d4fb {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:43 devstack sudo[91119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-52c2ba12-d568-4c56-98cc-84ea2344d4fb Jul 28 10:37:43 devstack sudo[91119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:44 devstack sudo[91119]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fcc9016d-3d64-465f-a33f-4f765892dbcb tempest-TaggedAttachmentsTest-423993782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-52c2ba12-d568-4c56-98cc-84ea2344d4fb" returned: 0 in 0.427s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fcc9016d-3d64-465f-a33f-4f765892dbcb tempest-TaggedAttachmentsTest-423993782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-52c2ba12-d568-4c56-98cc-84ea2344d4fb {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:44 devstack sudo[91124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-52c2ba12-d568-4c56-98cc-84ea2344d4fb Jul 28 10:37:44 devstack sudo[91124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:44 devstack sudo[91124]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fcc9016d-3d64-465f-a33f-4f765892dbcb tempest-TaggedAttachmentsTest-423993782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-52c2ba12-d568-4c56-98cc-84ea2344d4fb" returned: 0 in 0.403s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:44 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fcc9016d-3d64-465f-a33f-4f765892dbcb tempest-TaggedAttachmentsTest-423993782 None] Lock "cinder-quobyte-52c2ba12-d568-4c56-98cc-84ea2344d4fb" released by "delete_volume" :: held 0.905s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:37:44 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-fcc9016d-3d64-465f-a33f-4f765892dbcb tempest-TaggedAttachmentsTest-423993782 None] Created reservations ['e74c9f4d-e24a-4d5d-aece-925ca8700881', 'a550395e-dc6f-486d-b0cc-970b0c4ca404', 'ea8ac015-673c-46f2-a22e-502973a91d4c', 'af09adb9-2263-48ea-b9df-464cd531f341'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:37:44 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-cfada54b-1a2c-4209-8ed4-67a9893ab684 tempest-GroupSnapshotsTest-2102677433 None] Update group completed successfully. Jul 28 10:37:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fcc9016d-3d64-465f-a33f-4f765892dbcb tempest-TaggedAttachmentsTest-423993782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:37:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fcc9016d-3d64-465f-a33f-4f765892dbcb tempest-TaggedAttachmentsTest-423993782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:37:45 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-fcc9016d-3d64-465f-a33f-4f765892dbcb tempest-TaggedAttachmentsTest-423993782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:37:45 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-fcc9016d-3d64-465f-a33f-4f765892dbcb tempest-TaggedAttachmentsTest-423993782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:37:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fcc9016d-3d64-465f-a33f-4f765892dbcb tempest-TaggedAttachmentsTest-423993782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:37:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fcc9016d-3d64-465f-a33f-4f765892dbcb tempest-TaggedAttachmentsTest-423993782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:45 devstack sudo[91128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:37:45 devstack sudo[91128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:45 devstack sudo[91128]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fcc9016d-3d64-465f-a33f-4f765892dbcb tempest-TaggedAttachmentsTest-423993782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.317s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:45 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-fcc9016d-3d64-465f-a33f-4f765892dbcb tempest-TaggedAttachmentsTest-423993782 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:37:45 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-fcc9016d-3d64-465f-a33f-4f765892dbcb tempest-TaggedAttachmentsTest-423993782 None] Deleted volume successfully. Jul 28 10:37:45 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fcc9016d-3d64-465f-a33f-4f765892dbcb tempest-TaggedAttachmentsTest-423993782 None] Lock "cinder-52c2ba12-d568-4c56-98cc-84ea2344d4fb-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:37:46 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-1f408b0b-0ec1-445a-a484-13e0f5432d8f tempest-GroupSnapshotsTest-2102677433 None] GroupSnapshot 36ba4eac-bf2a-4ca5-9887-647a4926e626: creating. Jul 28 10:37:46 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1f408b0b-0ec1-445a-a484-13e0f5432d8f tempest-GroupSnapshotsTest-2102677433 None] Group snapshot 36ba4eac-bf2a-4ca5-9887-647a4926e626: creating. {{(pid=88413) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 28 10:37:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1f408b0b-0ec1-445a-a484-13e0f5432d8f tempest-GroupSnapshotsTest-2102677433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:37:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1f408b0b-0ec1-445a-a484-13e0f5432d8f tempest-GroupSnapshotsTest-2102677433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:37:46 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-1f408b0b-0ec1-445a-a484-13e0f5432d8f tempest-GroupSnapshotsTest-2102677433 None] Creating offline snapshot 48c59ee2-26b4-4317-a6d7-6a77dd6ab48c of volume 1be3a24b-4b8d-4c4a-86fe-098b38647b3c {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:37:46 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bea7be9-2cbf-410f-a9fc-c3b79f1e7d74]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:37:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1f408b0b-0ec1-445a-a484-13e0f5432d8f tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:46 devstack sudo[91133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c Jul 28 10:37:46 devstack sudo[91133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:47 devstack sudo[91133]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1f408b0b-0ec1-445a-a484-13e0f5432d8f tempest-GroupSnapshotsTest-2102677433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c" returned: 0 in 0.475s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1f408b0b-0ec1-445a-a484-13e0f5432d8f tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c.48c59ee2-26b4-4317-a6d7-6a77dd6ab48c 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:47 devstack sudo[91139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c.48c59ee2-26b4-4317-a6d7-6a77dd6ab48c 1G Jul 28 10:37:47 devstack sudo[91139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:47 devstack sudo[91139]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1f408b0b-0ec1-445a-a484-13e0f5432d8f tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c.48c59ee2-26b4-4317-a6d7-6a77dd6ab48c 1G" returned: 0 in 0.572s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1f408b0b-0ec1-445a-a484-13e0f5432d8f tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c.48c59ee2-26b4-4317-a6d7-6a77dd6ab48c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:47 devstack sudo[91146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c.48c59ee2-26b4-4317-a6d7-6a77dd6ab48c Jul 28 10:37:47 devstack sudo[91146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:47 devstack sudo[91146]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1f408b0b-0ec1-445a-a484-13e0f5432d8f tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c.48c59ee2-26b4-4317-a6d7-6a77dd6ab48c" returned: 0 in 0.323s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:47 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-1f408b0b-0ec1-445a-a484-13e0f5432d8f tempest-GroupSnapshotsTest-2102677433 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c.48c59ee2-26b4-4317-a6d7-6a77dd6ab48c is being set with open permissions: ugo+rw: NotImplementedError Jul 28 10:37:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1f408b0b-0ec1-445a-a484-13e0f5432d8f tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c.48c59ee2-26b4-4317-a6d7-6a77dd6ab48c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:47 devstack sudo[91152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c.48c59ee2-26b4-4317-a6d7-6a77dd6ab48c Jul 28 10:37:47 devstack sudo[91152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:48 devstack sudo[91152]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1f408b0b-0ec1-445a-a484-13e0f5432d8f tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c.48c59ee2-26b4-4317-a6d7-6a77dd6ab48c" returned: 0 in 0.266s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1f408b0b-0ec1-445a-a484-13e0f5432d8f tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:48 devstack sudo[91155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c.info Jul 28 10:37:48 devstack sudo[91155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:48 devstack sudo[91155]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1f408b0b-0ec1-445a-a484-13e0f5432d8f tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c.info" returned: 0 in 0.376s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:48 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-1f408b0b-0ec1-445a-a484-13e0f5432d8f tempest-GroupSnapshotsTest-2102677433 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c.info is being set with open permissions: ugo+rw: NotImplementedError Jul 28 10:37:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1f408b0b-0ec1-445a-a484-13e0f5432d8f tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:48 devstack sudo[91158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c.info Jul 28 10:37:48 devstack sudo[91158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:48 devstack sudo[91158]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1f408b0b-0ec1-445a-a484-13e0f5432d8f tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c.info" returned: 0 in 0.264s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1f408b0b-0ec1-445a-a484-13e0f5432d8f tempest-GroupSnapshotsTest-2102677433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.400s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:37:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1f408b0b-0ec1-445a-a484-13e0f5432d8f tempest-GroupSnapshotsTest-2102677433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:37:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1f408b0b-0ec1-445a-a484-13e0f5432d8f tempest-GroupSnapshotsTest-2102677433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:37:49 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-1f408b0b-0ec1-445a-a484-13e0f5432d8f tempest-GroupSnapshotsTest-2102677433 None] Creating offline snapshot a50d1a95-5009-4d44-b4b3-06599de47fd4 of volume b2439ae4-e527-4f89-b37c-115ea55ccaf2 {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:37:49 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ccf6599-b470-49f2-ab7f-6e2bc47480a8]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:37:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1f408b0b-0ec1-445a-a484-13e0f5432d8f tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:49 devstack sudo[91162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2 Jul 28 10:37:49 devstack sudo[91162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:49 devstack sudo[91162]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1f408b0b-0ec1-445a-a484-13e0f5432d8f tempest-GroupSnapshotsTest-2102677433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2" returned: 0 in 0.540s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1f408b0b-0ec1-445a-a484-13e0f5432d8f tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2.a50d1a95-5009-4d44-b4b3-06599de47fd4 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:49 devstack sudo[91169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2.a50d1a95-5009-4d44-b4b3-06599de47fd4 1G Jul 28 10:37:49 devstack sudo[91169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:50 devstack sudo[91169]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1f408b0b-0ec1-445a-a484-13e0f5432d8f tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2.a50d1a95-5009-4d44-b4b3-06599de47fd4 1G" returned: 0 in 0.722s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1f408b0b-0ec1-445a-a484-13e0f5432d8f tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2.a50d1a95-5009-4d44-b4b3-06599de47fd4 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:50 devstack sudo[91176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2.a50d1a95-5009-4d44-b4b3-06599de47fd4 Jul 28 10:37:50 devstack sudo[91176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:50 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5b20d72-e054-4cc9-b8ae-077d42d017fe tempest-ServerActionsTestOtherA-342503985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:37:50 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c5b20d72-e054-4cc9-b8ae-077d42d017fe tempest-ServerActionsTestOtherA-342503985 None] Flow 'volume_create_manager' (29b7de89-b44d-46dd-a495-0304feda135d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:37:50 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c5b20d72-e054-4cc9-b8ae-077d42d017fe tempest-ServerActionsTestOtherA-342503985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05b08fac-0fa9-4f7a-a29d-bf347e38c755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:37:50 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c5b20d72-e054-4cc9-b8ae-077d42d017fe tempest-ServerActionsTestOtherA-342503985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05b08fac-0fa9-4f7a-a29d-bf347e38c755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1091635012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1006a360-d8d6-4f63-9957-9f3349e7e256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8120068059d449a48697c27d3d54ed3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:37:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:37:50Z,use_quota=True,user_id='e29e88c37ced4cddb49514a654173a5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:37:50 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c5b20d72-e054-4cc9-b8ae-077d42d017fe tempest-ServerActionsTestOtherA-342503985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a2f0ff7-6a7f-42dc-b34f-291ebec39cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:37:50 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c5b20d72-e054-4cc9-b8ae-077d42d017fe tempest-ServerActionsTestOtherA-342503985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a2f0ff7-6a7f-42dc-b34f-291ebec39cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:37:50 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c5b20d72-e054-4cc9-b8ae-077d42d017fe tempest-ServerActionsTestOtherA-342503985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09cc2725-7c2d-4ea4-b2c2-18c2da6adba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:37:50 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c5b20d72-e054-4cc9-b8ae-077d42d017fe tempest-ServerActionsTestOtherA-342503985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09cc2725-7c2d-4ea4-b2c2-18c2da6adba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1006a360-d8d6-4f63-9957-9f3349e7e256', 'volume_name': 'volume-1006a360-d8d6-4f63-9957-9f3349e7e256', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:37:50 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c5b20d72-e054-4cc9-b8ae-077d42d017fe tempest-ServerActionsTestOtherA-342503985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00dee936-3b6b-4ea0-8136-592d82657edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:37:50 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c5b20d72-e054-4cc9-b8ae-077d42d017fe tempest-ServerActionsTestOtherA-342503985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00dee936-3b6b-4ea0-8136-592d82657edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:37:50 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c5b20d72-e054-4cc9-b8ae-077d42d017fe tempest-ServerActionsTestOtherA-342503985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e609ae3f-da8d-4dc1-80be-35c41ecdc73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:37:50 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-c5b20d72-e054-4cc9-b8ae-077d42d017fe tempest-ServerActionsTestOtherA-342503985 None] Volume 1006a360-d8d6-4f63-9957-9f3349e7e256: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1006a360-d8d6-4f63-9957-9f3349e7e256', 'volume_size': 1} Jul 28 10:37:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c5b20d72-e054-4cc9-b8ae-077d42d017fe tempest-ServerActionsTestOtherA-342503985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:37:50 devstack sudo[91176]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1f408b0b-0ec1-445a-a484-13e0f5432d8f tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2.a50d1a95-5009-4d44-b4b3-06599de47fd4" returned: 0 in 0.481s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:50 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-1f408b0b-0ec1-445a-a484-13e0f5432d8f tempest-GroupSnapshotsTest-2102677433 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2.a50d1a95-5009-4d44-b4b3-06599de47fd4 is being set with open permissions: ugo+rw: NotImplementedError Jul 28 10:37:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1f408b0b-0ec1-445a-a484-13e0f5432d8f tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2.a50d1a95-5009-4d44-b4b3-06599de47fd4 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:50 devstack sudo[91182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2.a50d1a95-5009-4d44-b4b3-06599de47fd4 Jul 28 10:37:50 devstack sudo[91182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:51 devstack sudo[91182]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1f408b0b-0ec1-445a-a484-13e0f5432d8f tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2.a50d1a95-5009-4d44-b4b3-06599de47fd4" returned: 0 in 0.329s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1f408b0b-0ec1-445a-a484-13e0f5432d8f tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:51 devstack sudo[91185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2.info Jul 28 10:37:51 devstack sudo[91185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:51 devstack sudo[91185]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1f408b0b-0ec1-445a-a484-13e0f5432d8f tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2.info" returned: 0 in 0.382s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:51 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-1f408b0b-0ec1-445a-a484-13e0f5432d8f tempest-GroupSnapshotsTest-2102677433 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2.info is being set with open permissions: ugo+rw: NotImplementedError Jul 28 10:37:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1f408b0b-0ec1-445a-a484-13e0f5432d8f tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:51 devstack sudo[91188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2.info Jul 28 10:37:51 devstack sudo[91188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:51 devstack sudo[91188]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1f408b0b-0ec1-445a-a484-13e0f5432d8f tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2.info" returned: 0 in 0.354s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1f408b0b-0ec1-445a-a484-13e0f5432d8f tempest-GroupSnapshotsTest-2102677433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.013s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:37:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c5b20d72-e054-4cc9-b8ae-077d42d017fe tempest-ServerActionsTestOtherA-342503985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.445s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:37:51 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c5b20d72-e054-4cc9-b8ae-077d42d017fe tempest-ServerActionsTestOtherA-342503985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1091635012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1006a360-d8d6-4f63-9957-9f3349e7e256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8120068059d449a48697c27d3d54ed3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:37:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:37:50Z,use_quota=True,user_id='e29e88c37ced4cddb49514a654173a5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:37:51 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-c5b20d72-e054-4cc9-b8ae-077d42d017fe tempest-ServerActionsTestOtherA-342503985 None] Creating volume 1006a360-d8d6-4f63-9957-9f3349e7e256 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:37:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c5b20d72-e054-4cc9-b8ae-077d42d017fe tempest-ServerActionsTestOtherA-342503985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:37:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c5b20d72-e054-4cc9-b8ae-077d42d017fe tempest-ServerActionsTestOtherA-342503985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:37:51 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c5b20d72-e054-4cc9-b8ae-077d42d017fe tempest-ServerActionsTestOtherA-342503985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:37:51 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c5b20d72-e054-4cc9-b8ae-077d42d017fe tempest-ServerActionsTestOtherA-342503985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:37:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c5b20d72-e054-4cc9-b8ae-077d42d017fe tempest-ServerActionsTestOtherA-342503985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:37:51 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c5b20d72-e054-4cc9-b8ae-077d42d017fe tempest-ServerActionsTestOtherA-342503985 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:37:51 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-c5b20d72-e054-4cc9-b8ae-077d42d017fe tempest-ServerActionsTestOtherA-342503985 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:37:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c5b20d72-e054-4cc9-b8ae-077d42d017fe tempest-ServerActionsTestOtherA-342503985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1006a360-d8d6-4f63-9957-9f3349e7e256 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:52 devstack sudo[91191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1006a360-d8d6-4f63-9957-9f3349e7e256 1073741824 Jul 28 10:37:52 devstack sudo[91191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:52 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-1f408b0b-0ec1-445a-a484-13e0f5432d8f tempest-GroupSnapshotsTest-2102677433 None] group_snapshot 36ba4eac-bf2a-4ca5-9887-647a4926e626: created successfully Jul 28 10:37:52 devstack sudo[91191]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c5b20d72-e054-4cc9-b8ae-077d42d017fe tempest-ServerActionsTestOtherA-342503985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1006a360-d8d6-4f63-9957-9f3349e7e256 1073741824" returned: 0 in 0.649s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c5b20d72-e054-4cc9-b8ae-077d42d017fe tempest-ServerActionsTestOtherA-342503985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1006a360-d8d6-4f63-9957-9f3349e7e256 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:52 devstack sudo[91199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1006a360-d8d6-4f63-9957-9f3349e7e256 Jul 28 10:37:52 devstack sudo[91199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:53 devstack sudo[91199]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c5b20d72-e054-4cc9-b8ae-077d42d017fe tempest-ServerActionsTestOtherA-342503985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1006a360-d8d6-4f63-9957-9f3349e7e256" returned: 0 in 0.359s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:53 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c5b20d72-e054-4cc9-b8ae-077d42d017fe tempest-ServerActionsTestOtherA-342503985 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:37:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c5b20d72-e054-4cc9-b8ae-077d42d017fe tempest-ServerActionsTestOtherA-342503985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:37:53 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c5b20d72-e054-4cc9-b8ae-077d42d017fe tempest-ServerActionsTestOtherA-342503985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e609ae3f-da8d-4dc1-80be-35c41ecdc73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1006a360-d8d6-4f63-9957-9f3349e7e256', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:37:53 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c5b20d72-e054-4cc9-b8ae-077d42d017fe tempest-ServerActionsTestOtherA-342503985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01e7ee2d-fad7-49fc-a41b-ecf6cf6be470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:37:53 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-c5b20d72-e054-4cc9-b8ae-077d42d017fe tempest-ServerActionsTestOtherA-342503985 None] Volume volume-1006a360-d8d6-4f63-9957-9f3349e7e256 (1006a360-d8d6-4f63-9957-9f3349e7e256): created successfully Jul 28 10:37:53 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c5b20d72-e054-4cc9-b8ae-077d42d017fe tempest-ServerActionsTestOtherA-342503985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01e7ee2d-fad7-49fc-a41b-ecf6cf6be470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:37:53 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c5b20d72-e054-4cc9-b8ae-077d42d017fe tempest-ServerActionsTestOtherA-342503985 None] Flow 'volume_create_manager' (29b7de89-b44d-46dd-a495-0304feda135d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:37:53 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] group_snapshot 36ba4eac-bf2a-4ca5-9887-647a4926e626: deleting Jul 28 10:37:53 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-c5b20d72-e054-4cc9-b8ae-077d42d017fe tempest-ServerActionsTestOtherA-342503985 None] Created volume successfully. Jul 28 10:37:53 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] group_snapshot 36ba4eac-bf2a-4ca5-9887-647a4926e626: deleting {{(pid=88413) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 28 10:37:53 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] Acquiring lock "cinder-quobyte-1be3a24b-4b8d-4c4a-86fe-098b38647b3c" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:37:53 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] Lock "cinder-quobyte-1be3a24b-4b8d-4c4a-86fe-098b38647b3c" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:37:53 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] Acquiring lock "cinder-quobyte-48c59ee2-26b4-4317-a6d7-6a77dd6ab48c" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:37:53 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] Lock "cinder-quobyte-48c59ee2-26b4-4317-a6d7-6a77dd6ab48c" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:37:53 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] Deleting offline snapshot 48c59ee2-26b4-4317-a6d7-6a77dd6ab48c of volume 1be3a24b-4b8d-4c4a-86fe-098b38647b3c {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:37:53 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] snapshot_file for this snap is: volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c.48c59ee2-26b4-4317-a6d7-6a77dd6ab48c {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:37:53 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65d91ee-b233-4bca-9e45-7640077816f7]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:37:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c.48c59ee2-26b4-4317-a6d7-6a77dd6ab48c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:53 devstack sudo[91202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c.48c59ee2-26b4-4317-a6d7-6a77dd6ab48c Jul 28 10:37:53 devstack sudo[91202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:54 devstack sudo[91202]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c.48c59ee2-26b4-4317-a6d7-6a77dd6ab48c" returned: 0 in 0.675s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:54 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:37:54 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56048ba-d13a-4a8d-84e3-b726c3c4ff43]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:37:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:54 devstack sudo[91207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c Jul 28 10:37:54 devstack sudo[91207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:54 devstack sudo[91207]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c" returned: 0 in 0.667s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c.48c59ee2-26b4-4317-a6d7-6a77dd6ab48c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:54 devstack sudo[91212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c.48c59ee2-26b4-4317-a6d7-6a77dd6ab48c Jul 28 10:37:54 devstack sudo[91212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:55 devstack sudo[91212]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c.48c59ee2-26b4-4317-a6d7-6a77dd6ab48c" returned: 0 in 0.554s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c.48c59ee2-26b4-4317-a6d7-6a77dd6ab48c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:55 devstack sudo[91239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c.48c59ee2-26b4-4317-a6d7-6a77dd6ab48c Jul 28 10:37:55 devstack sudo[91239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:55 devstack sudo[91239]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c.48c59ee2-26b4-4317-a6d7-6a77dd6ab48c" returned: 0 in 0.516s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:55 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] Lock "cinder-quobyte-48c59ee2-26b4-4317-a6d7-6a77dd6ab48c" released by "_delete_snapshot" :: held 2.550s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:37:55 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] Lock "cinder-quobyte-1be3a24b-4b8d-4c4a-86fe-098b38647b3c" released by "delete_snapshot" :: held 2.605s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:37:55 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] Acquiring lock "cinder-quobyte-b2439ae4-e527-4f89-b37c-115ea55ccaf2" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:37:55 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] Lock "cinder-quobyte-b2439ae4-e527-4f89-b37c-115ea55ccaf2" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:37:55 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] Acquiring lock "cinder-quobyte-a50d1a95-5009-4d44-b4b3-06599de47fd4" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:37:55 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] Lock "cinder-quobyte-a50d1a95-5009-4d44-b4b3-06599de47fd4" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:37:55 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] Deleting offline snapshot a50d1a95-5009-4d44-b4b3-06599de47fd4 of volume b2439ae4-e527-4f89-b37c-115ea55ccaf2 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:37:55 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] snapshot_file for this snap is: volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2.a50d1a95-5009-4d44-b4b3-06599de47fd4 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:37:55 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f402e67-1da5-45aa-99e2-5ff864653856]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:37:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2.a50d1a95-5009-4d44-b4b3-06599de47fd4 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:56 devstack sudo[91247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2.a50d1a95-5009-4d44-b4b3-06599de47fd4 Jul 28 10:37:56 devstack sudo[91247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:56 devstack sudo[91247]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2.a50d1a95-5009-4d44-b4b3-06599de47fd4" returned: 0 in 0.399s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:56 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:37:56 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[2941317d-3ae7-495c-9e89-46c59b5241ea]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:37:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:56 devstack sudo[91256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2 Jul 28 10:37:56 devstack sudo[91256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:56 devstack sudo[91256]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2" returned: 0 in 0.549s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2.a50d1a95-5009-4d44-b4b3-06599de47fd4 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:56 devstack sudo[91262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2.a50d1a95-5009-4d44-b4b3-06599de47fd4 Jul 28 10:37:56 devstack sudo[91262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:57 devstack sudo[91262]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2.a50d1a95-5009-4d44-b4b3-06599de47fd4" returned: 0 in 0.450s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2.a50d1a95-5009-4d44-b4b3-06599de47fd4 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:57 devstack sudo[91272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2.a50d1a95-5009-4d44-b4b3-06599de47fd4 Jul 28 10:37:57 devstack sudo[91272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:57 devstack sudo[91272]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2.a50d1a95-5009-4d44-b4b3-06599de47fd4" returned: 0 in 0.437s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:57 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] Lock "cinder-quobyte-a50d1a95-5009-4d44-b4b3-06599de47fd4" released by "_delete_snapshot" :: held 1.986s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:37:57 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] Lock "cinder-quobyte-b2439ae4-e527-4f89-b37c-115ea55ccaf2" released by "delete_snapshot" :: held 2.021s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:37:58 devstack cinder-volume[88413]: WARNING cinder.quota [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-410475937 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-410475937, it is now deprecated. Please use the default quota class for default quota. Jul 28 10:37:58 devstack cinder-volume[88413]: WARNING cinder.quota [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-410475937 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-410475937, it is now deprecated. Please use the default quota class for default quota. Jul 28 10:37:58 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] Created reservations ['43b56318-7e95-40df-b695-079fe5627174', '17980c80-fa76-4334-a487-51a7d5cc7065', '40eec1fa-3225-402b-a2c8-c19c7f2a5c73', '349f5e09-980c-4c99-8a09-ddbf1e7d2718'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:37:58 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] Created reservations ['e7ec78e6-1222-483c-b795-9fee94648ffa', '49cda43a-96ab-43d5-af68-16d4d4c9ad15', 'aad25592-5942-447a-9437-dd29f05448a8', 'c28f96ca-7eb6-440f-b713-9ebd685faac2'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:37:58 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-0cc7a70d-c85f-4e39-9ae5-9b64cbe17960 tempest-GroupSnapshotsTest-2102677433 None] group_snapshot 36ba4eac-bf2a-4ca5-9887-647a4926e626: deleted successfully Jul 28 10:37:59 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f2467c33-e4d9-4071-98c8-1058d2691d34 tempest-GroupSnapshotsTest-2102677433 None] Acquiring lock "cinder-quobyte-1be3a24b-4b8d-4c4a-86fe-098b38647b3c" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:37:59 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f2467c33-e4d9-4071-98c8-1058d2691d34 tempest-GroupSnapshotsTest-2102677433 None] Lock "cinder-quobyte-1be3a24b-4b8d-4c4a-86fe-098b38647b3c" acquired by "delete_volume" :: waited 0.031s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:37:59 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[7afc61f1-da6d-4449-bcf5-cc28eeb931c3]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:37:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f2467c33-e4d9-4071-98c8-1058d2691d34 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:59 devstack sudo[91292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c Jul 28 10:37:59 devstack sudo[91292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:37:59 devstack sudo[91292]: pam_unix(sudo:session): session closed for user root Jul 28 10:37:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f2467c33-e4d9-4071-98c8-1058d2691d34 tempest-GroupSnapshotsTest-2102677433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c" returned: 0 in 0.500s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:37:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f2467c33-e4d9-4071-98c8-1058d2691d34 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:37:59 devstack sudo[91297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c Jul 28 10:37:59 devstack sudo[91297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:00 devstack sudo[91297]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f2467c33-e4d9-4071-98c8-1058d2691d34 tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1be3a24b-4b8d-4c4a-86fe-098b38647b3c" returned: 0 in 0.540s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:00 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f2467c33-e4d9-4071-98c8-1058d2691d34 tempest-GroupSnapshotsTest-2102677433 None] Lock "cinder-quobyte-1be3a24b-4b8d-4c4a-86fe-098b38647b3c" released by "delete_volume" :: held 1.167s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:38:00 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f2467c33-e4d9-4071-98c8-1058d2691d34 tempest-GroupSnapshotsTest-2102677433 None] Acquiring lock "cinder-quobyte-b2439ae4-e527-4f89-b37c-115ea55ccaf2" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:38:00 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f2467c33-e4d9-4071-98c8-1058d2691d34 tempest-GroupSnapshotsTest-2102677433 None] Lock "cinder-quobyte-b2439ae4-e527-4f89-b37c-115ea55ccaf2" acquired by "delete_volume" :: waited 0.023s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:38:00 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[8782df4a-8a8a-4a37-a714-b95cc0c174b3]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:38:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f2467c33-e4d9-4071-98c8-1058d2691d34 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:00 devstack sudo[91328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2 Jul 28 10:38:00 devstack sudo[91328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:01 devstack sudo[91328]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f2467c33-e4d9-4071-98c8-1058d2691d34 tempest-GroupSnapshotsTest-2102677433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2" returned: 0 in 0.515s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f2467c33-e4d9-4071-98c8-1058d2691d34 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:01 devstack sudo[91342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2 Jul 28 10:38:01 devstack sudo[91342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:01 devstack sudo[91342]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f2467c33-e4d9-4071-98c8-1058d2691d34 tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b2439ae4-e527-4f89-b37c-115ea55ccaf2" returned: 0 in 0.297s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:01 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f2467c33-e4d9-4071-98c8-1058d2691d34 tempest-GroupSnapshotsTest-2102677433 None] Lock "cinder-quobyte-b2439ae4-e527-4f89-b37c-115ea55ccaf2" released by "delete_volume" :: held 0.928s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:38:01 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:UPDATE=77,cinder:SELECT=88,cinder:INSERT=15,cinder:DELETE=3 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:38:01 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=87,cinder:UPDATE=73,cinder:INSERT=18,cinder:DELETE=2 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:38:01 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-f2467c33-e4d9-4071-98c8-1058d2691d34 tempest-GroupSnapshotsTest-2102677433 None] Created reservations ['0f66d763-acfe-4c08-8d36-7e0f71fa3229'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:38:01 devstack cinder-volume[88413]: WARNING cinder.quota [None req-f2467c33-e4d9-4071-98c8-1058d2691d34 tempest-GroupSnapshotsTest-2102677433 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-410475937 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-410475937, it is now deprecated. Please use the default quota class for default quota. Jul 28 10:38:01 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-f2467c33-e4d9-4071-98c8-1058d2691d34 tempest-GroupSnapshotsTest-2102677433 None] Created reservations ['75962a49-221c-4933-87af-bf708ebafb36', 'ed45c288-0596-4f10-8121-4be84e115c17', 'c66811b7-3cec-44c4-812a-727bb58f1b70', 'e114dcbf-fe9f-4153-aa1d-65b4711aaf16'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:38:01 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-f2467c33-e4d9-4071-98c8-1058d2691d34 tempest-GroupSnapshotsTest-2102677433 None] Created reservations ['334f7c17-0cbf-416b-ba57-65c5958bb889', '63a17e85-b3fe-4a93-802e-117cab7839d7', '1e094199-6d25-476a-b6cc-a76347900a7b', '874a6b88-bd31-4658-8ee0-b671582b3a8a'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:38:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f2467c33-e4d9-4071-98c8-1058d2691d34 tempest-GroupSnapshotsTest-2102677433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:38:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f2467c33-e4d9-4071-98c8-1058d2691d34 tempest-GroupSnapshotsTest-2102677433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:38:01 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f2467c33-e4d9-4071-98c8-1058d2691d34 tempest-GroupSnapshotsTest-2102677433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:38:01 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f2467c33-e4d9-4071-98c8-1058d2691d34 tempest-GroupSnapshotsTest-2102677433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:38:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f2467c33-e4d9-4071-98c8-1058d2691d34 tempest-GroupSnapshotsTest-2102677433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:38:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f2467c33-e4d9-4071-98c8-1058d2691d34 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:01 devstack sudo[91368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:38:01 devstack sudo[91368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:02 devstack sudo[91368]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f2467c33-e4d9-4071-98c8-1058d2691d34 tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.253s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:02 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-f2467c33-e4d9-4071-98c8-1058d2691d34 tempest-GroupSnapshotsTest-2102677433 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:38:02 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-f2467c33-e4d9-4071-98c8-1058d2691d34 tempest-GroupSnapshotsTest-2102677433 None] Delete group completed successfully. Jul 28 10:38:03 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-4bd09244-9cd1-4073-8b6e-47b116512670 tempest-GroupSnapshotsTest-2102677433 None] Group tempest-GroupSnapshotsTest-Group-1720163945: creating Jul 28 10:38:03 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-4bd09244-9cd1-4073-8b6e-47b116512670 tempest-GroupSnapshotsTest-2102677433 None] Group tempest-GroupSnapshotsTest-Group-1720163945: created successfully Jul 28 10:38:03 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-4bd09244-9cd1-4073-8b6e-47b116512670 tempest-GroupSnapshotsTest-2102677433 None] Create group completed successfully. Jul 28 10:38:06 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ba6c25d-f784-481e-9253-7556f0b190c5 tempest-GroupSnapshotsTest-2102677433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:38:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5ba6c25d-f784-481e-9253-7556f0b190c5 tempest-GroupSnapshotsTest-2102677433 None] Flow 'volume_create_manager' (5700e239-ca8c-4681-b6f9-89be223fa0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:38:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5ba6c25d-f784-481e-9253-7556f0b190c5 tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed6f553d-0943-4822-a46c-0ff2a10062c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5ba6c25d-f784-481e-9253-7556f0b190c5 tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed6f553d-0943-4822-a46c-0ff2a10062c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2025262866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=046a27aa-a6ce-4480-aa61-9428a16a65e1,host='devstack@QuobyteHD#QuobyteHD',id=a4d029c7-c643-443b-9179-b052aec2c210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1ff79c74ff64e49b423d6225b236f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:38:06Z,use_quota=True,user_id='2a8b504e38ed480a917411d62f6c9bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f89db660-0998-47c5-a19b-61f5f420cad4),volume_type_id=f89db660-0998-47c5-a19b-61f5f420cad4)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5ba6c25d-f784-481e-9253-7556f0b190c5 tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd5abc1f-1212-42ef-b61e-f4e9723aba50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5ba6c25d-f784-481e-9253-7556f0b190c5 tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd5abc1f-1212-42ef-b61e-f4e9723aba50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5ba6c25d-f784-481e-9253-7556f0b190c5 tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f9434ec-ff72-428a-91b9-b4c023aba1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5ba6c25d-f784-481e-9253-7556f0b190c5 tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f9434ec-ff72-428a-91b9-b4c023aba1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4d029c7-c643-443b-9179-b052aec2c210', 'volume_name': 'volume-a4d029c7-c643-443b-9179-b052aec2c210', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5ba6c25d-f784-481e-9253-7556f0b190c5 tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4b3fa49-f26f-4285-8601-515789e44c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5ba6c25d-f784-481e-9253-7556f0b190c5 tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4b3fa49-f26f-4285-8601-515789e44c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5ba6c25d-f784-481e-9253-7556f0b190c5 tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc0e4ee5-e5b0-48ab-a47a-a2f650c947d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:06 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-5ba6c25d-f784-481e-9253-7556f0b190c5 tempest-GroupSnapshotsTest-2102677433 None] Volume a4d029c7-c643-443b-9179-b052aec2c210: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4d029c7-c643-443b-9179-b052aec2c210', 'volume_size': 1} Jul 28 10:38:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5ba6c25d-f784-481e-9253-7556f0b190c5 tempest-GroupSnapshotsTest-2102677433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:38:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5ba6c25d-f784-481e-9253-7556f0b190c5 tempest-GroupSnapshotsTest-2102677433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:38:06 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5ba6c25d-f784-481e-9253-7556f0b190c5 tempest-GroupSnapshotsTest-2102677433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=046a27aa-a6ce-4480-aa61-9428a16a65e1,created_at=2026-07-28T08:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2025262866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=046a27aa-a6ce-4480-aa61-9428a16a65e1,host='devstack@QuobyteHD#QuobyteHD',id=a4d029c7-c643-443b-9179-b052aec2c210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1ff79c74ff64e49b423d6225b236f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:38:06Z,use_quota=True,user_id='2a8b504e38ed480a917411d62f6c9bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f89db660-0998-47c5-a19b-61f5f420cad4),volume_type_id=f89db660-0998-47c5-a19b-61f5f420cad4)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:38:06 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-5ba6c25d-f784-481e-9253-7556f0b190c5 tempest-GroupSnapshotsTest-2102677433 None] Creating volume a4d029c7-c643-443b-9179-b052aec2c210 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:38:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5ba6c25d-f784-481e-9253-7556f0b190c5 tempest-GroupSnapshotsTest-2102677433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:38:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5ba6c25d-f784-481e-9253-7556f0b190c5 tempest-GroupSnapshotsTest-2102677433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:38:06 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5ba6c25d-f784-481e-9253-7556f0b190c5 tempest-GroupSnapshotsTest-2102677433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:38:06 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5ba6c25d-f784-481e-9253-7556f0b190c5 tempest-GroupSnapshotsTest-2102677433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:38:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5ba6c25d-f784-481e-9253-7556f0b190c5 tempest-GroupSnapshotsTest-2102677433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:38:06 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5ba6c25d-f784-481e-9253-7556f0b190c5 tempest-GroupSnapshotsTest-2102677433 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:38:06 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-5ba6c25d-f784-481e-9253-7556f0b190c5 tempest-GroupSnapshotsTest-2102677433 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:38:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5ba6c25d-f784-481e-9253-7556f0b190c5 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:06 devstack sudo[91375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210 1073741824 Jul 28 10:38:06 devstack sudo[91375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:06 devstack sudo[91375]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5ba6c25d-f784-481e-9253-7556f0b190c5 tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210 1073741824" returned: 0 in 0.609s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5ba6c25d-f784-481e-9253-7556f0b190c5 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:07 devstack sudo[91381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210 Jul 28 10:38:07 devstack sudo[91381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:07 devstack sudo[91381]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5ba6c25d-f784-481e-9253-7556f0b190c5 tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210" returned: 0 in 0.462s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:07 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5ba6c25d-f784-481e-9253-7556f0b190c5 tempest-GroupSnapshotsTest-2102677433 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:38:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5ba6c25d-f784-481e-9253-7556f0b190c5 tempest-GroupSnapshotsTest-2102677433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:38:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5ba6c25d-f784-481e-9253-7556f0b190c5 tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc0e4ee5-e5b0-48ab-a47a-a2f650c947d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4d029c7-c643-443b-9179-b052aec2c210', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5ba6c25d-f784-481e-9253-7556f0b190c5 tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d381dae0-585b-4eec-aeeb-216be0641cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:07 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-5ba6c25d-f784-481e-9253-7556f0b190c5 tempest-GroupSnapshotsTest-2102677433 None] Volume volume-a4d029c7-c643-443b-9179-b052aec2c210 (a4d029c7-c643-443b-9179-b052aec2c210): created successfully Jul 28 10:38:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5ba6c25d-f784-481e-9253-7556f0b190c5 tempest-GroupSnapshotsTest-2102677433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d381dae0-585b-4eec-aeeb-216be0641cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5ba6c25d-f784-481e-9253-7556f0b190c5 tempest-GroupSnapshotsTest-2102677433 None] Flow 'volume_create_manager' (5700e239-ca8c-4681-b6f9-89be223fa0fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:38:07 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-5ba6c25d-f784-481e-9253-7556f0b190c5 tempest-GroupSnapshotsTest-2102677433 None] Created volume successfully. Jul 28 10:38:09 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-83d365d3-fa65-45b8-b014-f2a8c056fe23 tempest-GroupSnapshotsTest-2102677433 None] GroupSnapshot 3e81e48c-7ea1-4fb7-9fef-048ca6be0afe: creating. Jul 28 10:38:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-83d365d3-fa65-45b8-b014-f2a8c056fe23 tempest-GroupSnapshotsTest-2102677433 None] Group snapshot 3e81e48c-7ea1-4fb7-9fef-048ca6be0afe: creating. {{(pid=88413) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 28 10:38:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-83d365d3-fa65-45b8-b014-f2a8c056fe23 tempest-GroupSnapshotsTest-2102677433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:38:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-83d365d3-fa65-45b8-b014-f2a8c056fe23 tempest-GroupSnapshotsTest-2102677433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:38:09 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-83d365d3-fa65-45b8-b014-f2a8c056fe23 tempest-GroupSnapshotsTest-2102677433 None] Creating offline snapshot be4e838c-0c44-496d-9dd7-34051575d70b of volume a4d029c7-c643-443b-9179-b052aec2c210 {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:38:09 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ad8b8c0-9422-442d-8db1-37753aa8b500 tempest-AttachVolumeTestJSON-250152809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:38:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1ad8b8c0-9422-442d-8db1-37753aa8b500 tempest-AttachVolumeTestJSON-250152809 None] Flow 'volume_create_manager' (1855d10f-6f9d-4655-bac8-ce59b22cfb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:38:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1ad8b8c0-9422-442d-8db1-37753aa8b500 tempest-AttachVolumeTestJSON-250152809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43692103-ee17-411e-bc10-4a167d6d00bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:09 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[1893e952-39b8-4aab-b63c-90426b78e5ba]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:38:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-83d365d3-fa65-45b8-b014-f2a8c056fe23 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1ad8b8c0-9422-442d-8db1-37753aa8b500 tempest-AttachVolumeTestJSON-250152809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43692103-ee17-411e-bc10-4a167d6d00bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1555903450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7af91544-9163-4c29-9233-70de6b390a7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='150a704735fe48429f68233c33fa87d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:38:09Z,use_quota=True,user_id='475d9d80f7b3425687e713b19ff704dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1ad8b8c0-9422-442d-8db1-37753aa8b500 tempest-AttachVolumeTestJSON-250152809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ba90536-969d-476f-aeb7-e4925f43ff7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1ad8b8c0-9422-442d-8db1-37753aa8b500 tempest-AttachVolumeTestJSON-250152809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ba90536-969d-476f-aeb7-e4925f43ff7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1ad8b8c0-9422-442d-8db1-37753aa8b500 tempest-AttachVolumeTestJSON-250152809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9e39b23-f904-4ff6-b0cb-5586edf04e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1ad8b8c0-9422-442d-8db1-37753aa8b500 tempest-AttachVolumeTestJSON-250152809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9e39b23-f904-4ff6-b0cb-5586edf04e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7af91544-9163-4c29-9233-70de6b390a7d', 'volume_name': 'volume-7af91544-9163-4c29-9233-70de6b390a7d', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1ad8b8c0-9422-442d-8db1-37753aa8b500 tempest-AttachVolumeTestJSON-250152809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (864e700e-d18c-4dbb-bdf2-9b9b9bc07327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1ad8b8c0-9422-442d-8db1-37753aa8b500 tempest-AttachVolumeTestJSON-250152809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (864e700e-d18c-4dbb-bdf2-9b9b9bc07327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1ad8b8c0-9422-442d-8db1-37753aa8b500 tempest-AttachVolumeTestJSON-250152809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9669f1bd-f684-4da7-a23d-fe75da616dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:09 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-1ad8b8c0-9422-442d-8db1-37753aa8b500 tempest-AttachVolumeTestJSON-250152809 None] Volume 7af91544-9163-4c29-9233-70de6b390a7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7af91544-9163-4c29-9233-70de6b390a7d', 'volume_size': 1} Jul 28 10:38:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1ad8b8c0-9422-442d-8db1-37753aa8b500 tempest-AttachVolumeTestJSON-250152809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:38:09 devstack sudo[91404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210 Jul 28 10:38:09 devstack sudo[91404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:10 devstack sudo[91404]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-83d365d3-fa65-45b8-b014-f2a8c056fe23 tempest-GroupSnapshotsTest-2102677433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210" returned: 0 in 0.788s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-83d365d3-fa65-45b8-b014-f2a8c056fe23 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210.be4e838c-0c44-496d-9dd7-34051575d70b 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:10 devstack sudo[91420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210.be4e838c-0c44-496d-9dd7-34051575d70b 1G Jul 28 10:38:10 devstack sudo[91420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:10 devstack sudo[91420]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-83d365d3-fa65-45b8-b014-f2a8c056fe23 tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210.be4e838c-0c44-496d-9dd7-34051575d70b 1G" returned: 0 in 0.726s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-83d365d3-fa65-45b8-b014-f2a8c056fe23 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4d029c7-c643-443b-9179-b052aec2c210 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210.be4e838c-0c44-496d-9dd7-34051575d70b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:10 devstack sudo[91426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4d029c7-c643-443b-9179-b052aec2c210 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210.be4e838c-0c44-496d-9dd7-34051575d70b Jul 28 10:38:10 devstack sudo[91426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:11 devstack sudo[91426]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-83d365d3-fa65-45b8-b014-f2a8c056fe23 tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4d029c7-c643-443b-9179-b052aec2c210 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210.be4e838c-0c44-496d-9dd7-34051575d70b" returned: 0 in 0.603s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:11 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-83d365d3-fa65-45b8-b014-f2a8c056fe23 tempest-GroupSnapshotsTest-2102677433 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210.be4e838c-0c44-496d-9dd7-34051575d70b is being set with open permissions: ugo+rw: NotImplementedError Jul 28 10:38:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-83d365d3-fa65-45b8-b014-f2a8c056fe23 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210.be4e838c-0c44-496d-9dd7-34051575d70b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:11 devstack sudo[91465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210.be4e838c-0c44-496d-9dd7-34051575d70b Jul 28 10:38:11 devstack sudo[91465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:11 devstack sudo[91465]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-83d365d3-fa65-45b8-b014-f2a8c056fe23 tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210.be4e838c-0c44-496d-9dd7-34051575d70b" returned: 0 in 0.422s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-83d365d3-fa65-45b8-b014-f2a8c056fe23 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:12 devstack sudo[91470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210.info Jul 28 10:38:12 devstack sudo[91470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:12 devstack sudo[91470]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-83d365d3-fa65-45b8-b014-f2a8c056fe23 tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210.info" returned: 0 in 0.385s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:12 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-83d365d3-fa65-45b8-b014-f2a8c056fe23 tempest-GroupSnapshotsTest-2102677433 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210.info is being set with open permissions: ugo+rw: NotImplementedError Jul 28 10:38:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-83d365d3-fa65-45b8-b014-f2a8c056fe23 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:12 devstack sudo[91473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210.info Jul 28 10:38:12 devstack sudo[91473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:12 devstack sudo[91473]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-83d365d3-fa65-45b8-b014-f2a8c056fe23 tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210.info" returned: 0 in 0.280s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-83d365d3-fa65-45b8-b014-f2a8c056fe23 tempest-GroupSnapshotsTest-2102677433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.385s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:38:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1ad8b8c0-9422-442d-8db1-37753aa8b500 tempest-AttachVolumeTestJSON-250152809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.117s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:38:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-1ad8b8c0-9422-442d-8db1-37753aa8b500 tempest-AttachVolumeTestJSON-250152809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1555903450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7af91544-9163-4c29-9233-70de6b390a7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='150a704735fe48429f68233c33fa87d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:38:09Z,use_quota=True,user_id='475d9d80f7b3425687e713b19ff704dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:38:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-1ad8b8c0-9422-442d-8db1-37753aa8b500 tempest-AttachVolumeTestJSON-250152809 None] Creating volume 7af91544-9163-4c29-9233-70de6b390a7d {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:38:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1ad8b8c0-9422-442d-8db1-37753aa8b500 tempest-AttachVolumeTestJSON-250152809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:38:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1ad8b8c0-9422-442d-8db1-37753aa8b500 tempest-AttachVolumeTestJSON-250152809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:38:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-1ad8b8c0-9422-442d-8db1-37753aa8b500 tempest-AttachVolumeTestJSON-250152809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:38:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-1ad8b8c0-9422-442d-8db1-37753aa8b500 tempest-AttachVolumeTestJSON-250152809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:38:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1ad8b8c0-9422-442d-8db1-37753aa8b500 tempest-AttachVolumeTestJSON-250152809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:38:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-1ad8b8c0-9422-442d-8db1-37753aa8b500 tempest-AttachVolumeTestJSON-250152809 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:38:12 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-1ad8b8c0-9422-442d-8db1-37753aa8b500 tempest-AttachVolumeTestJSON-250152809 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:38:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1ad8b8c0-9422-442d-8db1-37753aa8b500 tempest-AttachVolumeTestJSON-250152809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7af91544-9163-4c29-9233-70de6b390a7d 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:12 devstack sudo[91476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7af91544-9163-4c29-9233-70de6b390a7d 1073741824 Jul 28 10:38:12 devstack sudo[91476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:12 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-83d365d3-fa65-45b8-b014-f2a8c056fe23 tempest-GroupSnapshotsTest-2102677433 None] group_snapshot 3e81e48c-7ea1-4fb7-9fef-048ca6be0afe: created successfully Jul 28 10:38:13 devstack sudo[91476]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1ad8b8c0-9422-442d-8db1-37753aa8b500 tempest-AttachVolumeTestJSON-250152809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7af91544-9163-4c29-9233-70de6b390a7d 1073741824" returned: 0 in 0.531s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1ad8b8c0-9422-442d-8db1-37753aa8b500 tempest-AttachVolumeTestJSON-250152809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7af91544-9163-4c29-9233-70de6b390a7d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:13 devstack sudo[91481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7af91544-9163-4c29-9233-70de6b390a7d Jul 28 10:38:13 devstack sudo[91481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:13 devstack sudo[91481]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1ad8b8c0-9422-442d-8db1-37753aa8b500 tempest-AttachVolumeTestJSON-250152809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7af91544-9163-4c29-9233-70de6b390a7d" returned: 0 in 0.313s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:13 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-1ad8b8c0-9422-442d-8db1-37753aa8b500 tempest-AttachVolumeTestJSON-250152809 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:38:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1ad8b8c0-9422-442d-8db1-37753aa8b500 tempest-AttachVolumeTestJSON-250152809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:38:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1ad8b8c0-9422-442d-8db1-37753aa8b500 tempest-AttachVolumeTestJSON-250152809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9669f1bd-f684-4da7-a23d-fe75da616dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7af91544-9163-4c29-9233-70de6b390a7d', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1ad8b8c0-9422-442d-8db1-37753aa8b500 tempest-AttachVolumeTestJSON-250152809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc4cd84-c1d1-4573-b995-d75538aed897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:13 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-1ad8b8c0-9422-442d-8db1-37753aa8b500 tempest-AttachVolumeTestJSON-250152809 None] Volume volume-7af91544-9163-4c29-9233-70de6b390a7d (7af91544-9163-4c29-9233-70de6b390a7d): created successfully Jul 28 10:38:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1ad8b8c0-9422-442d-8db1-37753aa8b500 tempest-AttachVolumeTestJSON-250152809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc4cd84-c1d1-4573-b995-d75538aed897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1ad8b8c0-9422-442d-8db1-37753aa8b500 tempest-AttachVolumeTestJSON-250152809 None] Flow 'volume_create_manager' (1855d10f-6f9d-4655-bac8-ce59b22cfb1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:38:13 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-1ad8b8c0-9422-442d-8db1-37753aa8b500 tempest-AttachVolumeTestJSON-250152809 None] Created volume successfully. Jul 28 10:38:13 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-fc028705-2c35-4e63-9c19-108bcbbc089a tempest-GroupSnapshotsTest-2102677433 None] group_snapshot 3e81e48c-7ea1-4fb7-9fef-048ca6be0afe: deleting Jul 28 10:38:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fc028705-2c35-4e63-9c19-108bcbbc089a tempest-GroupSnapshotsTest-2102677433 None] group_snapshot 3e81e48c-7ea1-4fb7-9fef-048ca6be0afe: deleting {{(pid=88413) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 28 10:38:13 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fc028705-2c35-4e63-9c19-108bcbbc089a tempest-GroupSnapshotsTest-2102677433 None] Acquiring lock "cinder-quobyte-a4d029c7-c643-443b-9179-b052aec2c210" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:38:13 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fc028705-2c35-4e63-9c19-108bcbbc089a tempest-GroupSnapshotsTest-2102677433 None] Lock "cinder-quobyte-a4d029c7-c643-443b-9179-b052aec2c210" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:38:13 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fc028705-2c35-4e63-9c19-108bcbbc089a tempest-GroupSnapshotsTest-2102677433 None] Acquiring lock "cinder-quobyte-be4e838c-0c44-496d-9dd7-34051575d70b" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:38:13 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fc028705-2c35-4e63-9c19-108bcbbc089a tempest-GroupSnapshotsTest-2102677433 None] Lock "cinder-quobyte-be4e838c-0c44-496d-9dd7-34051575d70b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:38:13 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-fc028705-2c35-4e63-9c19-108bcbbc089a tempest-GroupSnapshotsTest-2102677433 None] Deleting offline snapshot be4e838c-0c44-496d-9dd7-34051575d70b of volume a4d029c7-c643-443b-9179-b052aec2c210 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:38:13 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-fc028705-2c35-4e63-9c19-108bcbbc089a tempest-GroupSnapshotsTest-2102677433 None] snapshot_file for this snap is: volume-a4d029c7-c643-443b-9179-b052aec2c210.be4e838c-0c44-496d-9dd7-34051575d70b {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:38:13 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceea188d-6c9c-4f31-8230-e1e92977b4e1]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:38:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fc028705-2c35-4e63-9c19-108bcbbc089a tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210.be4e838c-0c44-496d-9dd7-34051575d70b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:14 devstack sudo[91484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210.be4e838c-0c44-496d-9dd7-34051575d70b Jul 28 10:38:14 devstack sudo[91484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:14 devstack sudo[91484]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fc028705-2c35-4e63-9c19-108bcbbc089a tempest-GroupSnapshotsTest-2102677433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210.be4e838c-0c44-496d-9dd7-34051575d70b" returned: 0 in 0.450s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:14 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-fc028705-2c35-4e63-9c19-108bcbbc089a tempest-GroupSnapshotsTest-2102677433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4d029c7-c643-443b-9179-b052aec2c210(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:38:14 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d572311-13bb-4788-a97d-c813b9b8fd80]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:38:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fc028705-2c35-4e63-9c19-108bcbbc089a tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:14 devstack sudo[91493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210 Jul 28 10:38:14 devstack sudo[91493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:14 devstack sudo[91493]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fc028705-2c35-4e63-9c19-108bcbbc089a tempest-GroupSnapshotsTest-2102677433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210" returned: 0 in 0.541s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fc028705-2c35-4e63-9c19-108bcbbc089a tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210.be4e838c-0c44-496d-9dd7-34051575d70b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:15 devstack sudo[91505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210.be4e838c-0c44-496d-9dd7-34051575d70b Jul 28 10:38:15 devstack sudo[91505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-57ed6ca1-d4af-45c5-9920-25fbf7a4113f req-2671f36b-7e03-4c2d-812b-eb8210ce1907 tempest-AttachVolumeTestJSON-250152809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:38:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-57ed6ca1-d4af-45c5-9920-25fbf7a4113f req-2671f36b-7e03-4c2d-812b-eb8210ce1907 tempest-AttachVolumeTestJSON-250152809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:38:15 devstack sudo[91505]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fc028705-2c35-4e63-9c19-108bcbbc089a tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210.be4e838c-0c44-496d-9dd7-34051575d70b" returned: 0 in 0.678s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fc028705-2c35-4e63-9c19-108bcbbc089a tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210.be4e838c-0c44-496d-9dd7-34051575d70b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-57ed6ca1-d4af-45c5-9920-25fbf7a4113f req-2671f36b-7e03-4c2d-812b-eb8210ce1907 tempest-AttachVolumeTestJSON-250152809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.055s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:38:15 devstack sudo[91554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210.be4e838c-0c44-496d-9dd7-34051575d70b Jul 28 10:38:15 devstack sudo[91554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:15 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-57ed6ca1-d4af-45c5-9920-25fbf7a4113f req-2671f36b-7e03-4c2d-812b-eb8210ce1907 tempest-AttachVolumeTestJSON-250152809 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7', 'name': 'volume-7af91544-9163-4c29-9233-70de6b390a7d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5e186eb2-6e96-4576-94dc-69b43e9a90a6', 'enforce_multipath': True} {{(pid=88413) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 10:38:15 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-57ed6ca1-d4af-45c5-9920-25fbf7a4113f req-2671f36b-7e03-4c2d-812b-eb8210ce1907 tempest-AttachVolumeTestJSON-250152809 None] attachment_update completed successfully. Jul 28 10:38:15 devstack sudo[91554]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fc028705-2c35-4e63-9c19-108bcbbc089a tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210.be4e838c-0c44-496d-9dd7-34051575d70b" returned: 0 in 0.360s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:16 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fc028705-2c35-4e63-9c19-108bcbbc089a tempest-GroupSnapshotsTest-2102677433 None] Lock "cinder-quobyte-be4e838c-0c44-496d-9dd7-34051575d70b" released by "_delete_snapshot" :: held 2.232s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:38:16 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fc028705-2c35-4e63-9c19-108bcbbc089a tempest-GroupSnapshotsTest-2102677433 None] Lock "cinder-quobyte-a4d029c7-c643-443b-9179-b052aec2c210" released by "delete_snapshot" :: held 2.265s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:38:16 devstack cinder-volume[88413]: WARNING cinder.quota [None req-fc028705-2c35-4e63-9c19-108bcbbc089a tempest-GroupSnapshotsTest-2102677433 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1054300197 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1054300197, it is now deprecated. Please use the default quota class for default quota. Jul 28 10:38:16 devstack cinder-volume[88413]: WARNING cinder.quota [None req-fc028705-2c35-4e63-9c19-108bcbbc089a tempest-GroupSnapshotsTest-2102677433 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1054300197 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1054300197, it is now deprecated. Please use the default quota class for default quota. Jul 28 10:38:16 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-fc028705-2c35-4e63-9c19-108bcbbc089a tempest-GroupSnapshotsTest-2102677433 None] Created reservations ['d7c66c9a-9164-47f8-81ee-3e1192508696', 'd70186f7-4572-455f-af1c-5fd90470d963', 'ad54e100-2268-4838-b350-05ad9e415e3c', '824d7e61-a891-4812-b7c9-761b172b4a59'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:38:16 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-fc028705-2c35-4e63-9c19-108bcbbc089a tempest-GroupSnapshotsTest-2102677433 None] group_snapshot 3e81e48c-7ea1-4fb7-9fef-048ca6be0afe: deleted successfully Jul 28 10:38:17 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3c66b2c8-7028-4845-a1fd-fbde38abd072 tempest-GroupSnapshotsTest-2102677433 None] Acquiring lock "cinder-quobyte-a4d029c7-c643-443b-9179-b052aec2c210" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:38:17 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3c66b2c8-7028-4845-a1fd-fbde38abd072 tempest-GroupSnapshotsTest-2102677433 None] Lock "cinder-quobyte-a4d029c7-c643-443b-9179-b052aec2c210" acquired by "delete_volume" :: waited 0.032s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:38:17 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7cc656-cd38-466b-9af9-0bd6bb0aeb88]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:38:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3c66b2c8-7028-4845-a1fd-fbde38abd072 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:17 devstack sudo[91958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210 Jul 28 10:38:17 devstack sudo[91958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:18 devstack sudo[91958]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3c66b2c8-7028-4845-a1fd-fbde38abd072 tempest-GroupSnapshotsTest-2102677433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210" returned: 0 in 0.491s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3c66b2c8-7028-4845-a1fd-fbde38abd072 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:18 devstack sudo[91969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210 Jul 28 10:38:18 devstack sudo[91969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:18 devstack sudo[91969]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3c66b2c8-7028-4845-a1fd-fbde38abd072 tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a4d029c7-c643-443b-9179-b052aec2c210" returned: 0 in 0.262s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:18 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3c66b2c8-7028-4845-a1fd-fbde38abd072 tempest-GroupSnapshotsTest-2102677433 None] Lock "cinder-quobyte-a4d029c7-c643-443b-9179-b052aec2c210" released by "delete_volume" :: held 0.860s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:38:18 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-3c66b2c8-7028-4845-a1fd-fbde38abd072 tempest-GroupSnapshotsTest-2102677433 None] Created reservations ['3c9659cd-b291-4b2c-ae2c-44b8706c59b0'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:38:18 devstack cinder-volume[88413]: WARNING cinder.quota [None req-3c66b2c8-7028-4845-a1fd-fbde38abd072 tempest-GroupSnapshotsTest-2102677433 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1054300197 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1054300197, it is now deprecated. Please use the default quota class for default quota. Jul 28 10:38:18 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-3c66b2c8-7028-4845-a1fd-fbde38abd072 tempest-GroupSnapshotsTest-2102677433 None] Created reservations ['c0655739-5c7d-4f5c-9eee-ebf425ca6d90', 'ee2ea88d-f03c-4746-b6d2-e847d4dc1bd8', 'fd4aa3c8-2215-45cb-966d-6f9d86a0bc52', '5bec330f-ab4f-462d-a9c0-359f6d488d2a'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:38:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3c66b2c8-7028-4845-a1fd-fbde38abd072 tempest-GroupSnapshotsTest-2102677433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:38:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3c66b2c8-7028-4845-a1fd-fbde38abd072 tempest-GroupSnapshotsTest-2102677433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:38:18 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3c66b2c8-7028-4845-a1fd-fbde38abd072 tempest-GroupSnapshotsTest-2102677433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:38:18 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3c66b2c8-7028-4845-a1fd-fbde38abd072 tempest-GroupSnapshotsTest-2102677433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:38:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3c66b2c8-7028-4845-a1fd-fbde38abd072 tempest-GroupSnapshotsTest-2102677433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:38:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3c66b2c8-7028-4845-a1fd-fbde38abd072 tempest-GroupSnapshotsTest-2102677433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:18 devstack sudo[91978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:38:18 devstack sudo[91978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:19 devstack sudo[91978]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3c66b2c8-7028-4845-a1fd-fbde38abd072 tempest-GroupSnapshotsTest-2102677433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.409s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:19 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-3c66b2c8-7028-4845-a1fd-fbde38abd072 tempest-GroupSnapshotsTest-2102677433 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:38:19 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-3c66b2c8-7028-4845-a1fd-fbde38abd072 tempest-GroupSnapshotsTest-2102677433 None] Delete group completed successfully. Jul 28 10:38:28 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:38:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:38:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:38:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:38:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:38:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:38:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:28 devstack sudo[92593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:38:28 devstack sudo[92593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:28 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=45,cinder:UPDATE=57,cinder:INSERT=8,cinder:DELETE=2 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:38:28 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=44,cinder:INSERT=13,cinder:UPDATE=34 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:38:29 devstack sudo[92593]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.620s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:29 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:38:29 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager._thread_info {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:38:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread count: 8 {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 10:38:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread info: [<_MainThread(MainThread, started 137939890385024)>, , , , , , , ] {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 10:38:29 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-cdd93e02-80b1-4836-a453-7a0402b9c2fd tempest-GroupsTest-544951376 None] Group tempest-Group1-1378997772: creating Jul 28 10:38:29 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-cdd93e02-80b1-4836-a453-7a0402b9c2fd tempest-GroupsTest-544951376 None] Group tempest-Group1-1378997772: created successfully Jul 28 10:38:29 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-cdd93e02-80b1-4836-a453-7a0402b9c2fd tempest-GroupsTest-544951376 None] Create group completed successfully. Jul 28 10:38:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-2101423d-6042-437e-b259-038f1039596f req-b78ed297-c2f5-4b36-82e6-6bb86a3a27ab tempest-ServerActionsTestOtherA-342503985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:38:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-2101423d-6042-437e-b259-038f1039596f req-b78ed297-c2f5-4b36-82e6-6bb86a3a27ab tempest-ServerActionsTestOtherA-342503985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:38:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-2101423d-6042-437e-b259-038f1039596f req-b78ed297-c2f5-4b36-82e6-6bb86a3a27ab tempest-ServerActionsTestOtherA-342503985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:38:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-2101423d-6042-437e-b259-038f1039596f req-b78ed297-c2f5-4b36-82e6-6bb86a3a27ab tempest-ServerActionsTestOtherA-342503985 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7', 'name': 'volume-1006a360-d8d6-4f63-9957-9f3349e7e256', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a06a9b32-f14a-42d6-90e8-ca74b4d1ed27', 'enforce_multipath': True} {{(pid=88413) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 10:38:30 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-2101423d-6042-437e-b259-038f1039596f req-b78ed297-c2f5-4b36-82e6-6bb86a3a27ab tempest-ServerActionsTestOtherA-342503985 None] attachment_update completed successfully. Jul 28 10:38:31 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-fa385612-4aa5-49dd-a997-5f2a885499d4 tempest-GroupsTest-544951376 None] Group tempest-Group2-1106924149: creating Jul 28 10:38:31 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-fa385612-4aa5-49dd-a997-5f2a885499d4 tempest-GroupsTest-544951376 None] Group tempest-Group2-1106924149: created successfully Jul 28 10:38:31 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-fa385612-4aa5-49dd-a997-5f2a885499d4 tempest-GroupsTest-544951376 None] Create group completed successfully. Jul 28 10:38:33 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3109388-2f47-44a3-88fa-7f42d7db41d4 tempest-GroupsTest-544951376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:38:33 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a3109388-2f47-44a3-88fa-7f42d7db41d4 tempest-GroupsTest-544951376 None] Flow 'volume_create_manager' (6fcde980-7d0a-48ee-a27f-635b52db2317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:38:33 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a3109388-2f47-44a3-88fa-7f42d7db41d4 tempest-GroupsTest-544951376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d679cba-c1cd-4318-bdac-ab0a30f70e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:33 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a3109388-2f47-44a3-88fa-7f42d7db41d4 tempest-GroupsTest-544951376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d679cba-c1cd-4318-bdac-ab0a30f70e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1483390839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=63f62a4a-75ef-4b75-ac69-ba616bcb9a74,host='devstack@QuobyteHD#QuobyteHD',id=9282c255-2326-4c27-a98c-bd802aa4fffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='558694eabbcc4bdd93258361b57819a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:38:33Z,use_quota=True,user_id='24e74f8ee4624fa8bc451a39ca5b1204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a56db40-7c3b-46b5-83de-e620bbcfff9b),volume_type_id=3a56db40-7c3b-46b5-83de-e620bbcfff9b)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:33 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a3109388-2f47-44a3-88fa-7f42d7db41d4 tempest-GroupsTest-544951376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (711a517d-708b-4171-8af7-5c1bd4755299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:33 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a3109388-2f47-44a3-88fa-7f42d7db41d4 tempest-GroupsTest-544951376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (711a517d-708b-4171-8af7-5c1bd4755299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:33 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a3109388-2f47-44a3-88fa-7f42d7db41d4 tempest-GroupsTest-544951376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01096200-dfda-40b2-94fc-453c74bbfb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:33 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a3109388-2f47-44a3-88fa-7f42d7db41d4 tempest-GroupsTest-544951376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01096200-dfda-40b2-94fc-453c74bbfb74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9282c255-2326-4c27-a98c-bd802aa4fffa', 'volume_name': 'volume-9282c255-2326-4c27-a98c-bd802aa4fffa', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:33 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a3109388-2f47-44a3-88fa-7f42d7db41d4 tempest-GroupsTest-544951376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3bcfe7f-8a08-4f47-9058-61eb063c1697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:33 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a3109388-2f47-44a3-88fa-7f42d7db41d4 tempest-GroupsTest-544951376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3bcfe7f-8a08-4f47-9058-61eb063c1697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:33 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a3109388-2f47-44a3-88fa-7f42d7db41d4 tempest-GroupsTest-544951376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b095fb27-d372-4a94-8185-ca46b482271e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:33 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-a3109388-2f47-44a3-88fa-7f42d7db41d4 tempest-GroupsTest-544951376 None] Volume 9282c255-2326-4c27-a98c-bd802aa4fffa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9282c255-2326-4c27-a98c-bd802aa4fffa', 'volume_size': 1} Jul 28 10:38:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a3109388-2f47-44a3-88fa-7f42d7db41d4 tempest-GroupsTest-544951376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:38:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a3109388-2f47-44a3-88fa-7f42d7db41d4 tempest-GroupsTest-544951376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:38:33 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-a3109388-2f47-44a3-88fa-7f42d7db41d4 tempest-GroupsTest-544951376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=63f62a4a-75ef-4b75-ac69-ba616bcb9a74,created_at=2026-07-28T08:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1483390839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=63f62a4a-75ef-4b75-ac69-ba616bcb9a74,host='devstack@QuobyteHD#QuobyteHD',id=9282c255-2326-4c27-a98c-bd802aa4fffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='558694eabbcc4bdd93258361b57819a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:38:33Z,use_quota=True,user_id='24e74f8ee4624fa8bc451a39ca5b1204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a56db40-7c3b-46b5-83de-e620bbcfff9b),volume_type_id=3a56db40-7c3b-46b5-83de-e620bbcfff9b)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:38:33 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-a3109388-2f47-44a3-88fa-7f42d7db41d4 tempest-GroupsTest-544951376 None] Creating volume 9282c255-2326-4c27-a98c-bd802aa4fffa {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:38:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a3109388-2f47-44a3-88fa-7f42d7db41d4 tempest-GroupsTest-544951376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:38:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a3109388-2f47-44a3-88fa-7f42d7db41d4 tempest-GroupsTest-544951376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:38:33 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-a3109388-2f47-44a3-88fa-7f42d7db41d4 tempest-GroupsTest-544951376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:38:33 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-a3109388-2f47-44a3-88fa-7f42d7db41d4 tempest-GroupsTest-544951376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:38:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a3109388-2f47-44a3-88fa-7f42d7db41d4 tempest-GroupsTest-544951376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:38:33 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-a3109388-2f47-44a3-88fa-7f42d7db41d4 tempest-GroupsTest-544951376 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:38:33 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-a3109388-2f47-44a3-88fa-7f42d7db41d4 tempest-GroupsTest-544951376 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:38:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a3109388-2f47-44a3-88fa-7f42d7db41d4 tempest-GroupsTest-544951376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9282c255-2326-4c27-a98c-bd802aa4fffa 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:33 devstack sudo[92647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9282c255-2326-4c27-a98c-bd802aa4fffa 1073741824 Jul 28 10:38:33 devstack sudo[92647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:35 devstack sudo[92647]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a3109388-2f47-44a3-88fa-7f42d7db41d4 tempest-GroupsTest-544951376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9282c255-2326-4c27-a98c-bd802aa4fffa 1073741824" returned: 0 in 1.789s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a3109388-2f47-44a3-88fa-7f42d7db41d4 tempest-GroupsTest-544951376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9282c255-2326-4c27-a98c-bd802aa4fffa {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:35 devstack sudo[92681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9282c255-2326-4c27-a98c-bd802aa4fffa Jul 28 10:38:35 devstack sudo[92681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:36 devstack sudo[92681]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a3109388-2f47-44a3-88fa-7f42d7db41d4 tempest-GroupsTest-544951376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9282c255-2326-4c27-a98c-bd802aa4fffa" returned: 0 in 0.716s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:36 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-a3109388-2f47-44a3-88fa-7f42d7db41d4 tempest-GroupsTest-544951376 None] <== create_volume: return (2595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:38:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a3109388-2f47-44a3-88fa-7f42d7db41d4 tempest-GroupsTest-544951376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.603s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:38:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a3109388-2f47-44a3-88fa-7f42d7db41d4 tempest-GroupsTest-544951376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b095fb27-d372-4a94-8185-ca46b482271e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9282c255-2326-4c27-a98c-bd802aa4fffa', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a3109388-2f47-44a3-88fa-7f42d7db41d4 tempest-GroupsTest-544951376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61eb8544-be02-4a7b-8157-fec70ab36ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:36 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-a3109388-2f47-44a3-88fa-7f42d7db41d4 tempest-GroupsTest-544951376 None] Volume volume-9282c255-2326-4c27-a98c-bd802aa4fffa (9282c255-2326-4c27-a98c-bd802aa4fffa): created successfully Jul 28 10:38:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a3109388-2f47-44a3-88fa-7f42d7db41d4 tempest-GroupsTest-544951376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61eb8544-be02-4a7b-8157-fec70ab36ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a3109388-2f47-44a3-88fa-7f42d7db41d4 tempest-GroupsTest-544951376 None] Flow 'volume_create_manager' (6fcde980-7d0a-48ee-a27f-635b52db2317) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:38:36 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-a3109388-2f47-44a3-88fa-7f42d7db41d4 tempest-GroupsTest-544951376 None] Created volume successfully. Jul 28 10:38:37 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-78480fb9-d206-4732-9569-6d738f3d17ee req-bb665f67-4644-4c74-a4a9-560004db5386 tempest-ServerActionsTestOtherA-342503985 None] Terminate volume connection completed successfully. Jul 28 10:38:37 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-78480fb9-d206-4732-9569-6d738f3d17ee req-bb665f67-4644-4c74-a4a9-560004db5386 tempest-ServerActionsTestOtherA-342503985 None] Deleting attachment a06a9b32-f14a-42d6-90e8-ca74b4d1ed27. {{(pid=88413) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 10:38:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-78480fb9-d206-4732-9569-6d738f3d17ee req-0c60f4b1-7560-4a7c-8043-e8b1736b7d83 tempest-ServerActionsTestOtherA-342503985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:38:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-78480fb9-d206-4732-9569-6d738f3d17ee req-0c60f4b1-7560-4a7c-8043-e8b1736b7d83 tempest-ServerActionsTestOtherA-342503985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:38:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-78480fb9-d206-4732-9569-6d738f3d17ee req-0c60f4b1-7560-4a7c-8043-e8b1736b7d83 tempest-ServerActionsTestOtherA-342503985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.109s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:38:39 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3b2a913e-58fa-42d2-9888-4a599496688f tempest-GroupsTest-544951376 None] Acquiring lock "cinder-quobyte-9282c255-2326-4c27-a98c-bd802aa4fffa" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:38:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-78480fb9-d206-4732-9569-6d738f3d17ee req-0c60f4b1-7560-4a7c-8043-e8b1736b7d83 tempest-ServerActionsTestOtherA-342503985 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7', 'name': 'volume-1006a360-d8d6-4f63-9957-9f3349e7e256', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0954ba14-238a-4e5b-aeb9-a2f64a5a1658', 'enforce_multipath': True} {{(pid=88413) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 10:38:40 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3b2a913e-58fa-42d2-9888-4a599496688f tempest-GroupsTest-544951376 None] Lock "cinder-quobyte-9282c255-2326-4c27-a98c-bd802aa4fffa" acquired by "delete_volume" :: waited 0.125s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:38:40 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2d89d5-148a-4de3-a137-2ed300bb370f]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:38:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3b2a913e-58fa-42d2-9888-4a599496688f tempest-GroupsTest-544951376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9282c255-2326-4c27-a98c-bd802aa4fffa {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:40 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-78480fb9-d206-4732-9569-6d738f3d17ee req-0c60f4b1-7560-4a7c-8043-e8b1736b7d83 tempest-ServerActionsTestOtherA-342503985 None] attachment_update completed successfully. Jul 28 10:38:40 devstack sudo[92768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9282c255-2326-4c27-a98c-bd802aa4fffa Jul 28 10:38:40 devstack sudo[92768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:40 devstack sudo[92768]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3b2a913e-58fa-42d2-9888-4a599496688f tempest-GroupsTest-544951376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9282c255-2326-4c27-a98c-bd802aa4fffa" returned: 0 in 0.628s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3b2a913e-58fa-42d2-9888-4a599496688f tempest-GroupsTest-544951376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9282c255-2326-4c27-a98c-bd802aa4fffa {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:40 devstack sudo[92773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9282c255-2326-4c27-a98c-bd802aa4fffa Jul 28 10:38:40 devstack sudo[92773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:41 devstack sudo[92773]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3b2a913e-58fa-42d2-9888-4a599496688f tempest-GroupsTest-544951376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9282c255-2326-4c27-a98c-bd802aa4fffa" returned: 0 in 0.434s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:41 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3b2a913e-58fa-42d2-9888-4a599496688f tempest-GroupsTest-544951376 None] Lock "cinder-quobyte-9282c255-2326-4c27-a98c-bd802aa4fffa" released by "delete_volume" :: held 1.166s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:38:41 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-3b2a913e-58fa-42d2-9888-4a599496688f tempest-GroupsTest-544951376 None] Created reservations ['b8212807-870b-453b-bbc3-2efa0196ce5e'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:38:41 devstack cinder-volume[88413]: WARNING cinder.quota [None req-3b2a913e-58fa-42d2-9888-4a599496688f tempest-GroupsTest-544951376 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1171531922 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1171531922, it is now deprecated. Please use the default quota class for default quota. Jul 28 10:38:41 devstack cinder-volume[88413]: WARNING cinder.quota [None req-3b2a913e-58fa-42d2-9888-4a599496688f tempest-GroupsTest-544951376 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1171531922 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1171531922, it is now deprecated. Please use the default quota class for default quota. Jul 28 10:38:41 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-3b2a913e-58fa-42d2-9888-4a599496688f tempest-GroupsTest-544951376 None] Created reservations ['176502fd-19c4-4efa-a6f0-ac8467ab2117', 'b428e87d-2d52-400b-b6a1-eed95483f627', '0809b97c-2d0a-4fa2-8a41-680baf3e781b', '0e0b77c2-36b0-44b2-a3a4-743df3117dae'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:38:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3b2a913e-58fa-42d2-9888-4a599496688f tempest-GroupsTest-544951376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:38:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3b2a913e-58fa-42d2-9888-4a599496688f tempest-GroupsTest-544951376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:38:41 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3b2a913e-58fa-42d2-9888-4a599496688f tempest-GroupsTest-544951376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:38:41 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3b2a913e-58fa-42d2-9888-4a599496688f tempest-GroupsTest-544951376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:38:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3b2a913e-58fa-42d2-9888-4a599496688f tempest-GroupsTest-544951376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.101s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:38:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3b2a913e-58fa-42d2-9888-4a599496688f tempest-GroupsTest-544951376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:42 devstack sudo[92828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:38:42 devstack sudo[92828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:42 devstack sudo[92828]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3b2a913e-58fa-42d2-9888-4a599496688f tempest-GroupsTest-544951376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.589s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:42 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-3b2a913e-58fa-42d2-9888-4a599496688f tempest-GroupsTest-544951376 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:38:42 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-3b2a913e-58fa-42d2-9888-4a599496688f tempest-GroupsTest-544951376 None] Delete group completed successfully. Jul 28 10:38:42 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-ab020fb0-4064-4a70-8863-60486534c875 tempest-GroupsTest-544951376 None] Created reservations ['7ccdcce0-7d24-4589-98e8-341fd226e458'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:38:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ab020fb0-4064-4a70-8863-60486534c875 tempest-GroupsTest-544951376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:38:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ab020fb0-4064-4a70-8863-60486534c875 tempest-GroupsTest-544951376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:38:42 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-ab020fb0-4064-4a70-8863-60486534c875 tempest-GroupsTest-544951376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:38:42 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-ab020fb0-4064-4a70-8863-60486534c875 tempest-GroupsTest-544951376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:38:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ab020fb0-4064-4a70-8863-60486534c875 tempest-GroupsTest-544951376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:38:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ab020fb0-4064-4a70-8863-60486534c875 tempest-GroupsTest-544951376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:42 devstack sudo[92859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:38:42 devstack sudo[92859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:43 devstack sudo[92859]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ab020fb0-4064-4a70-8863-60486534c875 tempest-GroupsTest-544951376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.430s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:43 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-ab020fb0-4064-4a70-8863-60486534c875 tempest-GroupsTest-544951376 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:38:43 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-ab020fb0-4064-4a70-8863-60486534c875 tempest-GroupsTest-544951376 None] Delete group completed successfully. Jul 28 10:38:44 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-4ec6565a-1347-430a-9a7d-69ea82cfc8d9 tempest-GroupsTest-544951376 None] Group tempest-GroupsTest-Group-1914285942: creating Jul 28 10:38:44 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-4ec6565a-1347-430a-9a7d-69ea82cfc8d9 tempest-GroupsTest-544951376 None] Group tempest-GroupsTest-Group-1914285942: created successfully Jul 28 10:38:44 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-4ec6565a-1347-430a-9a7d-69ea82cfc8d9 tempest-GroupsTest-544951376 None] Create group completed successfully. Jul 28 10:38:46 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-fda05823-562e-4be5-b119-76709ea93cd0 tempest-GroupsTest-544951376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:38:46 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fda05823-562e-4be5-b119-76709ea93cd0 tempest-GroupsTest-544951376 None] Flow 'volume_create_manager' (5238e81f-67c8-491f-a051-fad000539247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:38:46 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fda05823-562e-4be5-b119-76709ea93cd0 tempest-GroupsTest-544951376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc6d4dc-a799-4c86-b726-7271c14d41a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:46 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fda05823-562e-4be5-b119-76709ea93cd0 tempest-GroupsTest-544951376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc6d4dc-a799-4c86-b726-7271c14d41a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-739788144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=331f782f-06da-42ae-bae2-544e3e54ef4f,host='devstack@QuobyteHD#QuobyteHD',id=ccc42ce8-9328-4aef-852e-4ff4ee1cd9b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='558694eabbcc4bdd93258361b57819a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:38:47Z,use_quota=True,user_id='24e74f8ee4624fa8bc451a39ca5b1204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13fd97d7-0c61-41eb-966e-20cd75db9b4f),volume_type_id=13fd97d7-0c61-41eb-966e-20cd75db9b4f)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:46 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fda05823-562e-4be5-b119-76709ea93cd0 tempest-GroupsTest-544951376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fbaca7a-58d6-49b7-9bbe-f307d89b95c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:46 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fda05823-562e-4be5-b119-76709ea93cd0 tempest-GroupsTest-544951376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fbaca7a-58d6-49b7-9bbe-f307d89b95c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:46 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fda05823-562e-4be5-b119-76709ea93cd0 tempest-GroupsTest-544951376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc03dc1c-6cda-4091-9429-a53c7256813f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:46 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fda05823-562e-4be5-b119-76709ea93cd0 tempest-GroupsTest-544951376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc03dc1c-6cda-4091-9429-a53c7256813f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccc42ce8-9328-4aef-852e-4ff4ee1cd9b0', 'volume_name': 'volume-ccc42ce8-9328-4aef-852e-4ff4ee1cd9b0', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:46 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fda05823-562e-4be5-b119-76709ea93cd0 tempest-GroupsTest-544951376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79c3fc06-4772-478f-b7d7-785b8854f6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:46 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fda05823-562e-4be5-b119-76709ea93cd0 tempest-GroupsTest-544951376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79c3fc06-4772-478f-b7d7-785b8854f6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:46 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fda05823-562e-4be5-b119-76709ea93cd0 tempest-GroupsTest-544951376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aaed275-06d9-4487-8870-4daa2075fa3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:46 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-fda05823-562e-4be5-b119-76709ea93cd0 tempest-GroupsTest-544951376 None] Volume ccc42ce8-9328-4aef-852e-4ff4ee1cd9b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccc42ce8-9328-4aef-852e-4ff4ee1cd9b0', 'volume_size': 1} Jul 28 10:38:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fda05823-562e-4be5-b119-76709ea93cd0 tempest-GroupsTest-544951376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:38:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fda05823-562e-4be5-b119-76709ea93cd0 tempest-GroupsTest-544951376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:38:46 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-fda05823-562e-4be5-b119-76709ea93cd0 tempest-GroupsTest-544951376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=331f782f-06da-42ae-bae2-544e3e54ef4f,created_at=2026-07-28T08:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-739788144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=331f782f-06da-42ae-bae2-544e3e54ef4f,host='devstack@QuobyteHD#QuobyteHD',id=ccc42ce8-9328-4aef-852e-4ff4ee1cd9b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='558694eabbcc4bdd93258361b57819a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:38:47Z,use_quota=True,user_id='24e74f8ee4624fa8bc451a39ca5b1204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13fd97d7-0c61-41eb-966e-20cd75db9b4f),volume_type_id=13fd97d7-0c61-41eb-966e-20cd75db9b4f)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:38:46 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-fda05823-562e-4be5-b119-76709ea93cd0 tempest-GroupsTest-544951376 None] Creating volume ccc42ce8-9328-4aef-852e-4ff4ee1cd9b0 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:38:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fda05823-562e-4be5-b119-76709ea93cd0 tempest-GroupsTest-544951376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:38:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fda05823-562e-4be5-b119-76709ea93cd0 tempest-GroupsTest-544951376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:38:46 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-fda05823-562e-4be5-b119-76709ea93cd0 tempest-GroupsTest-544951376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:38:46 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-fda05823-562e-4be5-b119-76709ea93cd0 tempest-GroupsTest-544951376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:38:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fda05823-562e-4be5-b119-76709ea93cd0 tempest-GroupsTest-544951376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:38:46 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-fda05823-562e-4be5-b119-76709ea93cd0 tempest-GroupsTest-544951376 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:38:46 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-fda05823-562e-4be5-b119-76709ea93cd0 tempest-GroupsTest-544951376 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:38:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fda05823-562e-4be5-b119-76709ea93cd0 tempest-GroupsTest-544951376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ccc42ce8-9328-4aef-852e-4ff4ee1cd9b0 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:46 devstack sudo[92923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ccc42ce8-9328-4aef-852e-4ff4ee1cd9b0 1073741824 Jul 28 10:38:46 devstack sudo[92923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:47 devstack sudo[92923]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fda05823-562e-4be5-b119-76709ea93cd0 tempest-GroupsTest-544951376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ccc42ce8-9328-4aef-852e-4ff4ee1cd9b0 1073741824" returned: 0 in 0.580s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fda05823-562e-4be5-b119-76709ea93cd0 tempest-GroupsTest-544951376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ccc42ce8-9328-4aef-852e-4ff4ee1cd9b0 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:47 devstack sudo[92929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ccc42ce8-9328-4aef-852e-4ff4ee1cd9b0 Jul 28 10:38:47 devstack sudo[92929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:47 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-a86085f4-c4ce-4c84-9c78-5713fb4fc73c tempest-ServersNegativeTestJSON-1048288533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:38:47 devstack sudo[92929]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:47 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a86085f4-c4ce-4c84-9c78-5713fb4fc73c tempest-ServersNegativeTestJSON-1048288533 None] Flow 'volume_create_manager' (ba55d2a9-c9ab-4675-a74a-8a256f00ef62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:38:47 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a86085f4-c4ce-4c84-9c78-5713fb4fc73c tempest-ServersNegativeTestJSON-1048288533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbdd0a4d-c979-4e14-8fcc-7f6dcb7f86ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fda05823-562e-4be5-b119-76709ea93cd0 tempest-GroupsTest-544951376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ccc42ce8-9328-4aef-852e-4ff4ee1cd9b0" returned: 0 in 0.333s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:47 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-fda05823-562e-4be5-b119-76709ea93cd0 tempest-GroupsTest-544951376 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:38:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fda05823-562e-4be5-b119-76709ea93cd0 tempest-GroupsTest-544951376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:38:47 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a86085f4-c4ce-4c84-9c78-5713fb4fc73c tempest-ServersNegativeTestJSON-1048288533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbdd0a4d-c979-4e14-8fcc-7f6dcb7f86ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1849296972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19fc0c01-193b-4638-ab5c-7021ff22e9f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60dfa79076954913bf616da13d2f8cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:38:48Z,use_quota=True,user_id='f92aa566c67c441b9bffcd04807abc90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:47 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a86085f4-c4ce-4c84-9c78-5713fb4fc73c tempest-ServersNegativeTestJSON-1048288533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb856f68-9899-4093-910a-07648688d5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:47 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a86085f4-c4ce-4c84-9c78-5713fb4fc73c tempest-ServersNegativeTestJSON-1048288533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb856f68-9899-4093-910a-07648688d5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:47 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a86085f4-c4ce-4c84-9c78-5713fb4fc73c tempest-ServersNegativeTestJSON-1048288533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e098073-5100-4548-9113-72734ae8c0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:47 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a86085f4-c4ce-4c84-9c78-5713fb4fc73c tempest-ServersNegativeTestJSON-1048288533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e098073-5100-4548-9113-72734ae8c0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19fc0c01-193b-4638-ab5c-7021ff22e9f8', 'volume_name': 'volume-19fc0c01-193b-4638-ab5c-7021ff22e9f8', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:47 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a86085f4-c4ce-4c84-9c78-5713fb4fc73c tempest-ServersNegativeTestJSON-1048288533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2a4f7ca-b816-48f4-abea-c6aa26666bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:47 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a86085f4-c4ce-4c84-9c78-5713fb4fc73c tempest-ServersNegativeTestJSON-1048288533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2a4f7ca-b816-48f4-abea-c6aa26666bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:47 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a86085f4-c4ce-4c84-9c78-5713fb4fc73c tempest-ServersNegativeTestJSON-1048288533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56386b0b-3f4a-49e9-a804-533740e9ae09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:47 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-a86085f4-c4ce-4c84-9c78-5713fb4fc73c tempest-ServersNegativeTestJSON-1048288533 None] Volume 19fc0c01-193b-4638-ab5c-7021ff22e9f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19fc0c01-193b-4638-ab5c-7021ff22e9f8', 'volume_size': 1} Jul 28 10:38:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a86085f4-c4ce-4c84-9c78-5713fb4fc73c tempest-ServersNegativeTestJSON-1048288533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:38:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a86085f4-c4ce-4c84-9c78-5713fb4fc73c tempest-ServersNegativeTestJSON-1048288533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:38:47 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-a86085f4-c4ce-4c84-9c78-5713fb4fc73c tempest-ServersNegativeTestJSON-1048288533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1849296972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19fc0c01-193b-4638-ab5c-7021ff22e9f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60dfa79076954913bf616da13d2f8cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:38:48Z,use_quota=True,user_id='f92aa566c67c441b9bffcd04807abc90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:38:47 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-a86085f4-c4ce-4c84-9c78-5713fb4fc73c tempest-ServersNegativeTestJSON-1048288533 None] Creating volume 19fc0c01-193b-4638-ab5c-7021ff22e9f8 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:38:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a86085f4-c4ce-4c84-9c78-5713fb4fc73c tempest-ServersNegativeTestJSON-1048288533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:38:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a86085f4-c4ce-4c84-9c78-5713fb4fc73c tempest-ServersNegativeTestJSON-1048288533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:38:47 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-a86085f4-c4ce-4c84-9c78-5713fb4fc73c tempest-ServersNegativeTestJSON-1048288533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:38:47 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-a86085f4-c4ce-4c84-9c78-5713fb4fc73c tempest-ServersNegativeTestJSON-1048288533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:38:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a86085f4-c4ce-4c84-9c78-5713fb4fc73c tempest-ServersNegativeTestJSON-1048288533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:38:47 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-a86085f4-c4ce-4c84-9c78-5713fb4fc73c tempest-ServersNegativeTestJSON-1048288533 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:38:47 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-a86085f4-c4ce-4c84-9c78-5713fb4fc73c tempest-ServersNegativeTestJSON-1048288533 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:38:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a86085f4-c4ce-4c84-9c78-5713fb4fc73c tempest-ServersNegativeTestJSON-1048288533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-19fc0c01-193b-4638-ab5c-7021ff22e9f8 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:47 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fda05823-562e-4be5-b119-76709ea93cd0 tempest-GroupsTest-544951376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aaed275-06d9-4487-8870-4daa2075fa3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccc42ce8-9328-4aef-852e-4ff4ee1cd9b0', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:47 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fda05823-562e-4be5-b119-76709ea93cd0 tempest-GroupsTest-544951376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df9bd73-0591-4c60-88cc-acdacfeea0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:47 devstack sudo[92932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-19fc0c01-193b-4638-ab5c-7021ff22e9f8 1073741824 Jul 28 10:38:47 devstack sudo[92932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:47 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-fda05823-562e-4be5-b119-76709ea93cd0 tempest-GroupsTest-544951376 None] Volume volume-ccc42ce8-9328-4aef-852e-4ff4ee1cd9b0 (ccc42ce8-9328-4aef-852e-4ff4ee1cd9b0): created successfully Jul 28 10:38:47 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fda05823-562e-4be5-b119-76709ea93cd0 tempest-GroupsTest-544951376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df9bd73-0591-4c60-88cc-acdacfeea0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:47 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fda05823-562e-4be5-b119-76709ea93cd0 tempest-GroupsTest-544951376 None] Flow 'volume_create_manager' (5238e81f-67c8-491f-a051-fad000539247) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:38:47 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-fda05823-562e-4be5-b119-76709ea93cd0 tempest-GroupsTest-544951376 None] Created volume successfully. Jul 28 10:38:48 devstack sudo[92932]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a86085f4-c4ce-4c84-9c78-5713fb4fc73c tempest-ServersNegativeTestJSON-1048288533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-19fc0c01-193b-4638-ab5c-7021ff22e9f8 1073741824" returned: 0 in 0.455s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a86085f4-c4ce-4c84-9c78-5713fb4fc73c tempest-ServersNegativeTestJSON-1048288533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-19fc0c01-193b-4638-ab5c-7021ff22e9f8 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:48 devstack sudo[92938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-19fc0c01-193b-4638-ab5c-7021ff22e9f8 Jul 28 10:38:48 devstack sudo[92938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:48 devstack sudo[92938]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a86085f4-c4ce-4c84-9c78-5713fb4fc73c tempest-ServersNegativeTestJSON-1048288533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-19fc0c01-193b-4638-ab5c-7021ff22e9f8" returned: 0 in 0.264s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:48 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-a86085f4-c4ce-4c84-9c78-5713fb4fc73c tempest-ServersNegativeTestJSON-1048288533 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:38:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a86085f4-c4ce-4c84-9c78-5713fb4fc73c tempest-ServersNegativeTestJSON-1048288533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:38:48 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a86085f4-c4ce-4c84-9c78-5713fb4fc73c tempest-ServersNegativeTestJSON-1048288533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56386b0b-3f4a-49e9-a804-533740e9ae09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19fc0c01-193b-4638-ab5c-7021ff22e9f8', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:48 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a86085f4-c4ce-4c84-9c78-5713fb4fc73c tempest-ServersNegativeTestJSON-1048288533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91c9286-33a9-4080-a052-6da181f62eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:48 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-a86085f4-c4ce-4c84-9c78-5713fb4fc73c tempest-ServersNegativeTestJSON-1048288533 None] Volume volume-19fc0c01-193b-4638-ab5c-7021ff22e9f8 (19fc0c01-193b-4638-ab5c-7021ff22e9f8): created successfully Jul 28 10:38:48 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a86085f4-c4ce-4c84-9c78-5713fb4fc73c tempest-ServersNegativeTestJSON-1048288533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91c9286-33a9-4080-a052-6da181f62eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:48 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a86085f4-c4ce-4c84-9c78-5713fb4fc73c tempest-ServersNegativeTestJSON-1048288533 None] Flow 'volume_create_manager' (ba55d2a9-c9ab-4675-a74a-8a256f00ef62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:38:48 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-a86085f4-c4ce-4c84-9c78-5713fb4fc73c tempest-ServersNegativeTestJSON-1048288533 None] Created volume successfully. Jul 28 10:38:49 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-742a2fcb-e002-454b-b9f4-b400318af9cc tempest-GroupsTest-544951376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:38:49 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-742a2fcb-e002-454b-b9f4-b400318af9cc tempest-GroupsTest-544951376 None] Flow 'volume_create_manager' (a72ebf0c-3d64-4f9a-9a81-a05ddf2d7e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:38:49 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-742a2fcb-e002-454b-b9f4-b400318af9cc tempest-GroupsTest-544951376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aa9b6a6-99d7-4039-97c3-017114ee3797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:49 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-742a2fcb-e002-454b-b9f4-b400318af9cc tempest-GroupsTest-544951376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aa9b6a6-99d7-4039-97c3-017114ee3797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1540834984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=331f782f-06da-42ae-bae2-544e3e54ef4f,host='devstack@QuobyteHD#QuobyteHD',id=f2cab71f-b72a-4888-80a6-c40ed9a22560,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='558694eabbcc4bdd93258361b57819a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:38:50Z,use_quota=True,user_id='24e74f8ee4624fa8bc451a39ca5b1204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13fd97d7-0c61-41eb-966e-20cd75db9b4f),volume_type_id=13fd97d7-0c61-41eb-966e-20cd75db9b4f)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:49 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-742a2fcb-e002-454b-b9f4-b400318af9cc tempest-GroupsTest-544951376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94f68c15-b81e-4d8c-8573-ab112b3b2023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:49 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-742a2fcb-e002-454b-b9f4-b400318af9cc tempest-GroupsTest-544951376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94f68c15-b81e-4d8c-8573-ab112b3b2023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:49 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-742a2fcb-e002-454b-b9f4-b400318af9cc tempest-GroupsTest-544951376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e59a8961-d4bc-4a1f-91d6-160e9885f188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:49 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-742a2fcb-e002-454b-b9f4-b400318af9cc tempest-GroupsTest-544951376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e59a8961-d4bc-4a1f-91d6-160e9885f188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2cab71f-b72a-4888-80a6-c40ed9a22560', 'volume_name': 'volume-f2cab71f-b72a-4888-80a6-c40ed9a22560', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:49 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-742a2fcb-e002-454b-b9f4-b400318af9cc tempest-GroupsTest-544951376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81a931ca-4e48-4cf3-a37b-087aac3d52bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:49 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-742a2fcb-e002-454b-b9f4-b400318af9cc tempest-GroupsTest-544951376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81a931ca-4e48-4cf3-a37b-087aac3d52bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:49 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-742a2fcb-e002-454b-b9f4-b400318af9cc tempest-GroupsTest-544951376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea62c89f-2403-41fc-880e-c252683f81f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:49 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-742a2fcb-e002-454b-b9f4-b400318af9cc tempest-GroupsTest-544951376 None] Volume f2cab71f-b72a-4888-80a6-c40ed9a22560: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2cab71f-b72a-4888-80a6-c40ed9a22560', 'volume_size': 1} Jul 28 10:38:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-742a2fcb-e002-454b-b9f4-b400318af9cc tempest-GroupsTest-544951376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:38:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-742a2fcb-e002-454b-b9f4-b400318af9cc tempest-GroupsTest-544951376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:38:49 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-742a2fcb-e002-454b-b9f4-b400318af9cc tempest-GroupsTest-544951376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=331f782f-06da-42ae-bae2-544e3e54ef4f,created_at=2026-07-28T08:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1540834984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=331f782f-06da-42ae-bae2-544e3e54ef4f,host='devstack@QuobyteHD#QuobyteHD',id=f2cab71f-b72a-4888-80a6-c40ed9a22560,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='558694eabbcc4bdd93258361b57819a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:38:50Z,use_quota=True,user_id='24e74f8ee4624fa8bc451a39ca5b1204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13fd97d7-0c61-41eb-966e-20cd75db9b4f),volume_type_id=13fd97d7-0c61-41eb-966e-20cd75db9b4f)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:38:49 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-742a2fcb-e002-454b-b9f4-b400318af9cc tempest-GroupsTest-544951376 None] Creating volume f2cab71f-b72a-4888-80a6-c40ed9a22560 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:38:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-742a2fcb-e002-454b-b9f4-b400318af9cc tempest-GroupsTest-544951376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:38:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-742a2fcb-e002-454b-b9f4-b400318af9cc tempest-GroupsTest-544951376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:38:49 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-742a2fcb-e002-454b-b9f4-b400318af9cc tempest-GroupsTest-544951376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:38:49 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-742a2fcb-e002-454b-b9f4-b400318af9cc tempest-GroupsTest-544951376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:38:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-742a2fcb-e002-454b-b9f4-b400318af9cc tempest-GroupsTest-544951376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:38:49 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-742a2fcb-e002-454b-b9f4-b400318af9cc tempest-GroupsTest-544951376 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:38:49 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-742a2fcb-e002-454b-b9f4-b400318af9cc tempest-GroupsTest-544951376 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:38:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-742a2fcb-e002-454b-b9f4-b400318af9cc tempest-GroupsTest-544951376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f2cab71f-b72a-4888-80a6-c40ed9a22560 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:49 devstack sudo[92956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f2cab71f-b72a-4888-80a6-c40ed9a22560 1073741824 Jul 28 10:38:49 devstack sudo[92956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:50 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-92d42242-74fa-4e8d-b38d-c1d0c835474b tempest-ServersNegativeTestJSON-1048288533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:38:50 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-92d42242-74fa-4e8d-b38d-c1d0c835474b tempest-ServersNegativeTestJSON-1048288533 None] Flow 'volume_create_manager' (db3f6d50-3119-46c1-95bf-590955244405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:38:50 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-92d42242-74fa-4e8d-b38d-c1d0c835474b tempest-ServersNegativeTestJSON-1048288533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38a96ddc-ffdc-452f-b915-53b0acf34fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:50 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-92d42242-74fa-4e8d-b38d-c1d0c835474b tempest-ServersNegativeTestJSON-1048288533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38a96ddc-ffdc-452f-b915-53b0acf34fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1316645191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77a1aec5-3dd7-4a0e-ba17-4f2f1bbadee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60dfa79076954913bf616da13d2f8cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:38:50Z,use_quota=True,user_id='f92aa566c67c441b9bffcd04807abc90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:50 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-92d42242-74fa-4e8d-b38d-c1d0c835474b tempest-ServersNegativeTestJSON-1048288533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9ecfdad-dd0b-4777-bddd-9b36d2cbfa15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:50 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-92d42242-74fa-4e8d-b38d-c1d0c835474b tempest-ServersNegativeTestJSON-1048288533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9ecfdad-dd0b-4777-bddd-9b36d2cbfa15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:50 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-92d42242-74fa-4e8d-b38d-c1d0c835474b tempest-ServersNegativeTestJSON-1048288533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (635f1b08-217a-4e2b-bb05-2e3f5df87a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:50 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-92d42242-74fa-4e8d-b38d-c1d0c835474b tempest-ServersNegativeTestJSON-1048288533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (635f1b08-217a-4e2b-bb05-2e3f5df87a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77a1aec5-3dd7-4a0e-ba17-4f2f1bbadee5', 'volume_name': 'volume-77a1aec5-3dd7-4a0e-ba17-4f2f1bbadee5', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:50 devstack sudo[92956]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:50 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-92d42242-74fa-4e8d-b38d-c1d0c835474b tempest-ServersNegativeTestJSON-1048288533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3526b395-1f2c-41c6-966f-f83597137068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:50 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-92d42242-74fa-4e8d-b38d-c1d0c835474b tempest-ServersNegativeTestJSON-1048288533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3526b395-1f2c-41c6-966f-f83597137068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:50 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-92d42242-74fa-4e8d-b38d-c1d0c835474b tempest-ServersNegativeTestJSON-1048288533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a7554ef-0c4d-4775-814b-30fe121a7a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:50 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-92d42242-74fa-4e8d-b38d-c1d0c835474b tempest-ServersNegativeTestJSON-1048288533 None] Volume 77a1aec5-3dd7-4a0e-ba17-4f2f1bbadee5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77a1aec5-3dd7-4a0e-ba17-4f2f1bbadee5', 'volume_size': 1} Jul 28 10:38:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-92d42242-74fa-4e8d-b38d-c1d0c835474b tempest-ServersNegativeTestJSON-1048288533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:38:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-742a2fcb-e002-454b-b9f4-b400318af9cc tempest-GroupsTest-544951376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f2cab71f-b72a-4888-80a6-c40ed9a22560 1073741824" returned: 0 in 0.619s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-742a2fcb-e002-454b-b9f4-b400318af9cc tempest-GroupsTest-544951376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f2cab71f-b72a-4888-80a6-c40ed9a22560 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:50 devstack sudo[92962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f2cab71f-b72a-4888-80a6-c40ed9a22560 Jul 28 10:38:50 devstack sudo[92962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:50 devstack sudo[92962]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-742a2fcb-e002-454b-b9f4-b400318af9cc tempest-GroupsTest-544951376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f2cab71f-b72a-4888-80a6-c40ed9a22560" returned: 0 in 0.291s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:50 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-742a2fcb-e002-454b-b9f4-b400318af9cc tempest-GroupsTest-544951376 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:38:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-742a2fcb-e002-454b-b9f4-b400318af9cc tempest-GroupsTest-544951376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:38:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-92d42242-74fa-4e8d-b38d-c1d0c835474b tempest-ServersNegativeTestJSON-1048288533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.336s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:38:50 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-92d42242-74fa-4e8d-b38d-c1d0c835474b tempest-ServersNegativeTestJSON-1048288533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1316645191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77a1aec5-3dd7-4a0e-ba17-4f2f1bbadee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60dfa79076954913bf616da13d2f8cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:38:50Z,use_quota=True,user_id='f92aa566c67c441b9bffcd04807abc90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:38:50 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-92d42242-74fa-4e8d-b38d-c1d0c835474b tempest-ServersNegativeTestJSON-1048288533 None] Creating volume 77a1aec5-3dd7-4a0e-ba17-4f2f1bbadee5 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:38:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-92d42242-74fa-4e8d-b38d-c1d0c835474b tempest-ServersNegativeTestJSON-1048288533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:38:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-92d42242-74fa-4e8d-b38d-c1d0c835474b tempest-ServersNegativeTestJSON-1048288533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:38:50 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-92d42242-74fa-4e8d-b38d-c1d0c835474b tempest-ServersNegativeTestJSON-1048288533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:38:50 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-92d42242-74fa-4e8d-b38d-c1d0c835474b tempest-ServersNegativeTestJSON-1048288533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:38:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-92d42242-74fa-4e8d-b38d-c1d0c835474b tempest-ServersNegativeTestJSON-1048288533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:38:50 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-92d42242-74fa-4e8d-b38d-c1d0c835474b tempest-ServersNegativeTestJSON-1048288533 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:38:50 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-92d42242-74fa-4e8d-b38d-c1d0c835474b tempest-ServersNegativeTestJSON-1048288533 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:38:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-92d42242-74fa-4e8d-b38d-c1d0c835474b tempest-ServersNegativeTestJSON-1048288533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-77a1aec5-3dd7-4a0e-ba17-4f2f1bbadee5 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:50 devstack sudo[92965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-77a1aec5-3dd7-4a0e-ba17-4f2f1bbadee5 1073741824 Jul 28 10:38:50 devstack sudo[92965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:50 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-742a2fcb-e002-454b-b9f4-b400318af9cc tempest-GroupsTest-544951376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea62c89f-2403-41fc-880e-c252683f81f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2cab71f-b72a-4888-80a6-c40ed9a22560', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:50 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-742a2fcb-e002-454b-b9f4-b400318af9cc tempest-GroupsTest-544951376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52828272-7aa7-423a-9f6e-c2be41755b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:50 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-742a2fcb-e002-454b-b9f4-b400318af9cc tempest-GroupsTest-544951376 None] Volume volume-f2cab71f-b72a-4888-80a6-c40ed9a22560 (f2cab71f-b72a-4888-80a6-c40ed9a22560): created successfully Jul 28 10:38:50 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-742a2fcb-e002-454b-b9f4-b400318af9cc tempest-GroupsTest-544951376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52828272-7aa7-423a-9f6e-c2be41755b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:50 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-742a2fcb-e002-454b-b9f4-b400318af9cc tempest-GroupsTest-544951376 None] Flow 'volume_create_manager' (a72ebf0c-3d64-4f9a-9a81-a05ddf2d7e24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:38:50 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-742a2fcb-e002-454b-b9f4-b400318af9cc tempest-GroupsTest-544951376 None] Created volume successfully. Jul 28 10:38:51 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-9f813b84-3eed-4f57-a666-247207ca7be5 tempest-GroupsTest-544951376 None] Update group completed successfully. Jul 28 10:38:51 devstack sudo[92965]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-92d42242-74fa-4e8d-b38d-c1d0c835474b tempest-ServersNegativeTestJSON-1048288533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-77a1aec5-3dd7-4a0e-ba17-4f2f1bbadee5 1073741824" returned: 0 in 0.598s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-92d42242-74fa-4e8d-b38d-c1d0c835474b tempest-ServersNegativeTestJSON-1048288533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-77a1aec5-3dd7-4a0e-ba17-4f2f1bbadee5 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:51 devstack sudo[92971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-77a1aec5-3dd7-4a0e-ba17-4f2f1bbadee5 Jul 28 10:38:51 devstack sudo[92971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:51 devstack sudo[92971]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-92d42242-74fa-4e8d-b38d-c1d0c835474b tempest-ServersNegativeTestJSON-1048288533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-77a1aec5-3dd7-4a0e-ba17-4f2f1bbadee5" returned: 0 in 0.255s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:51 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-92d42242-74fa-4e8d-b38d-c1d0c835474b tempest-ServersNegativeTestJSON-1048288533 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:38:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-92d42242-74fa-4e8d-b38d-c1d0c835474b tempest-ServersNegativeTestJSON-1048288533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:38:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-92d42242-74fa-4e8d-b38d-c1d0c835474b tempest-ServersNegativeTestJSON-1048288533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a7554ef-0c4d-4775-814b-30fe121a7a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77a1aec5-3dd7-4a0e-ba17-4f2f1bbadee5', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-92d42242-74fa-4e8d-b38d-c1d0c835474b tempest-ServersNegativeTestJSON-1048288533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b8bc8e2-3e71-4327-a851-b61b2cba63fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:38:51 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-92d42242-74fa-4e8d-b38d-c1d0c835474b tempest-ServersNegativeTestJSON-1048288533 None] Volume volume-77a1aec5-3dd7-4a0e-ba17-4f2f1bbadee5 (77a1aec5-3dd7-4a0e-ba17-4f2f1bbadee5): created successfully Jul 28 10:38:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-92d42242-74fa-4e8d-b38d-c1d0c835474b tempest-ServersNegativeTestJSON-1048288533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b8bc8e2-3e71-4327-a851-b61b2cba63fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:38:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-92d42242-74fa-4e8d-b38d-c1d0c835474b tempest-ServersNegativeTestJSON-1048288533 None] Flow 'volume_create_manager' (db3f6d50-3119-46c1-95bf-590955244405) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:38:51 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-92d42242-74fa-4e8d-b38d-c1d0c835474b tempest-ServersNegativeTestJSON-1048288533 None] Created volume successfully. Jul 28 10:38:52 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-5ccf471f-70f8-4e31-9a83-10b6a5273e77 tempest-GroupsTest-544951376 None] Update group completed successfully. Jul 28 10:38:52 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-a7831967-79f4-4265-94e2-d53104a236dd tempest-ServersNegativeTestJSON-1048288533 None] Acquiring lock "cinder-77a1aec5-3dd7-4a0e-ba17-4f2f1bbadee5-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:38:52 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-a7831967-79f4-4265-94e2-d53104a236dd tempest-ServersNegativeTestJSON-1048288533 None] Lock "cinder-77a1aec5-3dd7-4a0e-ba17-4f2f1bbadee5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:38:52 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-a7831967-79f4-4265-94e2-d53104a236dd tempest-ServersNegativeTestJSON-1048288533 None] Acquiring lock "cinder-quobyte-77a1aec5-3dd7-4a0e-ba17-4f2f1bbadee5" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:38:52 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-a7831967-79f4-4265-94e2-d53104a236dd tempest-ServersNegativeTestJSON-1048288533 None] Lock "cinder-quobyte-77a1aec5-3dd7-4a0e-ba17-4f2f1bbadee5" acquired by "delete_volume" :: waited 0.020s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:38:52 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de33a32-98a9-481e-8fe4-e1c06a0e6125]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:38:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a7831967-79f4-4265-94e2-d53104a236dd tempest-ServersNegativeTestJSON-1048288533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-77a1aec5-3dd7-4a0e-ba17-4f2f1bbadee5 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:52 devstack sudo[92974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-77a1aec5-3dd7-4a0e-ba17-4f2f1bbadee5 Jul 28 10:38:52 devstack sudo[92974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:53 devstack sudo[92974]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a7831967-79f4-4265-94e2-d53104a236dd tempest-ServersNegativeTestJSON-1048288533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-77a1aec5-3dd7-4a0e-ba17-4f2f1bbadee5" returned: 0 in 0.384s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a7831967-79f4-4265-94e2-d53104a236dd tempest-ServersNegativeTestJSON-1048288533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-77a1aec5-3dd7-4a0e-ba17-4f2f1bbadee5 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:53 devstack sudo[92979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-77a1aec5-3dd7-4a0e-ba17-4f2f1bbadee5 Jul 28 10:38:53 devstack sudo[92979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:53 devstack sudo[92979]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a7831967-79f4-4265-94e2-d53104a236dd tempest-ServersNegativeTestJSON-1048288533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-77a1aec5-3dd7-4a0e-ba17-4f2f1bbadee5" returned: 0 in 0.258s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:53 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-a7831967-79f4-4265-94e2-d53104a236dd tempest-ServersNegativeTestJSON-1048288533 None] Lock "cinder-quobyte-77a1aec5-3dd7-4a0e-ba17-4f2f1bbadee5" released by "delete_volume" :: held 0.687s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:38:53 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-a7831967-79f4-4265-94e2-d53104a236dd tempest-ServersNegativeTestJSON-1048288533 None] Created reservations ['6c1ae474-35aa-4eb7-83fa-01cfd0ee5544', '52b3aad1-e0a7-4680-92d8-060961ef08c8', '86f4db25-4dd0-40ea-baa9-4e79146f1cc4', '5be06828-0600-48d9-8e65-1858860f22d5'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:38:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a7831967-79f4-4265-94e2-d53104a236dd tempest-ServersNegativeTestJSON-1048288533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:38:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a7831967-79f4-4265-94e2-d53104a236dd tempest-ServersNegativeTestJSON-1048288533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:38:53 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-a7831967-79f4-4265-94e2-d53104a236dd tempest-ServersNegativeTestJSON-1048288533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:38:53 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-a7831967-79f4-4265-94e2-d53104a236dd tempest-ServersNegativeTestJSON-1048288533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:38:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a7831967-79f4-4265-94e2-d53104a236dd tempest-ServersNegativeTestJSON-1048288533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:38:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a7831967-79f4-4265-94e2-d53104a236dd tempest-ServersNegativeTestJSON-1048288533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:53 devstack sudo[92982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:38:53 devstack sudo[92982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:53 devstack sudo[92982]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a7831967-79f4-4265-94e2-d53104a236dd tempest-ServersNegativeTestJSON-1048288533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.262s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:53 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-a7831967-79f4-4265-94e2-d53104a236dd tempest-ServersNegativeTestJSON-1048288533 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:38:53 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-a7831967-79f4-4265-94e2-d53104a236dd tempest-ServersNegativeTestJSON-1048288533 None] Deleted volume successfully. Jul 28 10:38:53 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-863eaf52-5c6a-40ac-90ed-06fa3b0dc5c3 tempest-ServersNegativeTestJSON-1048288533 None] Acquiring lock "cinder-19fc0c01-193b-4638-ab5c-7021ff22e9f8-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:38:53 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-a7831967-79f4-4265-94e2-d53104a236dd tempest-ServersNegativeTestJSON-1048288533 None] Lock "cinder-77a1aec5-3dd7-4a0e-ba17-4f2f1bbadee5-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:38:53 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-863eaf52-5c6a-40ac-90ed-06fa3b0dc5c3 tempest-ServersNegativeTestJSON-1048288533 None] Lock "cinder-19fc0c01-193b-4638-ab5c-7021ff22e9f8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:38:53 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-863eaf52-5c6a-40ac-90ed-06fa3b0dc5c3 tempest-ServersNegativeTestJSON-1048288533 None] Acquiring lock "cinder-quobyte-19fc0c01-193b-4638-ab5c-7021ff22e9f8" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:38:53 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-863eaf52-5c6a-40ac-90ed-06fa3b0dc5c3 tempest-ServersNegativeTestJSON-1048288533 None] Lock "cinder-quobyte-19fc0c01-193b-4638-ab5c-7021ff22e9f8" acquired by "delete_volume" :: waited 0.028s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:38:53 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a8026c-667f-4fa3-b064-fec5fe749e19]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:38:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-863eaf52-5c6a-40ac-90ed-06fa3b0dc5c3 tempest-ServersNegativeTestJSON-1048288533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-19fc0c01-193b-4638-ab5c-7021ff22e9f8 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:54 devstack sudo[92985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-19fc0c01-193b-4638-ab5c-7021ff22e9f8 Jul 28 10:38:54 devstack sudo[92985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:54 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b7c94ed7-2e1f-420e-b0ce-236feb4e2497 tempest-GroupsTest-544951376 None] Acquiring lock "cinder-quobyte-ccc42ce8-9328-4aef-852e-4ff4ee1cd9b0" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:38:54 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b7c94ed7-2e1f-420e-b0ce-236feb4e2497 tempest-GroupsTest-544951376 None] Lock "cinder-quobyte-ccc42ce8-9328-4aef-852e-4ff4ee1cd9b0" acquired by "delete_volume" :: waited 0.032s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:38:54 devstack sudo[92985]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-863eaf52-5c6a-40ac-90ed-06fa3b0dc5c3 tempest-ServersNegativeTestJSON-1048288533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-19fc0c01-193b-4638-ab5c-7021ff22e9f8" returned: 0 in 0.450s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-863eaf52-5c6a-40ac-90ed-06fa3b0dc5c3 tempest-ServersNegativeTestJSON-1048288533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-19fc0c01-193b-4638-ab5c-7021ff22e9f8 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:54 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2b5899-1325-4085-9db0-639d59b1524c]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:38:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b7c94ed7-2e1f-420e-b0ce-236feb4e2497 tempest-GroupsTest-544951376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ccc42ce8-9328-4aef-852e-4ff4ee1cd9b0 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:54 devstack sudo[92991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-19fc0c01-193b-4638-ab5c-7021ff22e9f8 Jul 28 10:38:54 devstack sudo[92991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:54 devstack sudo[92992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ccc42ce8-9328-4aef-852e-4ff4ee1cd9b0 Jul 28 10:38:54 devstack sudo[92992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:54 devstack sudo[92991]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-863eaf52-5c6a-40ac-90ed-06fa3b0dc5c3 tempest-ServersNegativeTestJSON-1048288533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-19fc0c01-193b-4638-ab5c-7021ff22e9f8" returned: 0 in 0.293s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:54 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-863eaf52-5c6a-40ac-90ed-06fa3b0dc5c3 tempest-ServersNegativeTestJSON-1048288533 None] Lock "cinder-quobyte-19fc0c01-193b-4638-ab5c-7021ff22e9f8" released by "delete_volume" :: held 0.803s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:38:54 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-863eaf52-5c6a-40ac-90ed-06fa3b0dc5c3 tempest-ServersNegativeTestJSON-1048288533 None] Created reservations ['9b1e3814-a703-446b-aabf-89a60e644fab', 'ba591803-91ba-4d90-b46c-42cac81c4fbd', '19beb052-32e9-49c4-a210-e38e1b2fb538', 'a90f40bd-77bc-4ffb-a7f2-8adc18ba7daa'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:38:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-863eaf52-5c6a-40ac-90ed-06fa3b0dc5c3 tempest-ServersNegativeTestJSON-1048288533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:38:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-863eaf52-5c6a-40ac-90ed-06fa3b0dc5c3 tempest-ServersNegativeTestJSON-1048288533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:38:54 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-863eaf52-5c6a-40ac-90ed-06fa3b0dc5c3 tempest-ServersNegativeTestJSON-1048288533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:38:54 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-863eaf52-5c6a-40ac-90ed-06fa3b0dc5c3 tempest-ServersNegativeTestJSON-1048288533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:38:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-863eaf52-5c6a-40ac-90ed-06fa3b0dc5c3 tempest-ServersNegativeTestJSON-1048288533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:38:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-863eaf52-5c6a-40ac-90ed-06fa3b0dc5c3 tempest-ServersNegativeTestJSON-1048288533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:54 devstack sudo[92992]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b7c94ed7-2e1f-420e-b0ce-236feb4e2497 tempest-GroupsTest-544951376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ccc42ce8-9328-4aef-852e-4ff4ee1cd9b0" returned: 0 in 0.442s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b7c94ed7-2e1f-420e-b0ce-236feb4e2497 tempest-GroupsTest-544951376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ccc42ce8-9328-4aef-852e-4ff4ee1cd9b0 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:54 devstack sudo[92999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:38:54 devstack sudo[92999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:54 devstack sudo[93001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ccc42ce8-9328-4aef-852e-4ff4ee1cd9b0 Jul 28 10:38:54 devstack sudo[93001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:55 devstack sudo[92999]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-863eaf52-5c6a-40ac-90ed-06fa3b0dc5c3 tempest-ServersNegativeTestJSON-1048288533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.248s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:55 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-863eaf52-5c6a-40ac-90ed-06fa3b0dc5c3 tempest-ServersNegativeTestJSON-1048288533 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:38:55 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-863eaf52-5c6a-40ac-90ed-06fa3b0dc5c3 tempest-ServersNegativeTestJSON-1048288533 None] Deleted volume successfully. Jul 28 10:38:55 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-863eaf52-5c6a-40ac-90ed-06fa3b0dc5c3 tempest-ServersNegativeTestJSON-1048288533 None] Lock "cinder-19fc0c01-193b-4638-ab5c-7021ff22e9f8-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:38:55 devstack sudo[93001]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b7c94ed7-2e1f-420e-b0ce-236feb4e2497 tempest-GroupsTest-544951376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ccc42ce8-9328-4aef-852e-4ff4ee1cd9b0" returned: 0 in 0.304s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:55 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b7c94ed7-2e1f-420e-b0ce-236feb4e2497 tempest-GroupsTest-544951376 None] Lock "cinder-quobyte-ccc42ce8-9328-4aef-852e-4ff4ee1cd9b0" released by "delete_volume" :: held 0.807s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:38:55 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b7c94ed7-2e1f-420e-b0ce-236feb4e2497 tempest-GroupsTest-544951376 None] Acquiring lock "cinder-quobyte-f2cab71f-b72a-4888-80a6-c40ed9a22560" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:38:55 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b7c94ed7-2e1f-420e-b0ce-236feb4e2497 tempest-GroupsTest-544951376 None] Lock "cinder-quobyte-f2cab71f-b72a-4888-80a6-c40ed9a22560" acquired by "delete_volume" :: waited 0.018s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:38:55 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6188049-6f41-411c-8d02-87ff96733232]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:38:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b7c94ed7-2e1f-420e-b0ce-236feb4e2497 tempest-GroupsTest-544951376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f2cab71f-b72a-4888-80a6-c40ed9a22560 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:55 devstack sudo[93006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f2cab71f-b72a-4888-80a6-c40ed9a22560 Jul 28 10:38:55 devstack sudo[93006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:55 devstack sudo[93006]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b7c94ed7-2e1f-420e-b0ce-236feb4e2497 tempest-GroupsTest-544951376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f2cab71f-b72a-4888-80a6-c40ed9a22560" returned: 0 in 0.464s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b7c94ed7-2e1f-420e-b0ce-236feb4e2497 tempest-GroupsTest-544951376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f2cab71f-b72a-4888-80a6-c40ed9a22560 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:55 devstack sudo[93015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f2cab71f-b72a-4888-80a6-c40ed9a22560 Jul 28 10:38:55 devstack sudo[93015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:56 devstack sudo[93015]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b7c94ed7-2e1f-420e-b0ce-236feb4e2497 tempest-GroupsTest-544951376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f2cab71f-b72a-4888-80a6-c40ed9a22560" returned: 0 in 0.407s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:56 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b7c94ed7-2e1f-420e-b0ce-236feb4e2497 tempest-GroupsTest-544951376 None] Lock "cinder-quobyte-f2cab71f-b72a-4888-80a6-c40ed9a22560" released by "delete_volume" :: held 0.938s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:38:56 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-b7c94ed7-2e1f-420e-b0ce-236feb4e2497 tempest-GroupsTest-544951376 None] Created reservations ['82c08d51-ff52-4eef-90e9-fe8308775abf'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:38:56 devstack cinder-volume[88413]: WARNING cinder.quota [None req-b7c94ed7-2e1f-420e-b0ce-236feb4e2497 tempest-GroupsTest-544951376 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-360955006 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-360955006, it is now deprecated. Please use the default quota class for default quota. Jul 28 10:38:56 devstack cinder-volume[88413]: WARNING cinder.quota [None req-b7c94ed7-2e1f-420e-b0ce-236feb4e2497 tempest-GroupsTest-544951376 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-360955006 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-360955006, it is now deprecated. Please use the default quota class for default quota. Jul 28 10:38:56 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-b7c94ed7-2e1f-420e-b0ce-236feb4e2497 tempest-GroupsTest-544951376 None] Created reservations ['46992a51-3b48-44ab-8717-0eb28af407d0', 'd3e84c1d-ba2e-4af0-825a-d4400f5f5add', '014f3fdd-27bb-41ab-b4aa-28e8c80f5521', 'c386e420-6792-4d21-a30c-f37380409eb5'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:38:56 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-b7c94ed7-2e1f-420e-b0ce-236feb4e2497 tempest-GroupsTest-544951376 None] Created reservations ['2b96bf2f-d2b7-43e2-8bd2-3c8707be69e3', 'b62456e0-43a5-4082-9b0f-f298170a4f35', '9e72f387-3b1d-45c2-b4fe-8a53d7a6a89b', '66958072-15f9-4720-8f10-fee1498d2500'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:38:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b7c94ed7-2e1f-420e-b0ce-236feb4e2497 tempest-GroupsTest-544951376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:38:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b7c94ed7-2e1f-420e-b0ce-236feb4e2497 tempest-GroupsTest-544951376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:38:56 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b7c94ed7-2e1f-420e-b0ce-236feb4e2497 tempest-GroupsTest-544951376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:38:56 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b7c94ed7-2e1f-420e-b0ce-236feb4e2497 tempest-GroupsTest-544951376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:38:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b7c94ed7-2e1f-420e-b0ce-236feb4e2497 tempest-GroupsTest-544951376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:38:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b7c94ed7-2e1f-420e-b0ce-236feb4e2497 tempest-GroupsTest-544951376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:38:56 devstack sudo[93039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:38:56 devstack sudo[93039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:38:56 devstack sudo[93039]: pam_unix(sudo:session): session closed for user root Jul 28 10:38:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b7c94ed7-2e1f-420e-b0ce-236feb4e2497 tempest-GroupsTest-544951376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.386s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:38:56 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-b7c94ed7-2e1f-420e-b0ce-236feb4e2497 tempest-GroupsTest-544951376 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:38:57 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-b7c94ed7-2e1f-420e-b0ce-236feb4e2497 tempest-GroupsTest-544951376 None] Delete group completed successfully. Jul 28 10:39:02 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-3328e95a-657d-4de3-ad92-8cad79d7e99f tempest-GroupsV320Test-337521976 None] Group tempest-GroupsV320Test-Group-1604860467: creating Jul 28 10:39:02 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-3328e95a-657d-4de3-ad92-8cad79d7e99f tempest-GroupsV320Test-337521976 None] Group tempest-GroupsV320Test-Group-1604860467: created successfully Jul 28 10:39:02 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-3328e95a-657d-4de3-ad92-8cad79d7e99f tempest-GroupsV320Test-337521976 None] Create group completed successfully. Jul 28 10:39:04 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-8c1015ae-3767-4461-84a0-0477a0c06a6c tempest-GroupsV320Test-337521976 None] Created reservations ['a149383b-e002-47d7-9b35-a12c7a027bf6'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:39:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8c1015ae-3767-4461-84a0-0477a0c06a6c tempest-GroupsV320Test-337521976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:39:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8c1015ae-3767-4461-84a0-0477a0c06a6c tempest-GroupsV320Test-337521976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:39:04 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8c1015ae-3767-4461-84a0-0477a0c06a6c tempest-GroupsV320Test-337521976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:39:04 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8c1015ae-3767-4461-84a0-0477a0c06a6c tempest-GroupsV320Test-337521976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:39:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8c1015ae-3767-4461-84a0-0477a0c06a6c tempest-GroupsV320Test-337521976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:39:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8c1015ae-3767-4461-84a0-0477a0c06a6c tempest-GroupsV320Test-337521976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:39:04 devstack sudo[93069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:39:04 devstack sudo[93069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:39:04 devstack sudo[93069]: pam_unix(sudo:session): session closed for user root Jul 28 10:39:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8c1015ae-3767-4461-84a0-0477a0c06a6c tempest-GroupsV320Test-337521976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.258s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:39:04 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-8c1015ae-3767-4461-84a0-0477a0c06a6c tempest-GroupsV320Test-337521976 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:39:04 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-8c1015ae-3767-4461-84a0-0477a0c06a6c tempest-GroupsV320Test-337521976 None] Delete group completed successfully. Jul 28 10:39:05 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-29b95aad-e02c-424a-bf55-a38d8f9af191 req-76e3984c-be64-439e-a108-0ca955302d82 tempest-AttachVolumeTestJSON-250152809 None] Terminate volume connection completed successfully. Jul 28 10:39:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-29b95aad-e02c-424a-bf55-a38d8f9af191 req-76e3984c-be64-439e-a108-0ca955302d82 tempest-AttachVolumeTestJSON-250152809 None] Deleting attachment 5e186eb2-6e96-4576-94dc-69b43e9a90a6. {{(pid=88413) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 10:39:11 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-72d3ec84-0daf-4ea9-baef-a1262743dabf req-9346b37e-bd93-411b-9e86-1fa06f6b1f3c tempest-ServerActionsTestOtherA-342503985 None] Terminate volume connection completed successfully. Jul 28 10:39:11 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-72d3ec84-0daf-4ea9-baef-a1262743dabf req-9346b37e-bd93-411b-9e86-1fa06f6b1f3c tempest-ServerActionsTestOtherA-342503985 None] Deleting attachment 0954ba14-238a-4e5b-aeb9-a2f64a5a1658. {{(pid=88413) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 10:39:21 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=77,cinder:UPDATE=69,cinder:INSERT=18,cinder:DELETE=3 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:39:21 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-a9a42181-1832-4b2b-b0fa-7cf39cce1eab tempest-ServerActionsTestOtherA-342503985 None] Acquiring lock "cinder-1006a360-d8d6-4f63-9957-9f3349e7e256-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:39:21 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-a9a42181-1832-4b2b-b0fa-7cf39cce1eab tempest-ServerActionsTestOtherA-342503985 None] Lock "cinder-1006a360-d8d6-4f63-9957-9f3349e7e256-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:39:21 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-a9a42181-1832-4b2b-b0fa-7cf39cce1eab tempest-ServerActionsTestOtherA-342503985 None] Acquiring lock "cinder-quobyte-1006a360-d8d6-4f63-9957-9f3349e7e256" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:39:21 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-a9a42181-1832-4b2b-b0fa-7cf39cce1eab tempest-ServerActionsTestOtherA-342503985 None] Lock "cinder-quobyte-1006a360-d8d6-4f63-9957-9f3349e7e256" acquired by "delete_volume" :: waited 0.051s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:39:21 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abbf5c3-f0c0-489b-95f2-81e392f8ecf1]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:39:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a9a42181-1832-4b2b-b0fa-7cf39cce1eab tempest-ServerActionsTestOtherA-342503985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1006a360-d8d6-4f63-9957-9f3349e7e256 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:39:21 devstack sudo[93307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1006a360-d8d6-4f63-9957-9f3349e7e256 Jul 28 10:39:21 devstack sudo[93307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:39:22 devstack sudo[93307]: pam_unix(sudo:session): session closed for user root Jul 28 10:39:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a9a42181-1832-4b2b-b0fa-7cf39cce1eab tempest-ServerActionsTestOtherA-342503985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1006a360-d8d6-4f63-9957-9f3349e7e256" returned: 0 in 0.440s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:39:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a9a42181-1832-4b2b-b0fa-7cf39cce1eab tempest-ServerActionsTestOtherA-342503985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1006a360-d8d6-4f63-9957-9f3349e7e256 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:39:22 devstack sudo[93312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1006a360-d8d6-4f63-9957-9f3349e7e256 Jul 28 10:39:22 devstack sudo[93312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:39:22 devstack sudo[93312]: pam_unix(sudo:session): session closed for user root Jul 28 10:39:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a9a42181-1832-4b2b-b0fa-7cf39cce1eab tempest-ServerActionsTestOtherA-342503985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1006a360-d8d6-4f63-9957-9f3349e7e256" returned: 0 in 0.368s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:39:22 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-a9a42181-1832-4b2b-b0fa-7cf39cce1eab tempest-ServerActionsTestOtherA-342503985 None] Lock "cinder-quobyte-1006a360-d8d6-4f63-9957-9f3349e7e256" released by "delete_volume" :: held 0.879s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:39:22 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-a9a42181-1832-4b2b-b0fa-7cf39cce1eab tempest-ServerActionsTestOtherA-342503985 None] Created reservations ['1b8e1c76-6a7d-4a4a-a1c9-b659a495a06a', '7dca5de7-8704-47bd-baf4-9d37d10891fa', '892b03cf-8144-4f27-a6e7-313efbaba499', '7e85f3e5-22d1-4f44-9b94-d9cda48c36b5'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:39:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a9a42181-1832-4b2b-b0fa-7cf39cce1eab tempest-ServerActionsTestOtherA-342503985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:39:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a9a42181-1832-4b2b-b0fa-7cf39cce1eab tempest-ServerActionsTestOtherA-342503985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:39:22 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-a9a42181-1832-4b2b-b0fa-7cf39cce1eab tempest-ServerActionsTestOtherA-342503985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:39:22 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-a9a42181-1832-4b2b-b0fa-7cf39cce1eab tempest-ServerActionsTestOtherA-342503985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:39:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a9a42181-1832-4b2b-b0fa-7cf39cce1eab tempest-ServerActionsTestOtherA-342503985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:39:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a9a42181-1832-4b2b-b0fa-7cf39cce1eab tempest-ServerActionsTestOtherA-342503985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:39:22 devstack sudo[93315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:39:22 devstack sudo[93315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:39:23 devstack sudo[93315]: pam_unix(sudo:session): session closed for user root Jul 28 10:39:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a9a42181-1832-4b2b-b0fa-7cf39cce1eab tempest-ServerActionsTestOtherA-342503985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.354s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:39:23 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-a9a42181-1832-4b2b-b0fa-7cf39cce1eab tempest-ServerActionsTestOtherA-342503985 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:39:23 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-a9a42181-1832-4b2b-b0fa-7cf39cce1eab tempest-ServerActionsTestOtherA-342503985 None] Deleted volume successfully. Jul 28 10:39:23 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-a9a42181-1832-4b2b-b0fa-7cf39cce1eab tempest-ServerActionsTestOtherA-342503985 None] Lock "cinder-1006a360-d8d6-4f63-9957-9f3349e7e256-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:39:28 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:39:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:39:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:39:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:39:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:39:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:39:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:39:28 devstack sudo[93371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:39:28 devstack sudo[93371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:39:28 devstack sudo[93371]: pam_unix(sudo:session): session closed for user root Jul 28 10:39:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.464s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:39:28 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:39:28 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager._thread_info {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:39:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread count: 8 {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 10:39:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread info: [<_MainThread(MainThread, started 137939890385024)>, , , , , , , ] {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 10:39:32 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=84,cinder:UPDATE=87,cinder:DELETE=4,cinder:INSERT=12 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:39:33 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=5,cinder:UPDATE=9,cinder:INSERT=3,cinder:DELETE=1 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:39:33 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfe4109f-38b0-449b-8d34-96ab53c177f8 tempest-VolumeQuotasAdminTestJSON-254608943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:39:33 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bfe4109f-38b0-449b-8d34-96ab53c177f8 tempest-VolumeQuotasAdminTestJSON-254608943 None] Flow 'volume_create_manager' (4aa39d83-9888-49ce-b04f-9dd3a1056ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:39:33 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bfe4109f-38b0-449b-8d34-96ab53c177f8 tempest-VolumeQuotasAdminTestJSON-254608943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb09ff3a-3ba9-4c59-a7e9-2316f33edc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:39:33 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bfe4109f-38b0-449b-8d34-96ab53c177f8 tempest-VolumeQuotasAdminTestJSON-254608943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb09ff3a-3ba9-4c59-a7e9-2316f33edc47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1045046341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35f16eaa-7ae4-4b89-954a-9113aafd3bd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c27cd7931b43aab6d6b032227257b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:39:33Z,use_quota=True,user_id='c5b1e3d2165a4b94bd2723f2c2fbaad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:39:33 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bfe4109f-38b0-449b-8d34-96ab53c177f8 tempest-VolumeQuotasAdminTestJSON-254608943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe4d708f-bd32-413c-9924-160bc3bc78e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:39:33 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bfe4109f-38b0-449b-8d34-96ab53c177f8 tempest-VolumeQuotasAdminTestJSON-254608943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe4d708f-bd32-413c-9924-160bc3bc78e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:39:33 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bfe4109f-38b0-449b-8d34-96ab53c177f8 tempest-VolumeQuotasAdminTestJSON-254608943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (862c2b45-b0fe-4ed8-945c-37e5a919d0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:39:33 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bfe4109f-38b0-449b-8d34-96ab53c177f8 tempest-VolumeQuotasAdminTestJSON-254608943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (862c2b45-b0fe-4ed8-945c-37e5a919d0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35f16eaa-7ae4-4b89-954a-9113aafd3bd4', 'volume_name': 'volume-35f16eaa-7ae4-4b89-954a-9113aafd3bd4', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:39:33 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bfe4109f-38b0-449b-8d34-96ab53c177f8 tempest-VolumeQuotasAdminTestJSON-254608943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b24b949-97c3-41f4-b2fa-4cb8e389b2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:39:33 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bfe4109f-38b0-449b-8d34-96ab53c177f8 tempest-VolumeQuotasAdminTestJSON-254608943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b24b949-97c3-41f4-b2fa-4cb8e389b2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:39:33 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bfe4109f-38b0-449b-8d34-96ab53c177f8 tempest-VolumeQuotasAdminTestJSON-254608943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c023d5f8-fd86-4b55-9c9a-570a652af405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:39:33 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-bfe4109f-38b0-449b-8d34-96ab53c177f8 tempest-VolumeQuotasAdminTestJSON-254608943 None] Volume 35f16eaa-7ae4-4b89-954a-9113aafd3bd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35f16eaa-7ae4-4b89-954a-9113aafd3bd4', 'volume_size': 1} Jul 28 10:39:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-bfe4109f-38b0-449b-8d34-96ab53c177f8 tempest-VolumeQuotasAdminTestJSON-254608943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:39:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-bfe4109f-38b0-449b-8d34-96ab53c177f8 tempest-VolumeQuotasAdminTestJSON-254608943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:39:33 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-bfe4109f-38b0-449b-8d34-96ab53c177f8 tempest-VolumeQuotasAdminTestJSON-254608943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1045046341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35f16eaa-7ae4-4b89-954a-9113aafd3bd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c27cd7931b43aab6d6b032227257b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:39:33Z,use_quota=True,user_id='c5b1e3d2165a4b94bd2723f2c2fbaad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:39:33 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-bfe4109f-38b0-449b-8d34-96ab53c177f8 tempest-VolumeQuotasAdminTestJSON-254608943 None] Creating volume 35f16eaa-7ae4-4b89-954a-9113aafd3bd4 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:39:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-bfe4109f-38b0-449b-8d34-96ab53c177f8 tempest-VolumeQuotasAdminTestJSON-254608943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:39:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-bfe4109f-38b0-449b-8d34-96ab53c177f8 tempest-VolumeQuotasAdminTestJSON-254608943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:39:33 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-bfe4109f-38b0-449b-8d34-96ab53c177f8 tempest-VolumeQuotasAdminTestJSON-254608943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:39:33 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-bfe4109f-38b0-449b-8d34-96ab53c177f8 tempest-VolumeQuotasAdminTestJSON-254608943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:39:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-bfe4109f-38b0-449b-8d34-96ab53c177f8 tempest-VolumeQuotasAdminTestJSON-254608943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:39:33 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-bfe4109f-38b0-449b-8d34-96ab53c177f8 tempest-VolumeQuotasAdminTestJSON-254608943 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:39:33 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-bfe4109f-38b0-449b-8d34-96ab53c177f8 tempest-VolumeQuotasAdminTestJSON-254608943 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:39:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bfe4109f-38b0-449b-8d34-96ab53c177f8 tempest-VolumeQuotasAdminTestJSON-254608943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-35f16eaa-7ae4-4b89-954a-9113aafd3bd4 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:39:33 devstack sudo[93482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-35f16eaa-7ae4-4b89-954a-9113aafd3bd4 1073741824 Jul 28 10:39:33 devstack sudo[93482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:39:34 devstack sudo[93482]: pam_unix(sudo:session): session closed for user root Jul 28 10:39:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bfe4109f-38b0-449b-8d34-96ab53c177f8 tempest-VolumeQuotasAdminTestJSON-254608943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-35f16eaa-7ae4-4b89-954a-9113aafd3bd4 1073741824" returned: 0 in 0.698s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:39:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bfe4109f-38b0-449b-8d34-96ab53c177f8 tempest-VolumeQuotasAdminTestJSON-254608943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-35f16eaa-7ae4-4b89-954a-9113aafd3bd4 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:39:34 devstack sudo[93488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-35f16eaa-7ae4-4b89-954a-9113aafd3bd4 Jul 28 10:39:34 devstack sudo[93488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:39:34 devstack sudo[93488]: pam_unix(sudo:session): session closed for user root Jul 28 10:39:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bfe4109f-38b0-449b-8d34-96ab53c177f8 tempest-VolumeQuotasAdminTestJSON-254608943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-35f16eaa-7ae4-4b89-954a-9113aafd3bd4" returned: 0 in 0.375s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:39:34 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-bfe4109f-38b0-449b-8d34-96ab53c177f8 tempest-VolumeQuotasAdminTestJSON-254608943 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:39:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-bfe4109f-38b0-449b-8d34-96ab53c177f8 tempest-VolumeQuotasAdminTestJSON-254608943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:39:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bfe4109f-38b0-449b-8d34-96ab53c177f8 tempest-VolumeQuotasAdminTestJSON-254608943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c023d5f8-fd86-4b55-9c9a-570a652af405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35f16eaa-7ae4-4b89-954a-9113aafd3bd4', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:39:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bfe4109f-38b0-449b-8d34-96ab53c177f8 tempest-VolumeQuotasAdminTestJSON-254608943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30492362-df7c-4429-8daf-c0ece161cf1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:39:35 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-bfe4109f-38b0-449b-8d34-96ab53c177f8 tempest-VolumeQuotasAdminTestJSON-254608943 None] Volume volume-35f16eaa-7ae4-4b89-954a-9113aafd3bd4 (35f16eaa-7ae4-4b89-954a-9113aafd3bd4): created successfully Jul 28 10:39:35 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bfe4109f-38b0-449b-8d34-96ab53c177f8 tempest-VolumeQuotasAdminTestJSON-254608943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30492362-df7c-4429-8daf-c0ece161cf1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:39:35 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bfe4109f-38b0-449b-8d34-96ab53c177f8 tempest-VolumeQuotasAdminTestJSON-254608943 None] Flow 'volume_create_manager' (4aa39d83-9888-49ce-b04f-9dd3a1056ba9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:39:35 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-bfe4109f-38b0-449b-8d34-96ab53c177f8 tempest-VolumeQuotasAdminTestJSON-254608943 None] Created volume successfully. Jul 28 10:39:35 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9f9fdf6a-f6fa-4b10-a3a5-1143f9328f87 tempest-VolumeQuotasAdminTestJSON-254608943 None] Acquiring lock "cinder-35f16eaa-7ae4-4b89-954a-9113aafd3bd4-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:39:35 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9f9fdf6a-f6fa-4b10-a3a5-1143f9328f87 tempest-VolumeQuotasAdminTestJSON-254608943 None] Lock "cinder-35f16eaa-7ae4-4b89-954a-9113aafd3bd4-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:39:35 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9f9fdf6a-f6fa-4b10-a3a5-1143f9328f87 tempest-VolumeQuotasAdminTestJSON-254608943 None] Acquiring lock "cinder-quobyte-35f16eaa-7ae4-4b89-954a-9113aafd3bd4" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:39:35 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9f9fdf6a-f6fa-4b10-a3a5-1143f9328f87 tempest-VolumeQuotasAdminTestJSON-254608943 None] Lock "cinder-quobyte-35f16eaa-7ae4-4b89-954a-9113aafd3bd4" acquired by "delete_volume" :: waited 0.026s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:39:36 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[86830639-c5e6-49d1-ad18-dc130cd2c21a]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:39:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9f9fdf6a-f6fa-4b10-a3a5-1143f9328f87 tempest-VolumeQuotasAdminTestJSON-254608943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-35f16eaa-7ae4-4b89-954a-9113aafd3bd4 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:39:36 devstack sudo[93493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-35f16eaa-7ae4-4b89-954a-9113aafd3bd4 Jul 28 10:39:36 devstack sudo[93493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:39:36 devstack sudo[93493]: pam_unix(sudo:session): session closed for user root Jul 28 10:39:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9f9fdf6a-f6fa-4b10-a3a5-1143f9328f87 tempest-VolumeQuotasAdminTestJSON-254608943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-35f16eaa-7ae4-4b89-954a-9113aafd3bd4" returned: 0 in 0.663s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:39:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9f9fdf6a-f6fa-4b10-a3a5-1143f9328f87 tempest-VolumeQuotasAdminTestJSON-254608943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-35f16eaa-7ae4-4b89-954a-9113aafd3bd4 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:39:36 devstack sudo[93499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-35f16eaa-7ae4-4b89-954a-9113aafd3bd4 Jul 28 10:39:36 devstack sudo[93499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:39:36 devstack sudo[93499]: pam_unix(sudo:session): session closed for user root Jul 28 10:39:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9f9fdf6a-f6fa-4b10-a3a5-1143f9328f87 tempest-VolumeQuotasAdminTestJSON-254608943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-35f16eaa-7ae4-4b89-954a-9113aafd3bd4" returned: 0 in 0.321s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:39:37 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9f9fdf6a-f6fa-4b10-a3a5-1143f9328f87 tempest-VolumeQuotasAdminTestJSON-254608943 None] Lock "cinder-quobyte-35f16eaa-7ae4-4b89-954a-9113aafd3bd4" released by "delete_volume" :: held 1.061s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:39:37 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-9f9fdf6a-f6fa-4b10-a3a5-1143f9328f87 tempest-VolumeQuotasAdminTestJSON-254608943 None] Created reservations ['c0db9529-f060-4f8c-9517-1cc958a2fd87', '2d85870b-ca6e-432e-b3c0-509ab4634fb8', 'c201d808-8616-4158-a691-b1d2311346f3', '76b9db53-e10c-4173-8c97-35dfb541f5a6'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:39:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9f9fdf6a-f6fa-4b10-a3a5-1143f9328f87 tempest-VolumeQuotasAdminTestJSON-254608943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:39:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9f9fdf6a-f6fa-4b10-a3a5-1143f9328f87 tempest-VolumeQuotasAdminTestJSON-254608943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:39:37 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9f9fdf6a-f6fa-4b10-a3a5-1143f9328f87 tempest-VolumeQuotasAdminTestJSON-254608943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:39:37 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9f9fdf6a-f6fa-4b10-a3a5-1143f9328f87 tempest-VolumeQuotasAdminTestJSON-254608943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:39:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9f9fdf6a-f6fa-4b10-a3a5-1143f9328f87 tempest-VolumeQuotasAdminTestJSON-254608943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:39:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9f9fdf6a-f6fa-4b10-a3a5-1143f9328f87 tempest-VolumeQuotasAdminTestJSON-254608943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:39:37 devstack sudo[93504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:39:37 devstack sudo[93504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:39:37 devstack sudo[93504]: pam_unix(sudo:session): session closed for user root Jul 28 10:39:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9f9fdf6a-f6fa-4b10-a3a5-1143f9328f87 tempest-VolumeQuotasAdminTestJSON-254608943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.301s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:39:37 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-9f9fdf6a-f6fa-4b10-a3a5-1143f9328f87 tempest-VolumeQuotasAdminTestJSON-254608943 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:39:37 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-9f9fdf6a-f6fa-4b10-a3a5-1143f9328f87 tempest-VolumeQuotasAdminTestJSON-254608943 None] Deleted volume successfully. Jul 28 10:39:37 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9f9fdf6a-f6fa-4b10-a3a5-1143f9328f87 tempest-VolumeQuotasAdminTestJSON-254608943 None] Lock "cinder-35f16eaa-7ae4-4b89-954a-9113aafd3bd4-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:39:39 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-30836c88-fde4-45c2-9384-5a49e095faa4 tempest-VolumeQuotasAdminTestJSON-254608943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:39:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-30836c88-fde4-45c2-9384-5a49e095faa4 tempest-VolumeQuotasAdminTestJSON-254608943 None] Flow 'volume_create_manager' (e856d8b3-b99d-4d38-9e94-3baf6f327589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:39:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-30836c88-fde4-45c2-9384-5a49e095faa4 tempest-VolumeQuotasAdminTestJSON-254608943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69c9433d-8d70-421a-843c-0d3a4887901e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:39:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-30836c88-fde4-45c2-9384-5a49e095faa4 tempest-VolumeQuotasAdminTestJSON-254608943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69c9433d-8d70-421a-843c-0d3a4887901e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-949056417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f08bb9b-5697-4bf6-8fd4-722fdbfe261d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c27cd7931b43aab6d6b032227257b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:39:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:39:39Z,use_quota=True,user_id='c5b1e3d2165a4b94bd2723f2c2fbaad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:39:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-30836c88-fde4-45c2-9384-5a49e095faa4 tempest-VolumeQuotasAdminTestJSON-254608943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d1feb6-df9c-4de9-9d8a-a36748a11f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:39:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-30836c88-fde4-45c2-9384-5a49e095faa4 tempest-VolumeQuotasAdminTestJSON-254608943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d1feb6-df9c-4de9-9d8a-a36748a11f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:39:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-30836c88-fde4-45c2-9384-5a49e095faa4 tempest-VolumeQuotasAdminTestJSON-254608943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fc81a72-8b5e-4439-8650-f944ae792d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:39:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-30836c88-fde4-45c2-9384-5a49e095faa4 tempest-VolumeQuotasAdminTestJSON-254608943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fc81a72-8b5e-4439-8650-f944ae792d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f08bb9b-5697-4bf6-8fd4-722fdbfe261d', 'volume_name': 'volume-5f08bb9b-5697-4bf6-8fd4-722fdbfe261d', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:39:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-30836c88-fde4-45c2-9384-5a49e095faa4 tempest-VolumeQuotasAdminTestJSON-254608943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b77ba50c-bd9c-4815-b634-b936267b9445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:39:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-30836c88-fde4-45c2-9384-5a49e095faa4 tempest-VolumeQuotasAdminTestJSON-254608943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b77ba50c-bd9c-4815-b634-b936267b9445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:39:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-30836c88-fde4-45c2-9384-5a49e095faa4 tempest-VolumeQuotasAdminTestJSON-254608943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8099f7e3-ae98-45e2-af31-412f61a02b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:39:39 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-30836c88-fde4-45c2-9384-5a49e095faa4 tempest-VolumeQuotasAdminTestJSON-254608943 None] Volume 5f08bb9b-5697-4bf6-8fd4-722fdbfe261d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f08bb9b-5697-4bf6-8fd4-722fdbfe261d', 'volume_size': 1} Jul 28 10:39:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-30836c88-fde4-45c2-9384-5a49e095faa4 tempest-VolumeQuotasAdminTestJSON-254608943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:39:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-30836c88-fde4-45c2-9384-5a49e095faa4 tempest-VolumeQuotasAdminTestJSON-254608943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:39:39 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-30836c88-fde4-45c2-9384-5a49e095faa4 tempest-VolumeQuotasAdminTestJSON-254608943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-949056417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f08bb9b-5697-4bf6-8fd4-722fdbfe261d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c27cd7931b43aab6d6b032227257b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:39:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:39:39Z,use_quota=True,user_id='c5b1e3d2165a4b94bd2723f2c2fbaad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:39:39 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-30836c88-fde4-45c2-9384-5a49e095faa4 tempest-VolumeQuotasAdminTestJSON-254608943 None] Creating volume 5f08bb9b-5697-4bf6-8fd4-722fdbfe261d {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:39:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-30836c88-fde4-45c2-9384-5a49e095faa4 tempest-VolumeQuotasAdminTestJSON-254608943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:39:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-30836c88-fde4-45c2-9384-5a49e095faa4 tempest-VolumeQuotasAdminTestJSON-254608943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:39:39 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-30836c88-fde4-45c2-9384-5a49e095faa4 tempest-VolumeQuotasAdminTestJSON-254608943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:39:39 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-30836c88-fde4-45c2-9384-5a49e095faa4 tempest-VolumeQuotasAdminTestJSON-254608943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:39:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-30836c88-fde4-45c2-9384-5a49e095faa4 tempest-VolumeQuotasAdminTestJSON-254608943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:39:39 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-30836c88-fde4-45c2-9384-5a49e095faa4 tempest-VolumeQuotasAdminTestJSON-254608943 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:39:39 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-30836c88-fde4-45c2-9384-5a49e095faa4 tempest-VolumeQuotasAdminTestJSON-254608943 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:39:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-30836c88-fde4-45c2-9384-5a49e095faa4 tempest-VolumeQuotasAdminTestJSON-254608943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5f08bb9b-5697-4bf6-8fd4-722fdbfe261d 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:39:39 devstack sudo[93534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5f08bb9b-5697-4bf6-8fd4-722fdbfe261d 1073741824 Jul 28 10:39:39 devstack sudo[93534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:39:40 devstack sudo[93534]: pam_unix(sudo:session): session closed for user root Jul 28 10:39:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-30836c88-fde4-45c2-9384-5a49e095faa4 tempest-VolumeQuotasAdminTestJSON-254608943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5f08bb9b-5697-4bf6-8fd4-722fdbfe261d 1073741824" returned: 0 in 0.854s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:39:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-30836c88-fde4-45c2-9384-5a49e095faa4 tempest-VolumeQuotasAdminTestJSON-254608943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5f08bb9b-5697-4bf6-8fd4-722fdbfe261d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:39:40 devstack sudo[93542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5f08bb9b-5697-4bf6-8fd4-722fdbfe261d Jul 28 10:39:40 devstack sudo[93542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:39:40 devstack sudo[93542]: pam_unix(sudo:session): session closed for user root Jul 28 10:39:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-30836c88-fde4-45c2-9384-5a49e095faa4 tempest-VolumeQuotasAdminTestJSON-254608943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5f08bb9b-5697-4bf6-8fd4-722fdbfe261d" returned: 0 in 0.541s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:39:40 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-30836c88-fde4-45c2-9384-5a49e095faa4 tempest-VolumeQuotasAdminTestJSON-254608943 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:39:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-30836c88-fde4-45c2-9384-5a49e095faa4 tempest-VolumeQuotasAdminTestJSON-254608943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:39:40 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-30836c88-fde4-45c2-9384-5a49e095faa4 tempest-VolumeQuotasAdminTestJSON-254608943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8099f7e3-ae98-45e2-af31-412f61a02b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f08bb9b-5697-4bf6-8fd4-722fdbfe261d', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:39:40 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-30836c88-fde4-45c2-9384-5a49e095faa4 tempest-VolumeQuotasAdminTestJSON-254608943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d74fd51-250d-4f9c-9893-1904e186db6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:39:40 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-30836c88-fde4-45c2-9384-5a49e095faa4 tempest-VolumeQuotasAdminTestJSON-254608943 None] Volume volume-5f08bb9b-5697-4bf6-8fd4-722fdbfe261d (5f08bb9b-5697-4bf6-8fd4-722fdbfe261d): created successfully Jul 28 10:39:40 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-30836c88-fde4-45c2-9384-5a49e095faa4 tempest-VolumeQuotasAdminTestJSON-254608943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d74fd51-250d-4f9c-9893-1904e186db6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:39:40 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-30836c88-fde4-45c2-9384-5a49e095faa4 tempest-VolumeQuotasAdminTestJSON-254608943 None] Flow 'volume_create_manager' (e856d8b3-b99d-4d38-9e94-3baf6f327589) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:39:40 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-30836c88-fde4-45c2-9384-5a49e095faa4 tempest-VolumeQuotasAdminTestJSON-254608943 None] Created volume successfully. Jul 28 10:39:42 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-5e710e33-32ac-4514-9f0e-94dcfc4dec7a tempest-VolumeQuotasAdminTestJSON-741128878 None] Transfer volume completed successfully. Jul 28 10:39:42 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-73dc7bc7-5250-468b-8b45-596f6479edb8 tempest-VolumeQuotasAdminTestJSON-2094247381 None] Acquiring lock "cinder-5f08bb9b-5697-4bf6-8fd4-722fdbfe261d-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:39:42 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-73dc7bc7-5250-468b-8b45-596f6479edb8 tempest-VolumeQuotasAdminTestJSON-2094247381 None] Lock "cinder-5f08bb9b-5697-4bf6-8fd4-722fdbfe261d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:39:43 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-73dc7bc7-5250-468b-8b45-596f6479edb8 tempest-VolumeQuotasAdminTestJSON-2094247381 None] Acquiring lock "cinder-quobyte-5f08bb9b-5697-4bf6-8fd4-722fdbfe261d" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:39:43 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-73dc7bc7-5250-468b-8b45-596f6479edb8 tempest-VolumeQuotasAdminTestJSON-2094247381 None] Lock "cinder-quobyte-5f08bb9b-5697-4bf6-8fd4-722fdbfe261d" acquired by "delete_volume" :: waited 0.024s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:39:43 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77e84c2-68ef-4a45-b30c-149d61a1d80a]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:39:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-73dc7bc7-5250-468b-8b45-596f6479edb8 tempest-VolumeQuotasAdminTestJSON-2094247381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5f08bb9b-5697-4bf6-8fd4-722fdbfe261d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:39:43 devstack sudo[93550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5f08bb9b-5697-4bf6-8fd4-722fdbfe261d Jul 28 10:39:43 devstack sudo[93550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:39:43 devstack sudo[93550]: pam_unix(sudo:session): session closed for user root Jul 28 10:39:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-73dc7bc7-5250-468b-8b45-596f6479edb8 tempest-VolumeQuotasAdminTestJSON-2094247381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5f08bb9b-5697-4bf6-8fd4-722fdbfe261d" returned: 0 in 0.486s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:39:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-73dc7bc7-5250-468b-8b45-596f6479edb8 tempest-VolumeQuotasAdminTestJSON-2094247381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5f08bb9b-5697-4bf6-8fd4-722fdbfe261d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:39:43 devstack sudo[93555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5f08bb9b-5697-4bf6-8fd4-722fdbfe261d Jul 28 10:39:43 devstack sudo[93555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:39:43 devstack sudo[93555]: pam_unix(sudo:session): session closed for user root Jul 28 10:39:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-73dc7bc7-5250-468b-8b45-596f6479edb8 tempest-VolumeQuotasAdminTestJSON-2094247381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5f08bb9b-5697-4bf6-8fd4-722fdbfe261d" returned: 0 in 0.310s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:39:43 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-73dc7bc7-5250-468b-8b45-596f6479edb8 tempest-VolumeQuotasAdminTestJSON-2094247381 None] Lock "cinder-quobyte-5f08bb9b-5697-4bf6-8fd4-722fdbfe261d" released by "delete_volume" :: held 0.861s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:39:43 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-73dc7bc7-5250-468b-8b45-596f6479edb8 tempest-VolumeQuotasAdminTestJSON-2094247381 None] Created reservations ['26095d8d-89cb-487c-87c7-66950f6028e2', '40609046-6472-4c35-9dca-6d6a67c86d68', '37f68cc9-9832-4237-af3b-35e6cf85eace', '8fdc7e03-2de6-45c3-adb5-d0d1aa8e589b'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:39:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-73dc7bc7-5250-468b-8b45-596f6479edb8 tempest-VolumeQuotasAdminTestJSON-2094247381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:39:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-73dc7bc7-5250-468b-8b45-596f6479edb8 tempest-VolumeQuotasAdminTestJSON-2094247381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:39:44 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-73dc7bc7-5250-468b-8b45-596f6479edb8 tempest-VolumeQuotasAdminTestJSON-2094247381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:39:44 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-73dc7bc7-5250-468b-8b45-596f6479edb8 tempest-VolumeQuotasAdminTestJSON-2094247381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:39:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-73dc7bc7-5250-468b-8b45-596f6479edb8 tempest-VolumeQuotasAdminTestJSON-2094247381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:39:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-73dc7bc7-5250-468b-8b45-596f6479edb8 tempest-VolumeQuotasAdminTestJSON-2094247381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:39:44 devstack sudo[93558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:39:44 devstack sudo[93558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:39:44 devstack sudo[93558]: pam_unix(sudo:session): session closed for user root Jul 28 10:39:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-73dc7bc7-5250-468b-8b45-596f6479edb8 tempest-VolumeQuotasAdminTestJSON-2094247381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.391s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:39:44 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-73dc7bc7-5250-468b-8b45-596f6479edb8 tempest-VolumeQuotasAdminTestJSON-2094247381 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:39:44 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-73dc7bc7-5250-468b-8b45-596f6479edb8 tempest-VolumeQuotasAdminTestJSON-2094247381 None] Deleted volume successfully. Jul 28 10:39:44 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-73dc7bc7-5250-468b-8b45-596f6479edb8 tempest-VolumeQuotasAdminTestJSON-2094247381 None] Lock "cinder-5f08bb9b-5697-4bf6-8fd4-722fdbfe261d-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:39:54 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:UPDATE=21,cinder:SELECT=16,cinder:INSERT=3,cinder:DELETE=1 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:39:54 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=13,cinder:UPDATE=23,cinder:INSERT=7,cinder:DELETE=3 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:39:56 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-113cc7e1-848c-4efc-aa4e-dae80d9000bc tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:39:56 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-113cc7e1-848c-4efc-aa4e-dae80d9000bc tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Flow 'volume_create_manager' (a80779c7-f8a9-4998-b65d-aedf6cb38128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:39:56 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-113cc7e1-848c-4efc-aa4e-dae80d9000bc tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (131bfeac-89ee-4fa8-9548-981d9a2c540b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:39:56 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-113cc7e1-848c-4efc-aa4e-dae80d9000bc tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (131bfeac-89ee-4fa8-9548-981d9a2c540b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-69381716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a980d77b-75d5-4088-be09-27136da2be08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7f5734ddc6a43c5bc86e7b9f08ae6ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:39:56Z,use_quota=True,user_id='32d2118adf8246c9b9cbb4d00963e5a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(803ca759-ca92-4f4f-8e8a-9eb62cdd0603),volume_type_id=803ca759-ca92-4f4f-8e8a-9eb62cdd0603)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:39:56 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-113cc7e1-848c-4efc-aa4e-dae80d9000bc tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fe92fef-0e05-4d52-93b9-6fd7c524f284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:39:56 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-113cc7e1-848c-4efc-aa4e-dae80d9000bc tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fe92fef-0e05-4d52-93b9-6fd7c524f284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:39:56 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-113cc7e1-848c-4efc-aa4e-dae80d9000bc tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d0db856-51a7-4b4b-b05e-f474945920f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:39:56 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-113cc7e1-848c-4efc-aa4e-dae80d9000bc tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d0db856-51a7-4b4b-b05e-f474945920f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a980d77b-75d5-4088-be09-27136da2be08', 'volume_name': 'volume-a980d77b-75d5-4088-be09-27136da2be08', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:39:56 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-113cc7e1-848c-4efc-aa4e-dae80d9000bc tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (792fcbe8-9401-4db3-a738-045bf905b45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:39:56 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-113cc7e1-848c-4efc-aa4e-dae80d9000bc tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (792fcbe8-9401-4db3-a738-045bf905b45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:39:56 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-113cc7e1-848c-4efc-aa4e-dae80d9000bc tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (387f8d4c-3423-4a5d-abb5-33aaa60b4ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:39:56 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-113cc7e1-848c-4efc-aa4e-dae80d9000bc tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Volume a980d77b-75d5-4088-be09-27136da2be08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a980d77b-75d5-4088-be09-27136da2be08', 'volume_size': 1} Jul 28 10:39:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-113cc7e1-848c-4efc-aa4e-dae80d9000bc tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:39:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-113cc7e1-848c-4efc-aa4e-dae80d9000bc tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:39:56 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-113cc7e1-848c-4efc-aa4e-dae80d9000bc tempest-VolumeRetypeWithoutMigrationTest-335376717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-69381716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a980d77b-75d5-4088-be09-27136da2be08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7f5734ddc6a43c5bc86e7b9f08ae6ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:39:56Z,use_quota=True,user_id='32d2118adf8246c9b9cbb4d00963e5a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(803ca759-ca92-4f4f-8e8a-9eb62cdd0603),volume_type_id=803ca759-ca92-4f4f-8e8a-9eb62cdd0603)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:39:56 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-113cc7e1-848c-4efc-aa4e-dae80d9000bc tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Creating volume a980d77b-75d5-4088-be09-27136da2be08 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:39:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-113cc7e1-848c-4efc-aa4e-dae80d9000bc tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:39:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-113cc7e1-848c-4efc-aa4e-dae80d9000bc tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:39:56 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-113cc7e1-848c-4efc-aa4e-dae80d9000bc tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:39:56 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-113cc7e1-848c-4efc-aa4e-dae80d9000bc tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:39:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-113cc7e1-848c-4efc-aa4e-dae80d9000bc tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:39:56 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-113cc7e1-848c-4efc-aa4e-dae80d9000bc tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:39:56 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-113cc7e1-848c-4efc-aa4e-dae80d9000bc tempest-VolumeRetypeWithoutMigrationTest-335376717 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:39:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-113cc7e1-848c-4efc-aa4e-dae80d9000bc tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a980d77b-75d5-4088-be09-27136da2be08 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:39:56 devstack sudo[93656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a980d77b-75d5-4088-be09-27136da2be08 1073741824 Jul 28 10:39:56 devstack sudo[93656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:39:57 devstack sudo[93656]: pam_unix(sudo:session): session closed for user root Jul 28 10:39:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-113cc7e1-848c-4efc-aa4e-dae80d9000bc tempest-VolumeRetypeWithoutMigrationTest-335376717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a980d77b-75d5-4088-be09-27136da2be08 1073741824" returned: 0 in 1.173s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:39:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-113cc7e1-848c-4efc-aa4e-dae80d9000bc tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a980d77b-75d5-4088-be09-27136da2be08 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:39:57 devstack sudo[93705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a980d77b-75d5-4088-be09-27136da2be08 Jul 28 10:39:57 devstack sudo[93705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:39:57 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb30d7f1-55cc-4edb-a465-67574bf7a213 tempest-AttachVolumeShelveTestJSON-225488613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:39:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bb30d7f1-55cc-4edb-a465-67574bf7a213 tempest-AttachVolumeShelveTestJSON-225488613 None] Flow 'volume_create_manager' (da0c0cf0-bf2b-491c-bd29-778c248e3913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:39:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bb30d7f1-55cc-4edb-a465-67574bf7a213 tempest-AttachVolumeShelveTestJSON-225488613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c18bee4-906c-4a04-8c06-c5de40db5ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:39:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bb30d7f1-55cc-4edb-a465-67574bf7a213 tempest-AttachVolumeShelveTestJSON-225488613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c18bee4-906c-4a04-8c06-c5de40db5ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1021626126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aa220ce-0b5a-46f1-b27a-2cc6fcd04314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0464405ca9c7440a8ecfc9d2b7af6843',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:39:58Z,use_quota=True,user_id='34f587c2a73f44f5aeabe75f81c562af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:39:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bb30d7f1-55cc-4edb-a465-67574bf7a213 tempest-AttachVolumeShelveTestJSON-225488613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eadf1a8c-f453-44c4-94e7-5f1ed0ef287d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:39:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bb30d7f1-55cc-4edb-a465-67574bf7a213 tempest-AttachVolumeShelveTestJSON-225488613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eadf1a8c-f453-44c4-94e7-5f1ed0ef287d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:39:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bb30d7f1-55cc-4edb-a465-67574bf7a213 tempest-AttachVolumeShelveTestJSON-225488613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c17102-1fc3-4dec-9284-225b6f928686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:39:58 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bb30d7f1-55cc-4edb-a465-67574bf7a213 tempest-AttachVolumeShelveTestJSON-225488613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c17102-1fc3-4dec-9284-225b6f928686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1aa220ce-0b5a-46f1-b27a-2cc6fcd04314', 'volume_name': 'volume-1aa220ce-0b5a-46f1-b27a-2cc6fcd04314', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:39:58 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bb30d7f1-55cc-4edb-a465-67574bf7a213 tempest-AttachVolumeShelveTestJSON-225488613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ba4797-a046-451e-a272-691e3c9dad63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:39:58 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bb30d7f1-55cc-4edb-a465-67574bf7a213 tempest-AttachVolumeShelveTestJSON-225488613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ba4797-a046-451e-a272-691e3c9dad63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:39:58 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bb30d7f1-55cc-4edb-a465-67574bf7a213 tempest-AttachVolumeShelveTestJSON-225488613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed62108-d4d5-468d-8f0c-04a9cd9dca80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:39:58 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-bb30d7f1-55cc-4edb-a465-67574bf7a213 tempest-AttachVolumeShelveTestJSON-225488613 None] Volume 1aa220ce-0b5a-46f1-b27a-2cc6fcd04314: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1aa220ce-0b5a-46f1-b27a-2cc6fcd04314', 'volume_size': 1} Jul 28 10:39:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-bb30d7f1-55cc-4edb-a465-67574bf7a213 tempest-AttachVolumeShelveTestJSON-225488613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:39:58 devstack sudo[93705]: pam_unix(sudo:session): session closed for user root Jul 28 10:39:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-113cc7e1-848c-4efc-aa4e-dae80d9000bc tempest-VolumeRetypeWithoutMigrationTest-335376717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a980d77b-75d5-4088-be09-27136da2be08" returned: 0 in 0.404s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:39:58 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-113cc7e1-848c-4efc-aa4e-dae80d9000bc tempest-VolumeRetypeWithoutMigrationTest-335376717 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:39:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-113cc7e1-848c-4efc-aa4e-dae80d9000bc tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:39:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-bb30d7f1-55cc-4edb-a465-67574bf7a213 tempest-AttachVolumeShelveTestJSON-225488613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.098s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:39:58 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-bb30d7f1-55cc-4edb-a465-67574bf7a213 tempest-AttachVolumeShelveTestJSON-225488613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1021626126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aa220ce-0b5a-46f1-b27a-2cc6fcd04314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0464405ca9c7440a8ecfc9d2b7af6843',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:39:58Z,use_quota=True,user_id='34f587c2a73f44f5aeabe75f81c562af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:39:58 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-bb30d7f1-55cc-4edb-a465-67574bf7a213 tempest-AttachVolumeShelveTestJSON-225488613 None] Creating volume 1aa220ce-0b5a-46f1-b27a-2cc6fcd04314 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:39:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-bb30d7f1-55cc-4edb-a465-67574bf7a213 tempest-AttachVolumeShelveTestJSON-225488613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:39:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-bb30d7f1-55cc-4edb-a465-67574bf7a213 tempest-AttachVolumeShelveTestJSON-225488613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:39:58 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-bb30d7f1-55cc-4edb-a465-67574bf7a213 tempest-AttachVolumeShelveTestJSON-225488613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:39:58 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-bb30d7f1-55cc-4edb-a465-67574bf7a213 tempest-AttachVolumeShelveTestJSON-225488613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:39:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-bb30d7f1-55cc-4edb-a465-67574bf7a213 tempest-AttachVolumeShelveTestJSON-225488613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:39:58 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-bb30d7f1-55cc-4edb-a465-67574bf7a213 tempest-AttachVolumeShelveTestJSON-225488613 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:39:58 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-bb30d7f1-55cc-4edb-a465-67574bf7a213 tempest-AttachVolumeShelveTestJSON-225488613 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:39:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bb30d7f1-55cc-4edb-a465-67574bf7a213 tempest-AttachVolumeShelveTestJSON-225488613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1aa220ce-0b5a-46f1-b27a-2cc6fcd04314 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:39:58 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-113cc7e1-848c-4efc-aa4e-dae80d9000bc tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (387f8d4c-3423-4a5d-abb5-33aaa60b4ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a980d77b-75d5-4088-be09-27136da2be08', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:39:58 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-113cc7e1-848c-4efc-aa4e-dae80d9000bc tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bd23777-6d58-497c-bee3-0ab3a0662208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:39:58 devstack sudo[93721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1aa220ce-0b5a-46f1-b27a-2cc6fcd04314 1073741824 Jul 28 10:39:58 devstack sudo[93721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:39:58 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-113cc7e1-848c-4efc-aa4e-dae80d9000bc tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Volume volume-a980d77b-75d5-4088-be09-27136da2be08 (a980d77b-75d5-4088-be09-27136da2be08): created successfully Jul 28 10:39:58 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-113cc7e1-848c-4efc-aa4e-dae80d9000bc tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bd23777-6d58-497c-bee3-0ab3a0662208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:39:58 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-113cc7e1-848c-4efc-aa4e-dae80d9000bc tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Flow 'volume_create_manager' (a80779c7-f8a9-4998-b65d-aedf6cb38128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:39:58 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-113cc7e1-848c-4efc-aa4e-dae80d9000bc tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Created volume successfully. Jul 28 10:39:58 devstack sudo[93721]: pam_unix(sudo:session): session closed for user root Jul 28 10:39:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bb30d7f1-55cc-4edb-a465-67574bf7a213 tempest-AttachVolumeShelveTestJSON-225488613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1aa220ce-0b5a-46f1-b27a-2cc6fcd04314 1073741824" returned: 0 in 0.808s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:39:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bb30d7f1-55cc-4edb-a465-67574bf7a213 tempest-AttachVolumeShelveTestJSON-225488613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1aa220ce-0b5a-46f1-b27a-2cc6fcd04314 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:39:59 devstack sudo[93754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1aa220ce-0b5a-46f1-b27a-2cc6fcd04314 Jul 28 10:39:59 devstack sudo[93754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:39:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-2a13397e-85b2-4918-802c-fc4eaf5c8ab6 tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:39:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-2a13397e-85b2-4918-802c-fc4eaf5c8ab6 tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:39:59 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-2a13397e-85b2-4918-802c-fc4eaf5c8ab6 tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:39:59 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-2a13397e-85b2-4918-802c-fc4eaf5c8ab6 tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:39:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-2a13397e-85b2-4918-802c-fc4eaf5c8ab6 tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:39:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2a13397e-85b2-4918-802c-fc4eaf5c8ab6 tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:39:59 devstack sudo[93757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:39:59 devstack sudo[93757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:39:59 devstack sudo[93754]: pam_unix(sudo:session): session closed for user root Jul 28 10:39:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bb30d7f1-55cc-4edb-a465-67574bf7a213 tempest-AttachVolumeShelveTestJSON-225488613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1aa220ce-0b5a-46f1-b27a-2cc6fcd04314" returned: 0 in 0.407s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:39:59 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-bb30d7f1-55cc-4edb-a465-67574bf7a213 tempest-AttachVolumeShelveTestJSON-225488613 None] <== create_volume: return (1343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:39:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-bb30d7f1-55cc-4edb-a465-67574bf7a213 tempest-AttachVolumeShelveTestJSON-225488613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:39:59 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bb30d7f1-55cc-4edb-a465-67574bf7a213 tempest-AttachVolumeShelveTestJSON-225488613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed62108-d4d5-468d-8f0c-04a9cd9dca80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aa220ce-0b5a-46f1-b27a-2cc6fcd04314', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:39:59 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bb30d7f1-55cc-4edb-a465-67574bf7a213 tempest-AttachVolumeShelveTestJSON-225488613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c521e4-13e1-4ad5-81de-ba02ddfdf139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:39:59 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-bb30d7f1-55cc-4edb-a465-67574bf7a213 tempest-AttachVolumeShelveTestJSON-225488613 None] Volume volume-1aa220ce-0b5a-46f1-b27a-2cc6fcd04314 (1aa220ce-0b5a-46f1-b27a-2cc6fcd04314): created successfully Jul 28 10:39:59 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bb30d7f1-55cc-4edb-a465-67574bf7a213 tempest-AttachVolumeShelveTestJSON-225488613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c521e4-13e1-4ad5-81de-ba02ddfdf139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:39:59 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bb30d7f1-55cc-4edb-a465-67574bf7a213 tempest-AttachVolumeShelveTestJSON-225488613 None] Flow 'volume_create_manager' (da0c0cf0-bf2b-491c-bd29-778c248e3913) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:39:59 devstack sudo[93757]: pam_unix(sudo:session): session closed for user root Jul 28 10:39:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2a13397e-85b2-4918-802c-fc4eaf5c8ab6 tempest-VolumeRetypeWithoutMigrationTest-335376717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.335s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:39:59 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-2a13397e-85b2-4918-802c-fc4eaf5c8ab6 tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:39:59 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-2a13397e-85b2-4918-802c-fc4eaf5c8ab6 tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Retype volume completed successfully. Jul 28 10:39:59 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-bb30d7f1-55cc-4edb-a465-67574bf7a213 tempest-AttachVolumeShelveTestJSON-225488613 None] Created volume successfully. Jul 28 10:40:01 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-27d7d47a-10d7-4141-876a-8efea882fc7b tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Acquiring lock "cinder-a980d77b-75d5-4088-be09-27136da2be08-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:40:01 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-27d7d47a-10d7-4141-876a-8efea882fc7b tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Lock "cinder-a980d77b-75d5-4088-be09-27136da2be08-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:40:01 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-27d7d47a-10d7-4141-876a-8efea882fc7b tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Acquiring lock "cinder-quobyte-a980d77b-75d5-4088-be09-27136da2be08" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:40:01 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-27d7d47a-10d7-4141-876a-8efea882fc7b tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Lock "cinder-quobyte-a980d77b-75d5-4088-be09-27136da2be08" acquired by "delete_volume" :: waited 0.062s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:40:01 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bcf700-16ff-4785-afd3-36719f156f51]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:40:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-27d7d47a-10d7-4141-876a-8efea882fc7b tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a980d77b-75d5-4088-be09-27136da2be08 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:40:01 devstack sudo[93814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a980d77b-75d5-4088-be09-27136da2be08 Jul 28 10:40:01 devstack sudo[93814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:40:02 devstack sudo[93814]: pam_unix(sudo:session): session closed for user root Jul 28 10:40:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-27d7d47a-10d7-4141-876a-8efea882fc7b tempest-VolumeRetypeWithoutMigrationTest-335376717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a980d77b-75d5-4088-be09-27136da2be08" returned: 0 in 1.385s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:40:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-27d7d47a-10d7-4141-876a-8efea882fc7b tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a980d77b-75d5-4088-be09-27136da2be08 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:40:02 devstack sudo[93855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a980d77b-75d5-4088-be09-27136da2be08 Jul 28 10:40:02 devstack sudo[93855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:40:03 devstack sudo[93855]: pam_unix(sudo:session): session closed for user root Jul 28 10:40:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-27d7d47a-10d7-4141-876a-8efea882fc7b tempest-VolumeRetypeWithoutMigrationTest-335376717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a980d77b-75d5-4088-be09-27136da2be08" returned: 0 in 0.644s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:40:03 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-27d7d47a-10d7-4141-876a-8efea882fc7b tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Lock "cinder-quobyte-a980d77b-75d5-4088-be09-27136da2be08" released by "delete_volume" :: held 2.142s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:40:03 devstack cinder-volume[88413]: WARNING cinder.quota [None req-27d7d47a-10d7-4141-876a-8efea882fc7b tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 28 10:40:03 devstack cinder-volume[88413]: WARNING cinder.quota [None req-27d7d47a-10d7-4141-876a-8efea882fc7b tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 28 10:40:03 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-27d7d47a-10d7-4141-876a-8efea882fc7b tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Created reservations ['1d084921-7661-45f6-9640-9d4cca6ba643', '3f44d8f2-1857-4f0b-9243-cf35bb2ec268', '260c3ee3-62a2-4943-b7c9-6e01648ca88d', '5b8c3250-60d8-4bc6-8087-dc68dd70af2a'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:40:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-27d7d47a-10d7-4141-876a-8efea882fc7b tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:40:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-27d7d47a-10d7-4141-876a-8efea882fc7b tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:40:04 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-27d7d47a-10d7-4141-876a-8efea882fc7b tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:40:04 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-27d7d47a-10d7-4141-876a-8efea882fc7b tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:40:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-27d7d47a-10d7-4141-876a-8efea882fc7b tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:40:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-27d7d47a-10d7-4141-876a-8efea882fc7b tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:40:04 devstack sudo[93881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:40:04 devstack sudo[93881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:40:04 devstack sudo[93881]: pam_unix(sudo:session): session closed for user root Jul 28 10:40:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-27d7d47a-10d7-4141-876a-8efea882fc7b tempest-VolumeRetypeWithoutMigrationTest-335376717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.479s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:40:04 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-27d7d47a-10d7-4141-876a-8efea882fc7b tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:40:04 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-27d7d47a-10d7-4141-876a-8efea882fc7b tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Deleted volume successfully. Jul 28 10:40:04 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-27d7d47a-10d7-4141-876a-8efea882fc7b tempest-VolumeRetypeWithoutMigrationTest-335376717 None] Lock "cinder-a980d77b-75d5-4088-be09-27136da2be08-delete_volume" released by "delete_volume" :: held 3.360s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:40:13 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:UPDATE=19,cinder:SELECT=12,cinder:DELETE=1,cinder:INSERT=2 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:40:14 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=20,cinder:UPDATE=18,cinder:INSERT=4,cinder:DELETE=2 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:40:19 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-e29adbbb-0e77-48e0-9934-8a6e90df1f31 tempest-VolumesServicesTestJSON-348295844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:40:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e29adbbb-0e77-48e0-9934-8a6e90df1f31 tempest-VolumesServicesTestJSON-348295844 None] Flow 'volume_create_manager' (71c15543-70b3-4452-8b64-d1a32f770351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:40:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e29adbbb-0e77-48e0-9934-8a6e90df1f31 tempest-VolumesServicesTestJSON-348295844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b7f9a2-0547-42c4-b7a2-63300e7fc0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:40:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e29adbbb-0e77-48e0-9934-8a6e90df1f31 tempest-VolumesServicesTestJSON-348295844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b7f9a2-0547-42c4-b7a2-63300e7fc0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1486159751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=223d4261-1f73-4407-bc90-62bf96a0adf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a6aed316d8a45a2b36d371c216954bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:40:19Z,use_quota=True,user_id='1ffd6d4547664e63a2bc7f39cfe87479',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:40:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e29adbbb-0e77-48e0-9934-8a6e90df1f31 tempest-VolumesServicesTestJSON-348295844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb1ee43-c724-4c64-81c5-ea145810320a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:40:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e29adbbb-0e77-48e0-9934-8a6e90df1f31 tempest-VolumesServicesTestJSON-348295844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb1ee43-c724-4c64-81c5-ea145810320a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:40:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e29adbbb-0e77-48e0-9934-8a6e90df1f31 tempest-VolumesServicesTestJSON-348295844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f00e465a-d6eb-492b-ba96-65b8a27fdf39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:40:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e29adbbb-0e77-48e0-9934-8a6e90df1f31 tempest-VolumesServicesTestJSON-348295844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f00e465a-d6eb-492b-ba96-65b8a27fdf39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '223d4261-1f73-4407-bc90-62bf96a0adf1', 'volume_name': 'volume-223d4261-1f73-4407-bc90-62bf96a0adf1', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:40:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e29adbbb-0e77-48e0-9934-8a6e90df1f31 tempest-VolumesServicesTestJSON-348295844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (409cb40c-0e34-48f5-8891-67d6f439ba13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:40:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e29adbbb-0e77-48e0-9934-8a6e90df1f31 tempest-VolumesServicesTestJSON-348295844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (409cb40c-0e34-48f5-8891-67d6f439ba13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:40:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e29adbbb-0e77-48e0-9934-8a6e90df1f31 tempest-VolumesServicesTestJSON-348295844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (609bb884-e457-4579-80bc-b2f641ff31ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:40:19 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-e29adbbb-0e77-48e0-9934-8a6e90df1f31 tempest-VolumesServicesTestJSON-348295844 None] Volume 223d4261-1f73-4407-bc90-62bf96a0adf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-223d4261-1f73-4407-bc90-62bf96a0adf1', 'volume_size': 1} Jul 28 10:40:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e29adbbb-0e77-48e0-9934-8a6e90df1f31 tempest-VolumesServicesTestJSON-348295844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:40:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e29adbbb-0e77-48e0-9934-8a6e90df1f31 tempest-VolumesServicesTestJSON-348295844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:40:19 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e29adbbb-0e77-48e0-9934-8a6e90df1f31 tempest-VolumesServicesTestJSON-348295844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1486159751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=223d4261-1f73-4407-bc90-62bf96a0adf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a6aed316d8a45a2b36d371c216954bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:40:19Z,use_quota=True,user_id='1ffd6d4547664e63a2bc7f39cfe87479',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:40:19 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-e29adbbb-0e77-48e0-9934-8a6e90df1f31 tempest-VolumesServicesTestJSON-348295844 None] Creating volume 223d4261-1f73-4407-bc90-62bf96a0adf1 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:40:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e29adbbb-0e77-48e0-9934-8a6e90df1f31 tempest-VolumesServicesTestJSON-348295844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:40:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e29adbbb-0e77-48e0-9934-8a6e90df1f31 tempest-VolumesServicesTestJSON-348295844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:40:19 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e29adbbb-0e77-48e0-9934-8a6e90df1f31 tempest-VolumesServicesTestJSON-348295844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:40:19 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e29adbbb-0e77-48e0-9934-8a6e90df1f31 tempest-VolumesServicesTestJSON-348295844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:40:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e29adbbb-0e77-48e0-9934-8a6e90df1f31 tempest-VolumesServicesTestJSON-348295844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:40:19 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e29adbbb-0e77-48e0-9934-8a6e90df1f31 tempest-VolumesServicesTestJSON-348295844 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:40:19 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-e29adbbb-0e77-48e0-9934-8a6e90df1f31 tempest-VolumesServicesTestJSON-348295844 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:40:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e29adbbb-0e77-48e0-9934-8a6e90df1f31 tempest-VolumesServicesTestJSON-348295844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-223d4261-1f73-4407-bc90-62bf96a0adf1 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:40:19 devstack sudo[94115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-223d4261-1f73-4407-bc90-62bf96a0adf1 1073741824 Jul 28 10:40:19 devstack sudo[94115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:40:20 devstack sudo[94115]: pam_unix(sudo:session): session closed for user root Jul 28 10:40:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e29adbbb-0e77-48e0-9934-8a6e90df1f31 tempest-VolumesServicesTestJSON-348295844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-223d4261-1f73-4407-bc90-62bf96a0adf1 1073741824" returned: 0 in 0.687s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:40:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e29adbbb-0e77-48e0-9934-8a6e90df1f31 tempest-VolumesServicesTestJSON-348295844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-223d4261-1f73-4407-bc90-62bf96a0adf1 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:40:20 devstack sudo[94121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-223d4261-1f73-4407-bc90-62bf96a0adf1 Jul 28 10:40:20 devstack sudo[94121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:40:20 devstack sudo[94121]: pam_unix(sudo:session): session closed for user root Jul 28 10:40:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e29adbbb-0e77-48e0-9934-8a6e90df1f31 tempest-VolumesServicesTestJSON-348295844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-223d4261-1f73-4407-bc90-62bf96a0adf1" returned: 0 in 0.426s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:40:20 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e29adbbb-0e77-48e0-9934-8a6e90df1f31 tempest-VolumesServicesTestJSON-348295844 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:40:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e29adbbb-0e77-48e0-9934-8a6e90df1f31 tempest-VolumesServicesTestJSON-348295844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:40:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e29adbbb-0e77-48e0-9934-8a6e90df1f31 tempest-VolumesServicesTestJSON-348295844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (609bb884-e457-4579-80bc-b2f641ff31ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-223d4261-1f73-4407-bc90-62bf96a0adf1', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:40:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e29adbbb-0e77-48e0-9934-8a6e90df1f31 tempest-VolumesServicesTestJSON-348295844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b62e52-528c-43ca-a456-41fcf7ba91ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:40:20 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-e29adbbb-0e77-48e0-9934-8a6e90df1f31 tempest-VolumesServicesTestJSON-348295844 None] Volume volume-223d4261-1f73-4407-bc90-62bf96a0adf1 (223d4261-1f73-4407-bc90-62bf96a0adf1): created successfully Jul 28 10:40:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e29adbbb-0e77-48e0-9934-8a6e90df1f31 tempest-VolumesServicesTestJSON-348295844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b62e52-528c-43ca-a456-41fcf7ba91ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:40:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e29adbbb-0e77-48e0-9934-8a6e90df1f31 tempest-VolumesServicesTestJSON-348295844 None] Flow 'volume_create_manager' (71c15543-70b3-4452-8b64-d1a32f770351) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:40:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-c327136f-d284-4c41-86a0-92aebba4021a req-80596886-e4bd-4d19-8bf9-af7c9f51a1b9 tempest-AttachVolumeShelveTestJSON-225488613 None] No connector for attachment b2f99a49-7834-4b82-9f41-00cb7d052fc6; skipping storage backend terminate_connection call. {{(pid=88413) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 28 10:40:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-c327136f-d284-4c41-86a0-92aebba4021a req-80596886-e4bd-4d19-8bf9-af7c9f51a1b9 tempest-AttachVolumeShelveTestJSON-225488613 None] Deleting attachment b2f99a49-7834-4b82-9f41-00cb7d052fc6. {{(pid=88413) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 10:40:20 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-e29adbbb-0e77-48e0-9934-8a6e90df1f31 tempest-VolumesServicesTestJSON-348295844 None] Created volume successfully. Jul 28 10:40:21 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-adba241f-cfda-40b4-bdd5-6715c862ef22 tempest-VolumesServicesTestJSON-348295844 None] Acquiring lock "cinder-223d4261-1f73-4407-bc90-62bf96a0adf1-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:40:21 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-adba241f-cfda-40b4-bdd5-6715c862ef22 tempest-VolumesServicesTestJSON-348295844 None] Lock "cinder-223d4261-1f73-4407-bc90-62bf96a0adf1-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:40:21 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-adba241f-cfda-40b4-bdd5-6715c862ef22 tempest-VolumesServicesTestJSON-348295844 None] Acquiring lock "cinder-quobyte-223d4261-1f73-4407-bc90-62bf96a0adf1" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:40:21 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5e16615-ff91-4663-bf0a-28abb5f9fee4 tempest-ServerRescueNegativeTestJSON-1357749693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:40:21 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d5e16615-ff91-4663-bf0a-28abb5f9fee4 tempest-ServerRescueNegativeTestJSON-1357749693 None] Flow 'volume_create_manager' (7a76348e-98e2-4e5e-bbbb-abb057db2614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:40:21 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d5e16615-ff91-4663-bf0a-28abb5f9fee4 tempest-ServerRescueNegativeTestJSON-1357749693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (819772ae-f6e2-4aea-9206-16dcc752497a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:40:21 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-adba241f-cfda-40b4-bdd5-6715c862ef22 tempest-VolumesServicesTestJSON-348295844 None] Lock "cinder-quobyte-223d4261-1f73-4407-bc90-62bf96a0adf1" acquired by "delete_volume" :: waited 0.055s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:40:22 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d5e16615-ff91-4663-bf0a-28abb5f9fee4 tempest-ServerRescueNegativeTestJSON-1357749693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (819772ae-f6e2-4aea-9206-16dcc752497a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-523151872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4ecd20c-2009-4bb7-b3fd-9ca9b1281efa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='898e229353884b32a9fdec7da82d14b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:40:22Z,use_quota=True,user_id='e5241b0e4a904ca28fab8b64df0e47e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:40:22 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d5e16615-ff91-4663-bf0a-28abb5f9fee4 tempest-ServerRescueNegativeTestJSON-1357749693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bfdfb3d-e7a7-4903-883d-b9cb46914045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:40:22 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d5e16615-ff91-4663-bf0a-28abb5f9fee4 tempest-ServerRescueNegativeTestJSON-1357749693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bfdfb3d-e7a7-4903-883d-b9cb46914045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:40:22 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d5e16615-ff91-4663-bf0a-28abb5f9fee4 tempest-ServerRescueNegativeTestJSON-1357749693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91120552-1fc5-415b-a6db-94c606a3467b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:40:22 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d5e16615-ff91-4663-bf0a-28abb5f9fee4 tempest-ServerRescueNegativeTestJSON-1357749693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91120552-1fc5-415b-a6db-94c606a3467b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4ecd20c-2009-4bb7-b3fd-9ca9b1281efa', 'volume_name': 'volume-c4ecd20c-2009-4bb7-b3fd-9ca9b1281efa', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:40:22 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d5e16615-ff91-4663-bf0a-28abb5f9fee4 tempest-ServerRescueNegativeTestJSON-1357749693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eed8642-f438-4df2-80a0-1916b9ed0ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:40:22 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d5e16615-ff91-4663-bf0a-28abb5f9fee4 tempest-ServerRescueNegativeTestJSON-1357749693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eed8642-f438-4df2-80a0-1916b9ed0ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:40:22 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d5e16615-ff91-4663-bf0a-28abb5f9fee4 tempest-ServerRescueNegativeTestJSON-1357749693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (408b9cc9-5f36-4902-95c8-9691df2b5d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:40:22 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-d5e16615-ff91-4663-bf0a-28abb5f9fee4 tempest-ServerRescueNegativeTestJSON-1357749693 None] Volume c4ecd20c-2009-4bb7-b3fd-9ca9b1281efa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4ecd20c-2009-4bb7-b3fd-9ca9b1281efa', 'volume_size': 1} Jul 28 10:40:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d5e16615-ff91-4663-bf0a-28abb5f9fee4 tempest-ServerRescueNegativeTestJSON-1357749693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:40:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d5e16615-ff91-4663-bf0a-28abb5f9fee4 tempest-ServerRescueNegativeTestJSON-1357749693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:40:22 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-d5e16615-ff91-4663-bf0a-28abb5f9fee4 tempest-ServerRescueNegativeTestJSON-1357749693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-523151872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4ecd20c-2009-4bb7-b3fd-9ca9b1281efa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='898e229353884b32a9fdec7da82d14b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:40:22Z,use_quota=True,user_id='e5241b0e4a904ca28fab8b64df0e47e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:40:22 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-d5e16615-ff91-4663-bf0a-28abb5f9fee4 tempest-ServerRescueNegativeTestJSON-1357749693 None] Creating volume c4ecd20c-2009-4bb7-b3fd-9ca9b1281efa {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:40:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d5e16615-ff91-4663-bf0a-28abb5f9fee4 tempest-ServerRescueNegativeTestJSON-1357749693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:40:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d5e16615-ff91-4663-bf0a-28abb5f9fee4 tempest-ServerRescueNegativeTestJSON-1357749693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:40:22 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-d5e16615-ff91-4663-bf0a-28abb5f9fee4 tempest-ServerRescueNegativeTestJSON-1357749693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:40:22 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-d5e16615-ff91-4663-bf0a-28abb5f9fee4 tempest-ServerRescueNegativeTestJSON-1357749693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:40:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d5e16615-ff91-4663-bf0a-28abb5f9fee4 tempest-ServerRescueNegativeTestJSON-1357749693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:40:22 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-d5e16615-ff91-4663-bf0a-28abb5f9fee4 tempest-ServerRescueNegativeTestJSON-1357749693 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:40:22 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-d5e16615-ff91-4663-bf0a-28abb5f9fee4 tempest-ServerRescueNegativeTestJSON-1357749693 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:40:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d5e16615-ff91-4663-bf0a-28abb5f9fee4 tempest-ServerRescueNegativeTestJSON-1357749693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c4ecd20c-2009-4bb7-b3fd-9ca9b1281efa 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:40:22 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[19195f5b-c6e1-4953-82c9-7ee6fa2f9e08]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:40:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-adba241f-cfda-40b4-bdd5-6715c862ef22 tempest-VolumesServicesTestJSON-348295844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-223d4261-1f73-4407-bc90-62bf96a0adf1 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:40:22 devstack sudo[94125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c4ecd20c-2009-4bb7-b3fd-9ca9b1281efa 1073741824 Jul 28 10:40:22 devstack sudo[94125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:40:22 devstack sudo[94126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-223d4261-1f73-4407-bc90-62bf96a0adf1 Jul 28 10:40:22 devstack sudo[94126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:40:22 devstack sudo[94126]: pam_unix(sudo:session): session closed for user root Jul 28 10:40:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-adba241f-cfda-40b4-bdd5-6715c862ef22 tempest-VolumesServicesTestJSON-348295844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-223d4261-1f73-4407-bc90-62bf96a0adf1" returned: 0 in 0.565s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:40:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-adba241f-cfda-40b4-bdd5-6715c862ef22 tempest-VolumesServicesTestJSON-348295844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-223d4261-1f73-4407-bc90-62bf96a0adf1 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:40:22 devstack sudo[94141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-223d4261-1f73-4407-bc90-62bf96a0adf1 Jul 28 10:40:22 devstack sudo[94141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:40:22 devstack sudo[94125]: pam_unix(sudo:session): session closed for user root Jul 28 10:40:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d5e16615-ff91-4663-bf0a-28abb5f9fee4 tempest-ServerRescueNegativeTestJSON-1357749693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c4ecd20c-2009-4bb7-b3fd-9ca9b1281efa 1073741824" returned: 0 in 0.834s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:40:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d5e16615-ff91-4663-bf0a-28abb5f9fee4 tempest-ServerRescueNegativeTestJSON-1357749693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c4ecd20c-2009-4bb7-b3fd-9ca9b1281efa {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:40:23 devstack sudo[94175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c4ecd20c-2009-4bb7-b3fd-9ca9b1281efa Jul 28 10:40:23 devstack sudo[94175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:40:23 devstack sudo[94141]: pam_unix(sudo:session): session closed for user root Jul 28 10:40:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-adba241f-cfda-40b4-bdd5-6715c862ef22 tempest-VolumesServicesTestJSON-348295844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-223d4261-1f73-4407-bc90-62bf96a0adf1" returned: 0 in 0.731s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:40:23 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-adba241f-cfda-40b4-bdd5-6715c862ef22 tempest-VolumesServicesTestJSON-348295844 None] Lock "cinder-quobyte-223d4261-1f73-4407-bc90-62bf96a0adf1" released by "delete_volume" :: held 1.463s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:40:23 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-adba241f-cfda-40b4-bdd5-6715c862ef22 tempest-VolumesServicesTestJSON-348295844 None] Created reservations ['e8a22d0c-95dd-4e44-8c84-e3dcd7887442', 'c96153bc-bccc-42b1-8152-bb824feeada9', '4accd7b6-e478-462f-b7d8-112ca7053fd8', 'dd0c38d3-cde7-45ee-85d9-1df5066de009'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:40:23 devstack sudo[94175]: pam_unix(sudo:session): session closed for user root Jul 28 10:40:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d5e16615-ff91-4663-bf0a-28abb5f9fee4 tempest-ServerRescueNegativeTestJSON-1357749693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c4ecd20c-2009-4bb7-b3fd-9ca9b1281efa" returned: 0 in 0.660s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:40:23 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-d5e16615-ff91-4663-bf0a-28abb5f9fee4 tempest-ServerRescueNegativeTestJSON-1357749693 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:40:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d5e16615-ff91-4663-bf0a-28abb5f9fee4 tempest-ServerRescueNegativeTestJSON-1357749693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:40:23 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d5e16615-ff91-4663-bf0a-28abb5f9fee4 tempest-ServerRescueNegativeTestJSON-1357749693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (408b9cc9-5f36-4902-95c8-9691df2b5d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4ecd20c-2009-4bb7-b3fd-9ca9b1281efa', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:40:23 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d5e16615-ff91-4663-bf0a-28abb5f9fee4 tempest-ServerRescueNegativeTestJSON-1357749693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da13f07c-bd7e-4583-804a-3b0b4c78e1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:40:23 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-d5e16615-ff91-4663-bf0a-28abb5f9fee4 tempest-ServerRescueNegativeTestJSON-1357749693 None] Volume volume-c4ecd20c-2009-4bb7-b3fd-9ca9b1281efa (c4ecd20c-2009-4bb7-b3fd-9ca9b1281efa): created successfully Jul 28 10:40:23 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d5e16615-ff91-4663-bf0a-28abb5f9fee4 tempest-ServerRescueNegativeTestJSON-1357749693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da13f07c-bd7e-4583-804a-3b0b4c78e1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:40:23 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d5e16615-ff91-4663-bf0a-28abb5f9fee4 tempest-ServerRescueNegativeTestJSON-1357749693 None] Flow 'volume_create_manager' (7a76348e-98e2-4e5e-bbbb-abb057db2614) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:40:23 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-d5e16615-ff91-4663-bf0a-28abb5f9fee4 tempest-ServerRescueNegativeTestJSON-1357749693 None] Created volume successfully. Jul 28 10:40:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-adba241f-cfda-40b4-bdd5-6715c862ef22 tempest-VolumesServicesTestJSON-348295844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:40:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-adba241f-cfda-40b4-bdd5-6715c862ef22 tempest-VolumesServicesTestJSON-348295844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:40:23 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-adba241f-cfda-40b4-bdd5-6715c862ef22 tempest-VolumesServicesTestJSON-348295844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:40:23 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-adba241f-cfda-40b4-bdd5-6715c862ef22 tempest-VolumesServicesTestJSON-348295844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:40:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-adba241f-cfda-40b4-bdd5-6715c862ef22 tempest-VolumesServicesTestJSON-348295844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:40:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-adba241f-cfda-40b4-bdd5-6715c862ef22 tempest-VolumesServicesTestJSON-348295844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:40:23 devstack sudo[94179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:40:23 devstack sudo[94179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:40:24 devstack sudo[94179]: pam_unix(sudo:session): session closed for user root Jul 28 10:40:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-adba241f-cfda-40b4-bdd5-6715c862ef22 tempest-VolumesServicesTestJSON-348295844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.361s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:40:24 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-adba241f-cfda-40b4-bdd5-6715c862ef22 tempest-VolumesServicesTestJSON-348295844 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:40:24 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-adba241f-cfda-40b4-bdd5-6715c862ef22 tempest-VolumesServicesTestJSON-348295844 None] Deleted volume successfully. Jul 28 10:40:24 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-adba241f-cfda-40b4-bdd5-6715c862ef22 tempest-VolumesServicesTestJSON-348295844 None] Lock "cinder-223d4261-1f73-4407-bc90-62bf96a0adf1-delete_volume" released by "delete_volume" :: held 2.601s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:40:28 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:40:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:40:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:40:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:40:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:40:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:40:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:40:28 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f45750e-49d7-4572-89b8-6170a45b62e2 tempest-AttachVolumeTestJSON-250152809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:40:28 devstack sudo[94226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:40:28 devstack sudo[94226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:40:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7f45750e-49d7-4572-89b8-6170a45b62e2 tempest-AttachVolumeTestJSON-250152809 None] Flow 'volume_create_manager' (11f633d2-34c0-4c35-8550-11718c1e7479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:40:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7f45750e-49d7-4572-89b8-6170a45b62e2 tempest-AttachVolumeTestJSON-250152809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d120981b-1df6-40dd-a9b1-0f18c47df51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:40:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7f45750e-49d7-4572-89b8-6170a45b62e2 tempest-AttachVolumeTestJSON-250152809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d120981b-1df6-40dd-a9b1-0f18c47df51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-271912456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a2d5ed5-b694-425a-9433-b1c11fd82dac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='150a704735fe48429f68233c33fa87d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:40:28Z,use_quota=True,user_id='475d9d80f7b3425687e713b19ff704dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:40:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7f45750e-49d7-4572-89b8-6170a45b62e2 tempest-AttachVolumeTestJSON-250152809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfcad004-c2c1-47bb-893e-4a46f3d6ee77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:40:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7f45750e-49d7-4572-89b8-6170a45b62e2 tempest-AttachVolumeTestJSON-250152809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfcad004-c2c1-47bb-893e-4a46f3d6ee77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:40:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7f45750e-49d7-4572-89b8-6170a45b62e2 tempest-AttachVolumeTestJSON-250152809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c66206f1-4a52-48e5-b66a-7d8f2cbf1072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:40:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7f45750e-49d7-4572-89b8-6170a45b62e2 tempest-AttachVolumeTestJSON-250152809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c66206f1-4a52-48e5-b66a-7d8f2cbf1072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a2d5ed5-b694-425a-9433-b1c11fd82dac', 'volume_name': 'volume-7a2d5ed5-b694-425a-9433-b1c11fd82dac', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:40:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7f45750e-49d7-4572-89b8-6170a45b62e2 tempest-AttachVolumeTestJSON-250152809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2844286c-8e3b-4710-993e-062e493360b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:40:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7f45750e-49d7-4572-89b8-6170a45b62e2 tempest-AttachVolumeTestJSON-250152809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2844286c-8e3b-4710-993e-062e493360b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:40:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7f45750e-49d7-4572-89b8-6170a45b62e2 tempest-AttachVolumeTestJSON-250152809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a72533a8-9c59-4af0-bfc8-2c71bf9c5011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:40:28 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-7f45750e-49d7-4572-89b8-6170a45b62e2 tempest-AttachVolumeTestJSON-250152809 None] Volume 7a2d5ed5-b694-425a-9433-b1c11fd82dac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a2d5ed5-b694-425a-9433-b1c11fd82dac', 'volume_size': 1} Jul 28 10:40:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7f45750e-49d7-4572-89b8-6170a45b62e2 tempest-AttachVolumeTestJSON-250152809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:40:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7f45750e-49d7-4572-89b8-6170a45b62e2 tempest-AttachVolumeTestJSON-250152809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:40:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7f45750e-49d7-4572-89b8-6170a45b62e2 tempest-AttachVolumeTestJSON-250152809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-271912456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a2d5ed5-b694-425a-9433-b1c11fd82dac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='150a704735fe48429f68233c33fa87d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:40:28Z,use_quota=True,user_id='475d9d80f7b3425687e713b19ff704dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:40:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-7f45750e-49d7-4572-89b8-6170a45b62e2 tempest-AttachVolumeTestJSON-250152809 None] Creating volume 7a2d5ed5-b694-425a-9433-b1c11fd82dac {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:40:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7f45750e-49d7-4572-89b8-6170a45b62e2 tempest-AttachVolumeTestJSON-250152809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:40:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7f45750e-49d7-4572-89b8-6170a45b62e2 tempest-AttachVolumeTestJSON-250152809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:40:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7f45750e-49d7-4572-89b8-6170a45b62e2 tempest-AttachVolumeTestJSON-250152809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:40:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7f45750e-49d7-4572-89b8-6170a45b62e2 tempest-AttachVolumeTestJSON-250152809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:40:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7f45750e-49d7-4572-89b8-6170a45b62e2 tempest-AttachVolumeTestJSON-250152809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:40:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7f45750e-49d7-4572-89b8-6170a45b62e2 tempest-AttachVolumeTestJSON-250152809 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:40:28 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-7f45750e-49d7-4572-89b8-6170a45b62e2 tempest-AttachVolumeTestJSON-250152809 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:40:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7f45750e-49d7-4572-89b8-6170a45b62e2 tempest-AttachVolumeTestJSON-250152809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7a2d5ed5-b694-425a-9433-b1c11fd82dac 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:40:28 devstack sudo[94231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7a2d5ed5-b694-425a-9433-b1c11fd82dac 1073741824 Jul 28 10:40:28 devstack sudo[94231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:40:28 devstack sudo[94226]: pam_unix(sudo:session): session closed for user root Jul 28 10:40:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.502s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:40:28 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:40:28 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager._thread_info {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:40:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread count: 8 {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 10:40:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread info: [<_MainThread(MainThread, started 137939890385024)>, , , , , , , ] {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 10:40:29 devstack sudo[94231]: pam_unix(sudo:session): session closed for user root Jul 28 10:40:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7f45750e-49d7-4572-89b8-6170a45b62e2 tempest-AttachVolumeTestJSON-250152809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7a2d5ed5-b694-425a-9433-b1c11fd82dac 1073741824" returned: 0 in 1.142s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:40:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7f45750e-49d7-4572-89b8-6170a45b62e2 tempest-AttachVolumeTestJSON-250152809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7a2d5ed5-b694-425a-9433-b1c11fd82dac {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:40:29 devstack sudo[94252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7a2d5ed5-b694-425a-9433-b1c11fd82dac Jul 28 10:40:29 devstack sudo[94252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:40:30 devstack sudo[94252]: pam_unix(sudo:session): session closed for user root Jul 28 10:40:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7f45750e-49d7-4572-89b8-6170a45b62e2 tempest-AttachVolumeTestJSON-250152809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7a2d5ed5-b694-425a-9433-b1c11fd82dac" returned: 0 in 0.511s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:40:30 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7f45750e-49d7-4572-89b8-6170a45b62e2 tempest-AttachVolumeTestJSON-250152809 None] <== create_volume: return (1742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:40:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7f45750e-49d7-4572-89b8-6170a45b62e2 tempest-AttachVolumeTestJSON-250152809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.748s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:40:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7f45750e-49d7-4572-89b8-6170a45b62e2 tempest-AttachVolumeTestJSON-250152809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a72533a8-9c59-4af0-bfc8-2c71bf9c5011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a2d5ed5-b694-425a-9433-b1c11fd82dac', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:40:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7f45750e-49d7-4572-89b8-6170a45b62e2 tempest-AttachVolumeTestJSON-250152809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f0e5ee4-787f-4f53-b654-4d36bdc38a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:40:30 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-7f45750e-49d7-4572-89b8-6170a45b62e2 tempest-AttachVolumeTestJSON-250152809 None] Volume volume-7a2d5ed5-b694-425a-9433-b1c11fd82dac (7a2d5ed5-b694-425a-9433-b1c11fd82dac): created successfully Jul 28 10:40:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7f45750e-49d7-4572-89b8-6170a45b62e2 tempest-AttachVolumeTestJSON-250152809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f0e5ee4-787f-4f53-b654-4d36bdc38a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:40:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7f45750e-49d7-4572-89b8-6170a45b62e2 tempest-AttachVolumeTestJSON-250152809 None] Flow 'volume_create_manager' (11f633d2-34c0-4c35-8550-11718c1e7479) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:40:30 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-7f45750e-49d7-4572-89b8-6170a45b62e2 tempest-AttachVolumeTestJSON-250152809 None] Created volume successfully. Jul 28 10:40:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-adf8b724-11b8-4817-9b42-4d82d79ef63a req-fbe103da-a376-4278-978d-681e2ec6ad38 tempest-AttachVolumeTestJSON-250152809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:40:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-adf8b724-11b8-4817-9b42-4d82d79ef63a req-fbe103da-a376-4278-978d-681e2ec6ad38 tempest-AttachVolumeTestJSON-250152809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:40:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-adf8b724-11b8-4817-9b42-4d82d79ef63a req-fbe103da-a376-4278-978d-681e2ec6ad38 tempest-AttachVolumeTestJSON-250152809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:40:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-adf8b724-11b8-4817-9b42-4d82d79ef63a req-fbe103da-a376-4278-978d-681e2ec6ad38 tempest-AttachVolumeTestJSON-250152809 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7', 'name': 'volume-7a2d5ed5-b694-425a-9433-b1c11fd82dac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '052c78e1-7ad6-46f0-ad24-0e274a21589d', 'enforce_multipath': True} {{(pid=88413) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 10:40:34 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-adf8b724-11b8-4817-9b42-4d82d79ef63a req-fbe103da-a376-4278-978d-681e2ec6ad38 tempest-AttachVolumeTestJSON-250152809 None] attachment_update completed successfully. Jul 28 10:40:38 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-5df695d4-470f-4f4f-8845-bd32a16fc55f tempest-AttachVolumeTestJSON-250152809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:40:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5df695d4-470f-4f4f-8845-bd32a16fc55f tempest-AttachVolumeTestJSON-250152809 None] Flow 'volume_create_manager' (96a9cd2c-8895-4642-8608-482fcb75bd29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:40:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5df695d4-470f-4f4f-8845-bd32a16fc55f tempest-AttachVolumeTestJSON-250152809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23816ee5-5b07-483b-b053-e701eb4993ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:40:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5df695d4-470f-4f4f-8845-bd32a16fc55f tempest-AttachVolumeTestJSON-250152809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23816ee5-5b07-483b-b053-e701eb4993ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1732805825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87eff065-6ddd-4a96-a0e0-11ed9116ddd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='150a704735fe48429f68233c33fa87d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:40:38Z,use_quota=True,user_id='475d9d80f7b3425687e713b19ff704dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:40:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5df695d4-470f-4f4f-8845-bd32a16fc55f tempest-AttachVolumeTestJSON-250152809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3487aadb-c3cd-47fb-8e9d-06db0e8e5dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:40:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5df695d4-470f-4f4f-8845-bd32a16fc55f tempest-AttachVolumeTestJSON-250152809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3487aadb-c3cd-47fb-8e9d-06db0e8e5dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:40:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5df695d4-470f-4f4f-8845-bd32a16fc55f tempest-AttachVolumeTestJSON-250152809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (060097cf-0fc0-44ee-9a58-d1b45f4a474a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:40:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5df695d4-470f-4f4f-8845-bd32a16fc55f tempest-AttachVolumeTestJSON-250152809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (060097cf-0fc0-44ee-9a58-d1b45f4a474a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87eff065-6ddd-4a96-a0e0-11ed9116ddd5', 'volume_name': 'volume-87eff065-6ddd-4a96-a0e0-11ed9116ddd5', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:40:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5df695d4-470f-4f4f-8845-bd32a16fc55f tempest-AttachVolumeTestJSON-250152809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5468772b-40e9-4b2e-9a53-a8691d4ff7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:40:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5df695d4-470f-4f4f-8845-bd32a16fc55f tempest-AttachVolumeTestJSON-250152809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5468772b-40e9-4b2e-9a53-a8691d4ff7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:40:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5df695d4-470f-4f4f-8845-bd32a16fc55f tempest-AttachVolumeTestJSON-250152809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (456d1cf9-77d6-4468-abd3-3df41ea8c5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:40:38 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-5df695d4-470f-4f4f-8845-bd32a16fc55f tempest-AttachVolumeTestJSON-250152809 None] Volume 87eff065-6ddd-4a96-a0e0-11ed9116ddd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87eff065-6ddd-4a96-a0e0-11ed9116ddd5', 'volume_size': 1} Jul 28 10:40:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5df695d4-470f-4f4f-8845-bd32a16fc55f tempest-AttachVolumeTestJSON-250152809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:40:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5df695d4-470f-4f4f-8845-bd32a16fc55f tempest-AttachVolumeTestJSON-250152809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:40:38 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5df695d4-470f-4f4f-8845-bd32a16fc55f tempest-AttachVolumeTestJSON-250152809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1732805825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87eff065-6ddd-4a96-a0e0-11ed9116ddd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='150a704735fe48429f68233c33fa87d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:40:38Z,use_quota=True,user_id='475d9d80f7b3425687e713b19ff704dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:40:38 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-5df695d4-470f-4f4f-8845-bd32a16fc55f tempest-AttachVolumeTestJSON-250152809 None] Creating volume 87eff065-6ddd-4a96-a0e0-11ed9116ddd5 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:40:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5df695d4-470f-4f4f-8845-bd32a16fc55f tempest-AttachVolumeTestJSON-250152809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:40:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5df695d4-470f-4f4f-8845-bd32a16fc55f tempest-AttachVolumeTestJSON-250152809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:40:38 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5df695d4-470f-4f4f-8845-bd32a16fc55f tempest-AttachVolumeTestJSON-250152809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:40:38 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5df695d4-470f-4f4f-8845-bd32a16fc55f tempest-AttachVolumeTestJSON-250152809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:40:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5df695d4-470f-4f4f-8845-bd32a16fc55f tempest-AttachVolumeTestJSON-250152809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:40:38 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5df695d4-470f-4f4f-8845-bd32a16fc55f tempest-AttachVolumeTestJSON-250152809 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:40:38 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-5df695d4-470f-4f4f-8845-bd32a16fc55f tempest-AttachVolumeTestJSON-250152809 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:40:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5df695d4-470f-4f4f-8845-bd32a16fc55f tempest-AttachVolumeTestJSON-250152809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-87eff065-6ddd-4a96-a0e0-11ed9116ddd5 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:40:38 devstack sudo[94868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-87eff065-6ddd-4a96-a0e0-11ed9116ddd5 1073741824 Jul 28 10:40:38 devstack sudo[94868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:40:39 devstack sudo[94868]: pam_unix(sudo:session): session closed for user root Jul 28 10:40:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5df695d4-470f-4f4f-8845-bd32a16fc55f tempest-AttachVolumeTestJSON-250152809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-87eff065-6ddd-4a96-a0e0-11ed9116ddd5 1073741824" returned: 0 in 0.872s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:40:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5df695d4-470f-4f4f-8845-bd32a16fc55f tempest-AttachVolumeTestJSON-250152809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-87eff065-6ddd-4a96-a0e0-11ed9116ddd5 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:40:39 devstack sudo[94876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-87eff065-6ddd-4a96-a0e0-11ed9116ddd5 Jul 28 10:40:39 devstack sudo[94876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:40:40 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-02e57a38-10d8-49e3-9a21-216a305022f3 tempest-ServerRescueNegativeTestJSON-1357749693 None] Acquiring lock "cinder-c4ecd20c-2009-4bb7-b3fd-9ca9b1281efa-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:40:40 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-02e57a38-10d8-49e3-9a21-216a305022f3 tempest-ServerRescueNegativeTestJSON-1357749693 None] Lock "cinder-c4ecd20c-2009-4bb7-b3fd-9ca9b1281efa-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:40:40 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-02e57a38-10d8-49e3-9a21-216a305022f3 tempest-ServerRescueNegativeTestJSON-1357749693 None] Acquiring lock "cinder-quobyte-c4ecd20c-2009-4bb7-b3fd-9ca9b1281efa" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:40:40 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-02e57a38-10d8-49e3-9a21-216a305022f3 tempest-ServerRescueNegativeTestJSON-1357749693 None] Lock "cinder-quobyte-c4ecd20c-2009-4bb7-b3fd-9ca9b1281efa" acquired by "delete_volume" :: waited 0.034s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:40:40 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73d51f7-fec3-46e5-966c-6ea617e81528]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:40:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-02e57a38-10d8-49e3-9a21-216a305022f3 tempest-ServerRescueNegativeTestJSON-1357749693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c4ecd20c-2009-4bb7-b3fd-9ca9b1281efa {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:40:40 devstack sudo[94876]: pam_unix(sudo:session): session closed for user root Jul 28 10:40:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5df695d4-470f-4f4f-8845-bd32a16fc55f tempest-AttachVolumeTestJSON-250152809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-87eff065-6ddd-4a96-a0e0-11ed9116ddd5" returned: 0 in 0.780s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:40:40 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5df695d4-470f-4f4f-8845-bd32a16fc55f tempest-AttachVolumeTestJSON-250152809 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:40:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5df695d4-470f-4f4f-8845-bd32a16fc55f tempest-AttachVolumeTestJSON-250152809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.775s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:40:40 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5df695d4-470f-4f4f-8845-bd32a16fc55f tempest-AttachVolumeTestJSON-250152809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (456d1cf9-77d6-4468-abd3-3df41ea8c5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87eff065-6ddd-4a96-a0e0-11ed9116ddd5', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:40:40 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5df695d4-470f-4f4f-8845-bd32a16fc55f tempest-AttachVolumeTestJSON-250152809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c28c2220-ed4d-4b59-9e78-0f44558a99ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:40:40 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-5df695d4-470f-4f4f-8845-bd32a16fc55f tempest-AttachVolumeTestJSON-250152809 None] Volume volume-87eff065-6ddd-4a96-a0e0-11ed9116ddd5 (87eff065-6ddd-4a96-a0e0-11ed9116ddd5): created successfully Jul 28 10:40:40 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5df695d4-470f-4f4f-8845-bd32a16fc55f tempest-AttachVolumeTestJSON-250152809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c28c2220-ed4d-4b59-9e78-0f44558a99ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:40:40 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5df695d4-470f-4f4f-8845-bd32a16fc55f tempest-AttachVolumeTestJSON-250152809 None] Flow 'volume_create_manager' (96a9cd2c-8895-4642-8608-482fcb75bd29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:40:40 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-5df695d4-470f-4f4f-8845-bd32a16fc55f tempest-AttachVolumeTestJSON-250152809 None] Created volume successfully. Jul 28 10:40:40 devstack sudo[94882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c4ecd20c-2009-4bb7-b3fd-9ca9b1281efa Jul 28 10:40:40 devstack sudo[94882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:40:41 devstack sudo[94882]: pam_unix(sudo:session): session closed for user root Jul 28 10:40:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-02e57a38-10d8-49e3-9a21-216a305022f3 tempest-ServerRescueNegativeTestJSON-1357749693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c4ecd20c-2009-4bb7-b3fd-9ca9b1281efa" returned: 0 in 1.047s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:40:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-02e57a38-10d8-49e3-9a21-216a305022f3 tempest-ServerRescueNegativeTestJSON-1357749693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c4ecd20c-2009-4bb7-b3fd-9ca9b1281efa {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:40:41 devstack sudo[94887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c4ecd20c-2009-4bb7-b3fd-9ca9b1281efa Jul 28 10:40:41 devstack sudo[94887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:40:42 devstack sudo[94887]: pam_unix(sudo:session): session closed for user root Jul 28 10:40:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-02e57a38-10d8-49e3-9a21-216a305022f3 tempest-ServerRescueNegativeTestJSON-1357749693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c4ecd20c-2009-4bb7-b3fd-9ca9b1281efa" returned: 0 in 0.543s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:40:42 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-02e57a38-10d8-49e3-9a21-216a305022f3 tempest-ServerRescueNegativeTestJSON-1357749693 None] Lock "cinder-quobyte-c4ecd20c-2009-4bb7-b3fd-9ca9b1281efa" released by "delete_volume" :: held 1.758s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:40:42 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-02e57a38-10d8-49e3-9a21-216a305022f3 tempest-ServerRescueNegativeTestJSON-1357749693 None] Created reservations ['3afa2ec1-ec77-43cb-b4ee-d3f7b1b2510f', '9d3ed680-b64d-43a4-be14-27b452d71a1e', '14dfe278-c2a2-40f1-b121-73f92839540e', '223ffd69-f5c7-4f48-99b4-72d2a7a78bbe'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:40:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-02e57a38-10d8-49e3-9a21-216a305022f3 tempest-ServerRescueNegativeTestJSON-1357749693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:40:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-02e57a38-10d8-49e3-9a21-216a305022f3 tempest-ServerRescueNegativeTestJSON-1357749693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:40:42 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-02e57a38-10d8-49e3-9a21-216a305022f3 tempest-ServerRescueNegativeTestJSON-1357749693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:40:42 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-02e57a38-10d8-49e3-9a21-216a305022f3 tempest-ServerRescueNegativeTestJSON-1357749693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:40:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-02e57a38-10d8-49e3-9a21-216a305022f3 tempest-ServerRescueNegativeTestJSON-1357749693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:40:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-02e57a38-10d8-49e3-9a21-216a305022f3 tempest-ServerRescueNegativeTestJSON-1357749693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:40:42 devstack sudo[94894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:40:42 devstack sudo[94894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:40:43 devstack sudo[94894]: pam_unix(sudo:session): session closed for user root Jul 28 10:40:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-02e57a38-10d8-49e3-9a21-216a305022f3 tempest-ServerRescueNegativeTestJSON-1357749693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.602s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:40:43 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-02e57a38-10d8-49e3-9a21-216a305022f3 tempest-ServerRescueNegativeTestJSON-1357749693 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:40:43 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-02e57a38-10d8-49e3-9a21-216a305022f3 tempest-ServerRescueNegativeTestJSON-1357749693 None] Deleted volume successfully. Jul 28 10:40:43 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-02e57a38-10d8-49e3-9a21-216a305022f3 tempest-ServerRescueNegativeTestJSON-1357749693 None] Lock "cinder-c4ecd20c-2009-4bb7-b3fd-9ca9b1281efa-delete_volume" released by "delete_volume" :: held 2.919s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:40:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-3c2df94f-3eb4-4972-a0ac-5e309787f165 req-76f81faa-4da9-42de-8ed9-1b16eb0e9a46 tempest-AttachVolumeTestJSON-250152809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:40:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-3c2df94f-3eb4-4972-a0ac-5e309787f165 req-76f81faa-4da9-42de-8ed9-1b16eb0e9a46 tempest-AttachVolumeTestJSON-250152809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:40:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-3c2df94f-3eb4-4972-a0ac-5e309787f165 req-76f81faa-4da9-42de-8ed9-1b16eb0e9a46 tempest-AttachVolumeTestJSON-250152809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:40:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-3c2df94f-3eb4-4972-a0ac-5e309787f165 req-76f81faa-4da9-42de-8ed9-1b16eb0e9a46 tempest-AttachVolumeTestJSON-250152809 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7', 'name': 'volume-87eff065-6ddd-4a96-a0e0-11ed9116ddd5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4015964d-16f4-4788-beca-c9290ff84478', 'enforce_multipath': True} {{(pid=88413) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 10:40:43 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-3c2df94f-3eb4-4972-a0ac-5e309787f165 req-76f81faa-4da9-42de-8ed9-1b16eb0e9a46 tempest-AttachVolumeTestJSON-250152809 None] attachment_update completed successfully. Jul 28 10:40:48 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-a7d9fbf1-8d08-4992-b169-639bcbf2486f req-10d29865-b61c-4625-9f87-2b6a7ed8ceb1 tempest-AttachVolumeTestJSON-250152809 None] Terminate volume connection completed successfully. Jul 28 10:40:48 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-a7d9fbf1-8d08-4992-b169-639bcbf2486f req-10d29865-b61c-4625-9f87-2b6a7ed8ceb1 tempest-AttachVolumeTestJSON-250152809 None] Deleting attachment 052c78e1-7ad6-46f0-ad24-0e274a21589d. {{(pid=88413) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 10:40:50 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-6841bbce-192e-4b24-b5a2-862bdaf244ba req-820a359d-6157-481d-a30f-8898791c8f70 tempest-AttachVolumeTestJSON-250152809 None] Terminate volume connection completed successfully. Jul 28 10:40:50 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-6841bbce-192e-4b24-b5a2-862bdaf244ba req-820a359d-6157-481d-a30f-8898791c8f70 tempest-AttachVolumeTestJSON-250152809 None] Deleting attachment 4015964d-16f4-4788-beca-c9290ff84478. {{(pid=88413) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 10:40:58 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=33,cinder:UPDATE=33,cinder:DELETE=3,cinder:INSERT=9 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:40:59 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3ff80992-31c6-487c-999b-4eefebc5b494 tempest-AttachVolumeTestJSON-250152809 None] Acquiring lock "cinder-87eff065-6ddd-4a96-a0e0-11ed9116ddd5-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:40:59 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3ff80992-31c6-487c-999b-4eefebc5b494 tempest-AttachVolumeTestJSON-250152809 None] Lock "cinder-87eff065-6ddd-4a96-a0e0-11ed9116ddd5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:40:59 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3ff80992-31c6-487c-999b-4eefebc5b494 tempest-AttachVolumeTestJSON-250152809 None] Acquiring lock "cinder-quobyte-87eff065-6ddd-4a96-a0e0-11ed9116ddd5" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:40:59 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3ff80992-31c6-487c-999b-4eefebc5b494 tempest-AttachVolumeTestJSON-250152809 None] Lock "cinder-quobyte-87eff065-6ddd-4a96-a0e0-11ed9116ddd5" acquired by "delete_volume" :: waited 0.017s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:40:59 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a61489d-d015-4b93-8729-137a823a6a2c]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:40:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3ff80992-31c6-487c-999b-4eefebc5b494 tempest-AttachVolumeTestJSON-250152809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-87eff065-6ddd-4a96-a0e0-11ed9116ddd5 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:40:59 devstack sudo[95051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-87eff065-6ddd-4a96-a0e0-11ed9116ddd5 Jul 28 10:40:59 devstack sudo[95051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:40:59 devstack sudo[95051]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3ff80992-31c6-487c-999b-4eefebc5b494 tempest-AttachVolumeTestJSON-250152809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-87eff065-6ddd-4a96-a0e0-11ed9116ddd5" returned: 0 in 0.428s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3ff80992-31c6-487c-999b-4eefebc5b494 tempest-AttachVolumeTestJSON-250152809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-87eff065-6ddd-4a96-a0e0-11ed9116ddd5 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:00 devstack sudo[95056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-87eff065-6ddd-4a96-a0e0-11ed9116ddd5 Jul 28 10:41:00 devstack sudo[95056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:00 devstack sudo[95056]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3ff80992-31c6-487c-999b-4eefebc5b494 tempest-AttachVolumeTestJSON-250152809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-87eff065-6ddd-4a96-a0e0-11ed9116ddd5" returned: 0 in 0.300s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:00 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3ff80992-31c6-487c-999b-4eefebc5b494 tempest-AttachVolumeTestJSON-250152809 None] Lock "cinder-quobyte-87eff065-6ddd-4a96-a0e0-11ed9116ddd5" released by "delete_volume" :: held 0.787s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:41:00 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-3ff80992-31c6-487c-999b-4eefebc5b494 tempest-AttachVolumeTestJSON-250152809 None] Created reservations ['2fec36d1-9a48-4b4f-83c3-1b92d32adf2f', '1b37599e-99e8-42d9-a3ff-83298fa1a395', '9c2c2cd1-9e24-4ee9-a55e-b4068ab2338e', 'd60f6dd6-0526-4c72-9620-b208b841637f'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:41:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3ff80992-31c6-487c-999b-4eefebc5b494 tempest-AttachVolumeTestJSON-250152809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:41:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3ff80992-31c6-487c-999b-4eefebc5b494 tempest-AttachVolumeTestJSON-250152809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:41:00 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3ff80992-31c6-487c-999b-4eefebc5b494 tempest-AttachVolumeTestJSON-250152809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:41:00 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3ff80992-31c6-487c-999b-4eefebc5b494 tempest-AttachVolumeTestJSON-250152809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:41:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3ff80992-31c6-487c-999b-4eefebc5b494 tempest-AttachVolumeTestJSON-250152809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:41:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3ff80992-31c6-487c-999b-4eefebc5b494 tempest-AttachVolumeTestJSON-250152809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:00 devstack sudo[95061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:41:00 devstack sudo[95061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:00 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b65725c7-5487-4fef-a13b-3e62b4ba9b25 tempest-AttachVolumeTestJSON-250152809 None] Acquiring lock "cinder-7a2d5ed5-b694-425a-9433-b1c11fd82dac-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:41:00 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b65725c7-5487-4fef-a13b-3e62b4ba9b25 tempest-AttachVolumeTestJSON-250152809 None] Lock "cinder-7a2d5ed5-b694-425a-9433-b1c11fd82dac-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:41:00 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b65725c7-5487-4fef-a13b-3e62b4ba9b25 tempest-AttachVolumeTestJSON-250152809 None] Acquiring lock "cinder-quobyte-7a2d5ed5-b694-425a-9433-b1c11fd82dac" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:41:00 devstack sudo[95061]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:00 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b65725c7-5487-4fef-a13b-3e62b4ba9b25 tempest-AttachVolumeTestJSON-250152809 None] Lock "cinder-quobyte-7a2d5ed5-b694-425a-9433-b1c11fd82dac" acquired by "delete_volume" :: waited 0.024s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:41:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3ff80992-31c6-487c-999b-4eefebc5b494 tempest-AttachVolumeTestJSON-250152809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.356s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:00 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-3ff80992-31c6-487c-999b-4eefebc5b494 tempest-AttachVolumeTestJSON-250152809 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:41:00 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-3ff80992-31c6-487c-999b-4eefebc5b494 tempest-AttachVolumeTestJSON-250152809 None] Deleted volume successfully. Jul 28 10:41:00 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcc185c-8674-487f-b4d0-2f80e6c4d7c1]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:41:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b65725c7-5487-4fef-a13b-3e62b4ba9b25 tempest-AttachVolumeTestJSON-250152809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7a2d5ed5-b694-425a-9433-b1c11fd82dac {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:00 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3ff80992-31c6-487c-999b-4eefebc5b494 tempest-AttachVolumeTestJSON-250152809 None] Lock "cinder-87eff065-6ddd-4a96-a0e0-11ed9116ddd5-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:41:00 devstack sudo[95064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7a2d5ed5-b694-425a-9433-b1c11fd82dac Jul 28 10:41:00 devstack sudo[95064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:01 devstack sudo[95064]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b65725c7-5487-4fef-a13b-3e62b4ba9b25 tempest-AttachVolumeTestJSON-250152809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7a2d5ed5-b694-425a-9433-b1c11fd82dac" returned: 0 in 0.481s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b65725c7-5487-4fef-a13b-3e62b4ba9b25 tempest-AttachVolumeTestJSON-250152809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7a2d5ed5-b694-425a-9433-b1c11fd82dac {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:01 devstack sudo[95069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7a2d5ed5-b694-425a-9433-b1c11fd82dac Jul 28 10:41:01 devstack sudo[95069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:01 devstack sudo[95069]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b65725c7-5487-4fef-a13b-3e62b4ba9b25 tempest-AttachVolumeTestJSON-250152809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7a2d5ed5-b694-425a-9433-b1c11fd82dac" returned: 0 in 0.354s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:01 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b65725c7-5487-4fef-a13b-3e62b4ba9b25 tempest-AttachVolumeTestJSON-250152809 None] Lock "cinder-quobyte-7a2d5ed5-b694-425a-9433-b1c11fd82dac" released by "delete_volume" :: held 0.899s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:41:01 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-b65725c7-5487-4fef-a13b-3e62b4ba9b25 tempest-AttachVolumeTestJSON-250152809 None] Created reservations ['2b1ed766-60f3-46b9-b466-3c6973a63eb1', '8057f862-a46b-4efa-8e54-0449c2d6555d', 'f769311e-45bc-43a1-a45f-fde2f2a9f4d7', '30848700-f544-43f4-bf1f-15fdc782e10c'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:41:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b65725c7-5487-4fef-a13b-3e62b4ba9b25 tempest-AttachVolumeTestJSON-250152809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:41:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b65725c7-5487-4fef-a13b-3e62b4ba9b25 tempest-AttachVolumeTestJSON-250152809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:41:01 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b65725c7-5487-4fef-a13b-3e62b4ba9b25 tempest-AttachVolumeTestJSON-250152809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:41:01 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b65725c7-5487-4fef-a13b-3e62b4ba9b25 tempest-AttachVolumeTestJSON-250152809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:41:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b65725c7-5487-4fef-a13b-3e62b4ba9b25 tempest-AttachVolumeTestJSON-250152809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:41:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b65725c7-5487-4fef-a13b-3e62b4ba9b25 tempest-AttachVolumeTestJSON-250152809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:01 devstack sudo[95072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:41:01 devstack sudo[95072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:02 devstack sudo[95072]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b65725c7-5487-4fef-a13b-3e62b4ba9b25 tempest-AttachVolumeTestJSON-250152809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.339s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:02 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-b65725c7-5487-4fef-a13b-3e62b4ba9b25 tempest-AttachVolumeTestJSON-250152809 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:41:02 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-b65725c7-5487-4fef-a13b-3e62b4ba9b25 tempest-AttachVolumeTestJSON-250152809 None] Deleted volume successfully. Jul 28 10:41:02 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b65725c7-5487-4fef-a13b-3e62b4ba9b25 tempest-AttachVolumeTestJSON-250152809 None] Lock "cinder-7a2d5ed5-b694-425a-9433-b1c11fd82dac-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:41:03 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1ca3d789-d08a-49e3-b7a4-61f640e017e6 tempest-AttachVolumeTestJSON-250152809 None] Acquiring lock "cinder-7af91544-9163-4c29-9233-70de6b390a7d-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:41:03 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1ca3d789-d08a-49e3-b7a4-61f640e017e6 tempest-AttachVolumeTestJSON-250152809 None] Lock "cinder-7af91544-9163-4c29-9233-70de6b390a7d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:41:03 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1ca3d789-d08a-49e3-b7a4-61f640e017e6 tempest-AttachVolumeTestJSON-250152809 None] Acquiring lock "cinder-quobyte-7af91544-9163-4c29-9233-70de6b390a7d" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:41:03 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1ca3d789-d08a-49e3-b7a4-61f640e017e6 tempest-AttachVolumeTestJSON-250152809 None] Lock "cinder-quobyte-7af91544-9163-4c29-9233-70de6b390a7d" acquired by "delete_volume" :: waited 0.032s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:41:03 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[09bf57bf-63d3-4278-b173-d9bbb4dcefb4]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:41:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1ca3d789-d08a-49e3-b7a4-61f640e017e6 tempest-AttachVolumeTestJSON-250152809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7af91544-9163-4c29-9233-70de6b390a7d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:03 devstack sudo[95078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7af91544-9163-4c29-9233-70de6b390a7d Jul 28 10:41:03 devstack sudo[95078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:03 devstack sudo[95078]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1ca3d789-d08a-49e3-b7a4-61f640e017e6 tempest-AttachVolumeTestJSON-250152809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7af91544-9163-4c29-9233-70de6b390a7d" returned: 0 in 0.530s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1ca3d789-d08a-49e3-b7a4-61f640e017e6 tempest-AttachVolumeTestJSON-250152809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7af91544-9163-4c29-9233-70de6b390a7d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:03 devstack sudo[95096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7af91544-9163-4c29-9233-70de6b390a7d Jul 28 10:41:03 devstack sudo[95096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:04 devstack sudo[95096]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1ca3d789-d08a-49e3-b7a4-61f640e017e6 tempest-AttachVolumeTestJSON-250152809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7af91544-9163-4c29-9233-70de6b390a7d" returned: 0 in 0.379s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:04 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1ca3d789-d08a-49e3-b7a4-61f640e017e6 tempest-AttachVolumeTestJSON-250152809 None] Lock "cinder-quobyte-7af91544-9163-4c29-9233-70de6b390a7d" released by "delete_volume" :: held 1.008s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:41:04 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-1ca3d789-d08a-49e3-b7a4-61f640e017e6 tempest-AttachVolumeTestJSON-250152809 None] Created reservations ['b7e70e92-b9a8-4b4c-847e-cb8f93ed4e3d', '487e9927-77f3-4a81-8ba2-aa163c793dd1', 'd7283fad-6539-422b-ac45-291bf0a7a61c', '1ed42420-e163-4705-ac56-90efee27c6ee'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:41:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1ca3d789-d08a-49e3-b7a4-61f640e017e6 tempest-AttachVolumeTestJSON-250152809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:41:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1ca3d789-d08a-49e3-b7a4-61f640e017e6 tempest-AttachVolumeTestJSON-250152809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:41:04 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-1ca3d789-d08a-49e3-b7a4-61f640e017e6 tempest-AttachVolumeTestJSON-250152809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:41:04 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-1ca3d789-d08a-49e3-b7a4-61f640e017e6 tempest-AttachVolumeTestJSON-250152809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:41:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1ca3d789-d08a-49e3-b7a4-61f640e017e6 tempest-AttachVolumeTestJSON-250152809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:41:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1ca3d789-d08a-49e3-b7a4-61f640e017e6 tempest-AttachVolumeTestJSON-250152809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:04 devstack sudo[95109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:41:04 devstack sudo[95109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:04 devstack sudo[95109]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1ca3d789-d08a-49e3-b7a4-61f640e017e6 tempest-AttachVolumeTestJSON-250152809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.356s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:04 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-1ca3d789-d08a-49e3-b7a4-61f640e017e6 tempest-AttachVolumeTestJSON-250152809 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:41:04 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-1ca3d789-d08a-49e3-b7a4-61f640e017e6 tempest-AttachVolumeTestJSON-250152809 None] Deleted volume successfully. Jul 28 10:41:04 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1ca3d789-d08a-49e3-b7a4-61f640e017e6 tempest-AttachVolumeTestJSON-250152809 None] Lock "cinder-7af91544-9163-4c29-9233-70de6b390a7d-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:41:07 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-085ebd0d-a15d-4018-ae03-0b91c60e2c21 tempest-GroupSnapshotsV319Test-2145290284 None] Group tempest-GroupSnapshotsV319Test-Group-1047382218: creating Jul 28 10:41:07 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-085ebd0d-a15d-4018-ae03-0b91c60e2c21 tempest-GroupSnapshotsV319Test-2145290284 None] Group tempest-GroupSnapshotsV319Test-Group-1047382218: created successfully Jul 28 10:41:07 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-085ebd0d-a15d-4018-ae03-0b91c60e2c21 tempest-GroupSnapshotsV319Test-2145290284 None] Create group completed successfully. Jul 28 10:41:08 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ec9acb2-0c59-4b9a-8acc-8897df7cc382 tempest-GroupSnapshotsV319Test-2145290284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:41:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4ec9acb2-0c59-4b9a-8acc-8897df7cc382 tempest-GroupSnapshotsV319Test-2145290284 None] Flow 'volume_create_manager' (c7120503-4015-4e7a-bec7-8a6e3943e1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:41:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4ec9acb2-0c59-4b9a-8acc-8897df7cc382 tempest-GroupSnapshotsV319Test-2145290284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f5c48d5-8d29-49f5-b67b-db449d2362f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4ec9acb2-0c59-4b9a-8acc-8897df7cc382 tempest-GroupSnapshotsV319Test-2145290284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f5c48d5-8d29-49f5-b67b-db449d2362f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-99742589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7a951cd3-5e8a-41e8-9e49-275942339df9,host='devstack@QuobyteHD#QuobyteHD',id=9174a47f-cf9d-4751-bdaa-2d51d535d2f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88aae63e48da4b2f9a012e4248d20209',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:41:09Z,use_quota=True,user_id='1be8e11dce064c70bda3e5790ee21f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(661fb387-acf1-46a3-b9f7-8df76eccf952),volume_type_id=661fb387-acf1-46a3-b9f7-8df76eccf952)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4ec9acb2-0c59-4b9a-8acc-8897df7cc382 tempest-GroupSnapshotsV319Test-2145290284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb4a1ca8-dcca-4d7f-a529-793b33e2ed46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4ec9acb2-0c59-4b9a-8acc-8897df7cc382 tempest-GroupSnapshotsV319Test-2145290284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb4a1ca8-dcca-4d7f-a529-793b33e2ed46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4ec9acb2-0c59-4b9a-8acc-8897df7cc382 tempest-GroupSnapshotsV319Test-2145290284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (371b9043-bdbc-4900-8163-64a4069146b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4ec9acb2-0c59-4b9a-8acc-8897df7cc382 tempest-GroupSnapshotsV319Test-2145290284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (371b9043-bdbc-4900-8163-64a4069146b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9174a47f-cf9d-4751-bdaa-2d51d535d2f9', 'volume_name': 'volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4ec9acb2-0c59-4b9a-8acc-8897df7cc382 tempest-GroupSnapshotsV319Test-2145290284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c59edf62-c185-4091-bc36-1d970c4e83b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4ec9acb2-0c59-4b9a-8acc-8897df7cc382 tempest-GroupSnapshotsV319Test-2145290284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c59edf62-c185-4091-bc36-1d970c4e83b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4ec9acb2-0c59-4b9a-8acc-8897df7cc382 tempest-GroupSnapshotsV319Test-2145290284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d47fb33-2375-4e60-9b73-501a23647d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:08 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-4ec9acb2-0c59-4b9a-8acc-8897df7cc382 tempest-GroupSnapshotsV319Test-2145290284 None] Volume 9174a47f-cf9d-4751-bdaa-2d51d535d2f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9', 'volume_size': 1} Jul 28 10:41:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-4ec9acb2-0c59-4b9a-8acc-8897df7cc382 tempest-GroupSnapshotsV319Test-2145290284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:41:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-4ec9acb2-0c59-4b9a-8acc-8897df7cc382 tempest-GroupSnapshotsV319Test-2145290284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:41:08 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-4ec9acb2-0c59-4b9a-8acc-8897df7cc382 tempest-GroupSnapshotsV319Test-2145290284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7a951cd3-5e8a-41e8-9e49-275942339df9,created_at=2026-07-28T08:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-99742589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7a951cd3-5e8a-41e8-9e49-275942339df9,host='devstack@QuobyteHD#QuobyteHD',id=9174a47f-cf9d-4751-bdaa-2d51d535d2f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88aae63e48da4b2f9a012e4248d20209',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:41:09Z,use_quota=True,user_id='1be8e11dce064c70bda3e5790ee21f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(661fb387-acf1-46a3-b9f7-8df76eccf952),volume_type_id=661fb387-acf1-46a3-b9f7-8df76eccf952)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:41:08 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-4ec9acb2-0c59-4b9a-8acc-8897df7cc382 tempest-GroupSnapshotsV319Test-2145290284 None] Creating volume 9174a47f-cf9d-4751-bdaa-2d51d535d2f9 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:41:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-4ec9acb2-0c59-4b9a-8acc-8897df7cc382 tempest-GroupSnapshotsV319Test-2145290284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:41:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-4ec9acb2-0c59-4b9a-8acc-8897df7cc382 tempest-GroupSnapshotsV319Test-2145290284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:41:08 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-4ec9acb2-0c59-4b9a-8acc-8897df7cc382 tempest-GroupSnapshotsV319Test-2145290284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:41:08 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-4ec9acb2-0c59-4b9a-8acc-8897df7cc382 tempest-GroupSnapshotsV319Test-2145290284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:41:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-4ec9acb2-0c59-4b9a-8acc-8897df7cc382 tempest-GroupSnapshotsV319Test-2145290284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:41:08 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-4ec9acb2-0c59-4b9a-8acc-8897df7cc382 tempest-GroupSnapshotsV319Test-2145290284 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:41:08 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-4ec9acb2-0c59-4b9a-8acc-8897df7cc382 tempest-GroupSnapshotsV319Test-2145290284 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:41:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4ec9acb2-0c59-4b9a-8acc-8897df7cc382 tempest-GroupSnapshotsV319Test-2145290284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:08 devstack sudo[95115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9 1073741824 Jul 28 10:41:08 devstack sudo[95115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:09 devstack sudo[95115]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4ec9acb2-0c59-4b9a-8acc-8897df7cc382 tempest-GroupSnapshotsV319Test-2145290284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9 1073741824" returned: 0 in 0.646s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4ec9acb2-0c59-4b9a-8acc-8897df7cc382 tempest-GroupSnapshotsV319Test-2145290284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:09 devstack sudo[95122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9 Jul 28 10:41:09 devstack sudo[95122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:09 devstack sudo[95122]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4ec9acb2-0c59-4b9a-8acc-8897df7cc382 tempest-GroupSnapshotsV319Test-2145290284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9" returned: 0 in 0.313s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:09 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-4ec9acb2-0c59-4b9a-8acc-8897df7cc382 tempest-GroupSnapshotsV319Test-2145290284 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:41:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-4ec9acb2-0c59-4b9a-8acc-8897df7cc382 tempest-GroupSnapshotsV319Test-2145290284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:41:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4ec9acb2-0c59-4b9a-8acc-8897df7cc382 tempest-GroupSnapshotsV319Test-2145290284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d47fb33-2375-4e60-9b73-501a23647d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4ec9acb2-0c59-4b9a-8acc-8897df7cc382 tempest-GroupSnapshotsV319Test-2145290284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56410aa2-5351-4dc6-b8dc-4b845b34e893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:09 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-4ec9acb2-0c59-4b9a-8acc-8897df7cc382 tempest-GroupSnapshotsV319Test-2145290284 None] Volume volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9 (9174a47f-cf9d-4751-bdaa-2d51d535d2f9): created successfully Jul 28 10:41:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4ec9acb2-0c59-4b9a-8acc-8897df7cc382 tempest-GroupSnapshotsV319Test-2145290284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56410aa2-5351-4dc6-b8dc-4b845b34e893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4ec9acb2-0c59-4b9a-8acc-8897df7cc382 tempest-GroupSnapshotsV319Test-2145290284 None] Flow 'volume_create_manager' (c7120503-4015-4e7a-bec7-8a6e3943e1ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:41:09 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-4ec9acb2-0c59-4b9a-8acc-8897df7cc382 tempest-GroupSnapshotsV319Test-2145290284 None] Created volume successfully. Jul 28 10:41:10 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-020e9fe5-fd76-491b-837f-9abcfd09a0b1 tempest-AttachVolumeShelveTestJSON-225488613 None] Acquiring lock "cinder-1aa220ce-0b5a-46f1-b27a-2cc6fcd04314-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:41:10 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-020e9fe5-fd76-491b-837f-9abcfd09a0b1 tempest-AttachVolumeShelveTestJSON-225488613 None] Lock "cinder-1aa220ce-0b5a-46f1-b27a-2cc6fcd04314-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:41:10 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-020e9fe5-fd76-491b-837f-9abcfd09a0b1 tempest-AttachVolumeShelveTestJSON-225488613 None] Acquiring lock "cinder-quobyte-1aa220ce-0b5a-46f1-b27a-2cc6fcd04314" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:41:10 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-020e9fe5-fd76-491b-837f-9abcfd09a0b1 tempest-AttachVolumeShelveTestJSON-225488613 None] Lock "cinder-quobyte-1aa220ce-0b5a-46f1-b27a-2cc6fcd04314" acquired by "delete_volume" :: waited 0.025s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:41:10 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fad454-565c-493f-8164-bf61e5c7b0a1]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:41:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-020e9fe5-fd76-491b-837f-9abcfd09a0b1 tempest-AttachVolumeShelveTestJSON-225488613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1aa220ce-0b5a-46f1-b27a-2cc6fcd04314 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:10 devstack sudo[95125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1aa220ce-0b5a-46f1-b27a-2cc6fcd04314 Jul 28 10:41:10 devstack sudo[95125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:10 devstack sudo[95125]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-020e9fe5-fd76-491b-837f-9abcfd09a0b1 tempest-AttachVolumeShelveTestJSON-225488613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1aa220ce-0b5a-46f1-b27a-2cc6fcd04314" returned: 0 in 0.452s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-020e9fe5-fd76-491b-837f-9abcfd09a0b1 tempest-AttachVolumeShelveTestJSON-225488613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1aa220ce-0b5a-46f1-b27a-2cc6fcd04314 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:10 devstack sudo[95131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1aa220ce-0b5a-46f1-b27a-2cc6fcd04314 Jul 28 10:41:10 devstack sudo[95131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:11 devstack sudo[95131]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-020e9fe5-fd76-491b-837f-9abcfd09a0b1 tempest-AttachVolumeShelveTestJSON-225488613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1aa220ce-0b5a-46f1-b27a-2cc6fcd04314" returned: 0 in 0.329s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:11 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-020e9fe5-fd76-491b-837f-9abcfd09a0b1 tempest-AttachVolumeShelveTestJSON-225488613 None] Lock "cinder-quobyte-1aa220ce-0b5a-46f1-b27a-2cc6fcd04314" released by "delete_volume" :: held 0.865s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:41:11 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-020e9fe5-fd76-491b-837f-9abcfd09a0b1 tempest-AttachVolumeShelveTestJSON-225488613 None] Created reservations ['7f7c6bb9-972c-4882-bf79-dd6e70c44635', '4d636bdf-faf6-41bf-adf5-9724d24f750e', 'c24b412d-5779-437f-b194-eb3aaa550f4c', '965fa982-9b0c-436f-87ea-bd8bb958a4f8'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:41:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-020e9fe5-fd76-491b-837f-9abcfd09a0b1 tempest-AttachVolumeShelveTestJSON-225488613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:41:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-020e9fe5-fd76-491b-837f-9abcfd09a0b1 tempest-AttachVolumeShelveTestJSON-225488613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:41:11 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-020e9fe5-fd76-491b-837f-9abcfd09a0b1 tempest-AttachVolumeShelveTestJSON-225488613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:41:11 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-020e9fe5-fd76-491b-837f-9abcfd09a0b1 tempest-AttachVolumeShelveTestJSON-225488613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:41:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-020e9fe5-fd76-491b-837f-9abcfd09a0b1 tempest-AttachVolumeShelveTestJSON-225488613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:41:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-020e9fe5-fd76-491b-837f-9abcfd09a0b1 tempest-AttachVolumeShelveTestJSON-225488613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:11 devstack sudo[95136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:41:11 devstack sudo[95136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:11 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-e9a7bd3a-77e5-49c1-b677-7e193e99699e tempest-GroupSnapshotsV319Test-2145290284 None] GroupSnapshot 120a4c60-d8af-4e2e-a0bf-ef538337f3bd: creating. Jul 28 10:41:11 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e9a7bd3a-77e5-49c1-b677-7e193e99699e tempest-GroupSnapshotsV319Test-2145290284 None] Group snapshot 120a4c60-d8af-4e2e-a0bf-ef538337f3bd: creating. {{(pid=88413) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 28 10:41:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e9a7bd3a-77e5-49c1-b677-7e193e99699e tempest-GroupSnapshotsV319Test-2145290284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:41:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e9a7bd3a-77e5-49c1-b677-7e193e99699e tempest-GroupSnapshotsV319Test-2145290284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:41:11 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-e9a7bd3a-77e5-49c1-b677-7e193e99699e tempest-GroupSnapshotsV319Test-2145290284 None] Creating offline snapshot 4586a29f-e17f-49a1-b9b6-a9de5825ff12 of volume 9174a47f-cf9d-4751-bdaa-2d51d535d2f9 {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:41:11 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab2bdb5-c2e0-4b7c-82a8-c9f458487742]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:41:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e9a7bd3a-77e5-49c1-b677-7e193e99699e tempest-GroupSnapshotsV319Test-2145290284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:11 devstack sudo[95138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9 Jul 28 10:41:11 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:11 devstack sudo[95136]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-020e9fe5-fd76-491b-837f-9abcfd09a0b1 tempest-AttachVolumeShelveTestJSON-225488613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.418s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:11 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-020e9fe5-fd76-491b-837f-9abcfd09a0b1 tempest-AttachVolumeShelveTestJSON-225488613 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:41:11 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-020e9fe5-fd76-491b-837f-9abcfd09a0b1 tempest-AttachVolumeShelveTestJSON-225488613 None] Deleted volume successfully. Jul 28 10:41:11 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-020e9fe5-fd76-491b-837f-9abcfd09a0b1 tempest-AttachVolumeShelveTestJSON-225488613 None] Lock "cinder-1aa220ce-0b5a-46f1-b27a-2cc6fcd04314-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:41:12 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e9a7bd3a-77e5-49c1-b677-7e193e99699e tempest-GroupSnapshotsV319Test-2145290284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9" returned: 0 in 0.461s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e9a7bd3a-77e5-49c1-b677-7e193e99699e tempest-GroupSnapshotsV319Test-2145290284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9.4586a29f-e17f-49a1-b9b6-a9de5825ff12 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:12 devstack sudo[95145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9.4586a29f-e17f-49a1-b9b6-a9de5825ff12 1G Jul 28 10:41:12 devstack sudo[95145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:12 devstack sudo[95145]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e9a7bd3a-77e5-49c1-b677-7e193e99699e tempest-GroupSnapshotsV319Test-2145290284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9.4586a29f-e17f-49a1-b9b6-a9de5825ff12 1G" returned: 0 in 0.729s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e9a7bd3a-77e5-49c1-b677-7e193e99699e tempest-GroupSnapshotsV319Test-2145290284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9.4586a29f-e17f-49a1-b9b6-a9de5825ff12 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:12 devstack sudo[95153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9.4586a29f-e17f-49a1-b9b6-a9de5825ff12 Jul 28 10:41:12 devstack sudo[95153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:13 devstack sudo[95153]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e9a7bd3a-77e5-49c1-b677-7e193e99699e tempest-GroupSnapshotsV319Test-2145290284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9.4586a29f-e17f-49a1-b9b6-a9de5825ff12" returned: 0 in 0.409s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:13 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-e9a7bd3a-77e5-49c1-b677-7e193e99699e tempest-GroupSnapshotsV319Test-2145290284 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9.4586a29f-e17f-49a1-b9b6-a9de5825ff12 is being set with open permissions: ugo+rw: NotImplementedError Jul 28 10:41:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e9a7bd3a-77e5-49c1-b677-7e193e99699e tempest-GroupSnapshotsV319Test-2145290284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9.4586a29f-e17f-49a1-b9b6-a9de5825ff12 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:13 devstack sudo[95160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9.4586a29f-e17f-49a1-b9b6-a9de5825ff12 Jul 28 10:41:13 devstack sudo[95160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:13 devstack sudo[95160]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e9a7bd3a-77e5-49c1-b677-7e193e99699e tempest-GroupSnapshotsV319Test-2145290284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9.4586a29f-e17f-49a1-b9b6-a9de5825ff12" returned: 0 in 0.323s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e9a7bd3a-77e5-49c1-b677-7e193e99699e tempest-GroupSnapshotsV319Test-2145290284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:13 devstack sudo[95164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9.info Jul 28 10:41:13 devstack sudo[95164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:13 devstack sudo[95164]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e9a7bd3a-77e5-49c1-b677-7e193e99699e tempest-GroupSnapshotsV319Test-2145290284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9.info" returned: 0 in 0.390s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:13 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-e9a7bd3a-77e5-49c1-b677-7e193e99699e tempest-GroupSnapshotsV319Test-2145290284 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9.info is being set with open permissions: ugo+rw: NotImplementedError Jul 28 10:41:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e9a7bd3a-77e5-49c1-b677-7e193e99699e tempest-GroupSnapshotsV319Test-2145290284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:14 devstack sudo[95167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9.info Jul 28 10:41:14 devstack sudo[95167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:14 devstack sudo[95167]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e9a7bd3a-77e5-49c1-b677-7e193e99699e tempest-GroupSnapshotsV319Test-2145290284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9.info" returned: 0 in 0.339s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e9a7bd3a-77e5-49c1-b677-7e193e99699e tempest-GroupSnapshotsV319Test-2145290284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.772s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:41:14 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-e9a7bd3a-77e5-49c1-b677-7e193e99699e tempest-GroupSnapshotsV319Test-2145290284 None] group_snapshot 120a4c60-d8af-4e2e-a0bf-ef538337f3bd: created successfully Jul 28 10:41:15 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-adeb1dd4-09ce-45b6-9b93-64027c7d2823 tempest-GroupSnapshotsV319Test-2145290284 None] group_snapshot 120a4c60-d8af-4e2e-a0bf-ef538337f3bd: deleting Jul 28 10:41:15 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=68,cinder:INSERT=13,cinder:UPDATE=64,cinder:DELETE=5 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:41:15 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-adeb1dd4-09ce-45b6-9b93-64027c7d2823 tempest-GroupSnapshotsV319Test-2145290284 None] group_snapshot 120a4c60-d8af-4e2e-a0bf-ef538337f3bd: deleting {{(pid=88413) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 28 10:41:15 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-adeb1dd4-09ce-45b6-9b93-64027c7d2823 tempest-GroupSnapshotsV319Test-2145290284 None] Acquiring lock "cinder-quobyte-9174a47f-cf9d-4751-bdaa-2d51d535d2f9" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:41:15 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [req-68338a6a-896a-42f3-bd65-9aecc2b54112 req-4dcae772-6e43-4bd6-8970-9be3fcdf13eb tempest-VolumesGetTestJSON-666135609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:41:15 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-68338a6a-896a-42f3-bd65-9aecc2b54112 req-4dcae772-6e43-4bd6-8970-9be3fcdf13eb tempest-VolumesGetTestJSON-666135609 None] Flow 'volume_create_manager' (0a3b8ddf-2e2c-4977-951f-a4e157e92525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:41:15 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-68338a6a-896a-42f3-bd65-9aecc2b54112 req-4dcae772-6e43-4bd6-8970-9be3fcdf13eb tempest-VolumesGetTestJSON-666135609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fd0e4e8-15cc-44bd-b52a-bb5825bbe072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:15 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-adeb1dd4-09ce-45b6-9b93-64027c7d2823 tempest-GroupSnapshotsV319Test-2145290284 None] Lock "cinder-quobyte-9174a47f-cf9d-4751-bdaa-2d51d535d2f9" acquired by "delete_snapshot" :: waited 0.092s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:41:15 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-adeb1dd4-09ce-45b6-9b93-64027c7d2823 tempest-GroupSnapshotsV319Test-2145290284 None] Acquiring lock "cinder-quobyte-4586a29f-e17f-49a1-b9b6-a9de5825ff12" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:41:15 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-68338a6a-896a-42f3-bd65-9aecc2b54112 req-4dcae772-6e43-4bd6-8970-9be3fcdf13eb tempest-VolumesGetTestJSON-666135609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fd0e4e8-15cc-44bd-b52a-bb5825bbe072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1159550493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb8daab5-e810-4d93-b6c3-1befbe85c9e3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1e2326ede25141cebdc3b487746ea6e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:41:16Z,use_quota=True,user_id='ea37bc784e3e40b8a10b54e51c32e966',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:15 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-68338a6a-896a-42f3-bd65-9aecc2b54112 req-4dcae772-6e43-4bd6-8970-9be3fcdf13eb tempest-VolumesGetTestJSON-666135609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a97c902a-6c6d-4b01-8c55-973d67048df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:15 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-68338a6a-896a-42f3-bd65-9aecc2b54112 req-4dcae772-6e43-4bd6-8970-9be3fcdf13eb tempest-VolumesGetTestJSON-666135609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a97c902a-6c6d-4b01-8c55-973d67048df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:15 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-68338a6a-896a-42f3-bd65-9aecc2b54112 req-4dcae772-6e43-4bd6-8970-9be3fcdf13eb tempest-VolumesGetTestJSON-666135609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39eb4862-a3a5-420c-ac44-c5792b6645e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:15 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-68338a6a-896a-42f3-bd65-9aecc2b54112 req-4dcae772-6e43-4bd6-8970-9be3fcdf13eb tempest-VolumesGetTestJSON-666135609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39eb4862-a3a5-420c-ac44-c5792b6645e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb8daab5-e810-4d93-b6c3-1befbe85c9e3', 'volume_name': 'volume-eb8daab5-e810-4d93-b6c3-1befbe85c9e3', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:15 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-68338a6a-896a-42f3-bd65-9aecc2b54112 req-4dcae772-6e43-4bd6-8970-9be3fcdf13eb tempest-VolumesGetTestJSON-666135609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (271ccddc-ec95-4108-828f-6a9a2ab2dff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:15 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-68338a6a-896a-42f3-bd65-9aecc2b54112 req-4dcae772-6e43-4bd6-8970-9be3fcdf13eb tempest-VolumesGetTestJSON-666135609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (271ccddc-ec95-4108-828f-6a9a2ab2dff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:15 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-68338a6a-896a-42f3-bd65-9aecc2b54112 req-4dcae772-6e43-4bd6-8970-9be3fcdf13eb tempest-VolumesGetTestJSON-666135609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c888962-0c46-418c-848e-9e5d951b5356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:15 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [req-68338a6a-896a-42f3-bd65-9aecc2b54112 req-4dcae772-6e43-4bd6-8970-9be3fcdf13eb tempest-VolumesGetTestJSON-666135609 None] Volume eb8daab5-e810-4d93-b6c3-1befbe85c9e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb8daab5-e810-4d93-b6c3-1befbe85c9e3', 'volume_size': 1} Jul 28 10:41:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-68338a6a-896a-42f3-bd65-9aecc2b54112 req-4dcae772-6e43-4bd6-8970-9be3fcdf13eb tempest-VolumesGetTestJSON-666135609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:41:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-68338a6a-896a-42f3-bd65-9aecc2b54112 req-4dcae772-6e43-4bd6-8970-9be3fcdf13eb tempest-VolumesGetTestJSON-666135609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:41:15 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [req-68338a6a-896a-42f3-bd65-9aecc2b54112 req-4dcae772-6e43-4bd6-8970-9be3fcdf13eb tempest-VolumesGetTestJSON-666135609 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1159550493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb8daab5-e810-4d93-b6c3-1befbe85c9e3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1e2326ede25141cebdc3b487746ea6e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:41:16Z,use_quota=True,user_id='ea37bc784e3e40b8a10b54e51c32e966',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:41:15 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [req-68338a6a-896a-42f3-bd65-9aecc2b54112 req-4dcae772-6e43-4bd6-8970-9be3fcdf13eb tempest-VolumesGetTestJSON-666135609 None] Creating volume eb8daab5-e810-4d93-b6c3-1befbe85c9e3 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:41:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-68338a6a-896a-42f3-bd65-9aecc2b54112 req-4dcae772-6e43-4bd6-8970-9be3fcdf13eb tempest-VolumesGetTestJSON-666135609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:41:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-68338a6a-896a-42f3-bd65-9aecc2b54112 req-4dcae772-6e43-4bd6-8970-9be3fcdf13eb tempest-VolumesGetTestJSON-666135609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:41:15 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [req-68338a6a-896a-42f3-bd65-9aecc2b54112 req-4dcae772-6e43-4bd6-8970-9be3fcdf13eb tempest-VolumesGetTestJSON-666135609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:41:15 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [req-68338a6a-896a-42f3-bd65-9aecc2b54112 req-4dcae772-6e43-4bd6-8970-9be3fcdf13eb tempest-VolumesGetTestJSON-666135609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:41:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-68338a6a-896a-42f3-bd65-9aecc2b54112 req-4dcae772-6e43-4bd6-8970-9be3fcdf13eb tempest-VolumesGetTestJSON-666135609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:41:15 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [req-68338a6a-896a-42f3-bd65-9aecc2b54112 req-4dcae772-6e43-4bd6-8970-9be3fcdf13eb tempest-VolumesGetTestJSON-666135609 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:41:15 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [req-68338a6a-896a-42f3-bd65-9aecc2b54112 req-4dcae772-6e43-4bd6-8970-9be3fcdf13eb tempest-VolumesGetTestJSON-666135609 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:41:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-68338a6a-896a-42f3-bd65-9aecc2b54112 req-4dcae772-6e43-4bd6-8970-9be3fcdf13eb tempest-VolumesGetTestJSON-666135609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eb8daab5-e810-4d93-b6c3-1befbe85c9e3 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:15 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-adeb1dd4-09ce-45b6-9b93-64027c7d2823 tempest-GroupSnapshotsV319Test-2145290284 None] Lock "cinder-quobyte-4586a29f-e17f-49a1-b9b6-a9de5825ff12" acquired by "_delete_snapshot" :: waited 0.134s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:41:15 devstack sudo[95221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eb8daab5-e810-4d93-b6c3-1befbe85c9e3 1073741824 Jul 28 10:41:15 devstack sudo[95221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:15 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-adeb1dd4-09ce-45b6-9b93-64027c7d2823 tempest-GroupSnapshotsV319Test-2145290284 None] Deleting offline snapshot 4586a29f-e17f-49a1-b9b6-a9de5825ff12 of volume 9174a47f-cf9d-4751-bdaa-2d51d535d2f9 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:41:15 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-adeb1dd4-09ce-45b6-9b93-64027c7d2823 tempest-GroupSnapshotsV319Test-2145290284 None] snapshot_file for this snap is: volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9.4586a29f-e17f-49a1-b9b6-a9de5825ff12 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:41:16 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[4281111e-7a46-4079-bb32-fa2daa1f1de6]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:41:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-adeb1dd4-09ce-45b6-9b93-64027c7d2823 tempest-GroupSnapshotsV319Test-2145290284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9.4586a29f-e17f-49a1-b9b6-a9de5825ff12 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:16 devstack sudo[95223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9.4586a29f-e17f-49a1-b9b6-a9de5825ff12 Jul 28 10:41:16 devstack sudo[95223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:16 devstack sudo[95223]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-adeb1dd4-09ce-45b6-9b93-64027c7d2823 tempest-GroupSnapshotsV319Test-2145290284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9.4586a29f-e17f-49a1-b9b6-a9de5825ff12" returned: 0 in 0.441s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:16 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-adeb1dd4-09ce-45b6-9b93-64027c7d2823 tempest-GroupSnapshotsV319Test-2145290284 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:41:16 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[60658bf4-d44a-4308-b1cc-df6832f0f3e1]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:41:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-adeb1dd4-09ce-45b6-9b93-64027c7d2823 tempest-GroupSnapshotsV319Test-2145290284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:16 devstack sudo[95221]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-68338a6a-896a-42f3-bd65-9aecc2b54112 req-4dcae772-6e43-4bd6-8970-9be3fcdf13eb tempest-VolumesGetTestJSON-666135609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eb8daab5-e810-4d93-b6c3-1befbe85c9e3 1073741824" returned: 0 in 0.661s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-68338a6a-896a-42f3-bd65-9aecc2b54112 req-4dcae772-6e43-4bd6-8970-9be3fcdf13eb tempest-VolumesGetTestJSON-666135609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eb8daab5-e810-4d93-b6c3-1befbe85c9e3 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:16 devstack sudo[95235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9 Jul 28 10:41:16 devstack sudo[95236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eb8daab5-e810-4d93-b6c3-1befbe85c9e3 Jul 28 10:41:16 devstack sudo[95235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:16 devstack sudo[95236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:16 devstack sudo[95236]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-68338a6a-896a-42f3-bd65-9aecc2b54112 req-4dcae772-6e43-4bd6-8970-9be3fcdf13eb tempest-VolumesGetTestJSON-666135609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eb8daab5-e810-4d93-b6c3-1befbe85c9e3" returned: 0 in 0.422s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:16 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [req-68338a6a-896a-42f3-bd65-9aecc2b54112 req-4dcae772-6e43-4bd6-8970-9be3fcdf13eb tempest-VolumesGetTestJSON-666135609 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:41:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-68338a6a-896a-42f3-bd65-9aecc2b54112 req-4dcae772-6e43-4bd6-8970-9be3fcdf13eb tempest-VolumesGetTestJSON-666135609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:41:16 devstack sudo[95235]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-adeb1dd4-09ce-45b6-9b93-64027c7d2823 tempest-GroupSnapshotsV319Test-2145290284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9" returned: 0 in 0.507s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-adeb1dd4-09ce-45b6-9b93-64027c7d2823 tempest-GroupSnapshotsV319Test-2145290284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9.4586a29f-e17f-49a1-b9b6-a9de5825ff12 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:17 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-68338a6a-896a-42f3-bd65-9aecc2b54112 req-4dcae772-6e43-4bd6-8970-9be3fcdf13eb tempest-VolumesGetTestJSON-666135609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c888962-0c46-418c-848e-9e5d951b5356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb8daab5-e810-4d93-b6c3-1befbe85c9e3', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:17 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-68338a6a-896a-42f3-bd65-9aecc2b54112 req-4dcae772-6e43-4bd6-8970-9be3fcdf13eb tempest-VolumesGetTestJSON-666135609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (921d6aaf-7622-45f7-96a7-0e97472623c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:17 devstack sudo[95244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9.4586a29f-e17f-49a1-b9b6-a9de5825ff12 Jul 28 10:41:17 devstack sudo[95244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:17 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [req-68338a6a-896a-42f3-bd65-9aecc2b54112 req-4dcae772-6e43-4bd6-8970-9be3fcdf13eb tempest-VolumesGetTestJSON-666135609 None] Volume volume-eb8daab5-e810-4d93-b6c3-1befbe85c9e3 (eb8daab5-e810-4d93-b6c3-1befbe85c9e3): created successfully Jul 28 10:41:17 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-68338a6a-896a-42f3-bd65-9aecc2b54112 req-4dcae772-6e43-4bd6-8970-9be3fcdf13eb tempest-VolumesGetTestJSON-666135609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (921d6aaf-7622-45f7-96a7-0e97472623c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:17 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-68338a6a-896a-42f3-bd65-9aecc2b54112 req-4dcae772-6e43-4bd6-8970-9be3fcdf13eb tempest-VolumesGetTestJSON-666135609 None] Flow 'volume_create_manager' (0a3b8ddf-2e2c-4977-951f-a4e157e92525) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:41:17 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-68338a6a-896a-42f3-bd65-9aecc2b54112 req-4dcae772-6e43-4bd6-8970-9be3fcdf13eb tempest-VolumesGetTestJSON-666135609 None] Created volume successfully. Jul 28 10:41:17 devstack sudo[95244]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-adeb1dd4-09ce-45b6-9b93-64027c7d2823 tempest-GroupSnapshotsV319Test-2145290284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9.4586a29f-e17f-49a1-b9b6-a9de5825ff12" returned: 0 in 0.456s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-adeb1dd4-09ce-45b6-9b93-64027c7d2823 tempest-GroupSnapshotsV319Test-2145290284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9.4586a29f-e17f-49a1-b9b6-a9de5825ff12 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:17 devstack sudo[95249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9.4586a29f-e17f-49a1-b9b6-a9de5825ff12 Jul 28 10:41:17 devstack sudo[95249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:17 devstack sudo[95249]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-adeb1dd4-09ce-45b6-9b93-64027c7d2823 tempest-GroupSnapshotsV319Test-2145290284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9.4586a29f-e17f-49a1-b9b6-a9de5825ff12" returned: 0 in 0.299s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:17 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-adeb1dd4-09ce-45b6-9b93-64027c7d2823 tempest-GroupSnapshotsV319Test-2145290284 None] Lock "cinder-quobyte-4586a29f-e17f-49a1-b9b6-a9de5825ff12" released by "_delete_snapshot" :: held 1.900s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:41:17 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-adeb1dd4-09ce-45b6-9b93-64027c7d2823 tempest-GroupSnapshotsV319Test-2145290284 None] Lock "cinder-quobyte-9174a47f-cf9d-4751-bdaa-2d51d535d2f9" released by "delete_snapshot" :: held 2.050s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:41:17 devstack cinder-volume[88413]: WARNING cinder.quota [None req-adeb1dd4-09ce-45b6-9b93-64027c7d2823 tempest-GroupSnapshotsV319Test-2145290284 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1579191516 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1579191516, it is now deprecated. Please use the default quota class for default quota. Jul 28 10:41:17 devstack cinder-volume[88413]: WARNING cinder.quota [None req-adeb1dd4-09ce-45b6-9b93-64027c7d2823 tempest-GroupSnapshotsV319Test-2145290284 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1579191516 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1579191516, it is now deprecated. Please use the default quota class for default quota. Jul 28 10:41:17 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-adeb1dd4-09ce-45b6-9b93-64027c7d2823 tempest-GroupSnapshotsV319Test-2145290284 None] Created reservations ['0796392f-d432-4dd2-9090-dc13642179ea', '9ffbc4d7-be2c-4400-80e2-9c543eae45c9', '77f79e22-fa83-431b-b105-b17f06d2d88a', '37bf0f35-b006-461a-b566-5116ea6932f3'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:41:18 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-adeb1dd4-09ce-45b6-9b93-64027c7d2823 tempest-GroupSnapshotsV319Test-2145290284 None] group_snapshot 120a4c60-d8af-4e2e-a0bf-ef538337f3bd: deleted successfully Jul 28 10:41:18 devstack cinder-volume[88413]: DEBUG cinder.coordination [req-d343c94e-69d0-43c4-a06c-ecc0abc0065a req-8107a4b3-e4b5-4a31-b69a-db88fd902229 tempest-VolumesGetTestJSON-666135609 None] Acquiring lock "cinder-eb8daab5-e810-4d93-b6c3-1befbe85c9e3-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:41:18 devstack cinder-volume[88413]: DEBUG cinder.coordination [req-d343c94e-69d0-43c4-a06c-ecc0abc0065a req-8107a4b3-e4b5-4a31-b69a-db88fd902229 tempest-VolumesGetTestJSON-666135609 None] Lock "cinder-eb8daab5-e810-4d93-b6c3-1befbe85c9e3-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:41:18 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1a770dc5-639b-46ca-b565-09f415ed6dd3 tempest-GroupSnapshotsV319Test-2145290284 None] Acquiring lock "cinder-quobyte-9174a47f-cf9d-4751-bdaa-2d51d535d2f9" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:41:18 devstack cinder-volume[88413]: DEBUG cinder.coordination [req-d343c94e-69d0-43c4-a06c-ecc0abc0065a req-8107a4b3-e4b5-4a31-b69a-db88fd902229 tempest-VolumesGetTestJSON-666135609 None] Acquiring lock "cinder-quobyte-eb8daab5-e810-4d93-b6c3-1befbe85c9e3" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:41:18 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1a770dc5-639b-46ca-b565-09f415ed6dd3 tempest-GroupSnapshotsV319Test-2145290284 None] Lock "cinder-quobyte-9174a47f-cf9d-4751-bdaa-2d51d535d2f9" acquired by "delete_volume" :: waited 0.075s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:41:18 devstack cinder-volume[88413]: DEBUG cinder.coordination [req-d343c94e-69d0-43c4-a06c-ecc0abc0065a req-8107a4b3-e4b5-4a31-b69a-db88fd902229 tempest-VolumesGetTestJSON-666135609 None] Lock "cinder-quobyte-eb8daab5-e810-4d93-b6c3-1befbe85c9e3" acquired by "delete_volume" :: waited 0.112s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:41:18 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bb98e2-0039-4e12-85cc-3a63626d4ac2]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:41:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1a770dc5-639b-46ca-b565-09f415ed6dd3 tempest-GroupSnapshotsV319Test-2145290284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:19 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[3043d2ca-548c-44ce-922f-a664a173b6ea]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:41:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-d343c94e-69d0-43c4-a06c-ecc0abc0065a req-8107a4b3-e4b5-4a31-b69a-db88fd902229 tempest-VolumesGetTestJSON-666135609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eb8daab5-e810-4d93-b6c3-1befbe85c9e3 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:19 devstack sudo[95288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9 Jul 28 10:41:19 devstack sudo[95288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:19 devstack sudo[95289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eb8daab5-e810-4d93-b6c3-1befbe85c9e3 Jul 28 10:41:19 devstack sudo[95289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:19 devstack sudo[95288]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1a770dc5-639b-46ca-b565-09f415ed6dd3 tempest-GroupSnapshotsV319Test-2145290284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9" returned: 0 in 0.839s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1a770dc5-639b-46ca-b565-09f415ed6dd3 tempest-GroupSnapshotsV319Test-2145290284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:19 devstack sudo[95323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9 Jul 28 10:41:19 devstack sudo[95323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:19 devstack sudo[95289]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-d343c94e-69d0-43c4-a06c-ecc0abc0065a req-8107a4b3-e4b5-4a31-b69a-db88fd902229 tempest-VolumesGetTestJSON-666135609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eb8daab5-e810-4d93-b6c3-1befbe85c9e3" returned: 0 in 0.882s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-d343c94e-69d0-43c4-a06c-ecc0abc0065a req-8107a4b3-e4b5-4a31-b69a-db88fd902229 tempest-VolumesGetTestJSON-666135609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eb8daab5-e810-4d93-b6c3-1befbe85c9e3 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:19 devstack sudo[95332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eb8daab5-e810-4d93-b6c3-1befbe85c9e3 Jul 28 10:41:19 devstack sudo[95332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:20 devstack sudo[95323]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1a770dc5-639b-46ca-b565-09f415ed6dd3 tempest-GroupSnapshotsV319Test-2145290284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9174a47f-cf9d-4751-bdaa-2d51d535d2f9" returned: 0 in 0.413s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:20 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1a770dc5-639b-46ca-b565-09f415ed6dd3 tempest-GroupSnapshotsV319Test-2145290284 None] Lock "cinder-quobyte-9174a47f-cf9d-4751-bdaa-2d51d535d2f9" released by "delete_volume" :: held 1.397s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:41:20 devstack sudo[95332]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-d343c94e-69d0-43c4-a06c-ecc0abc0065a req-8107a4b3-e4b5-4a31-b69a-db88fd902229 tempest-VolumesGetTestJSON-666135609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eb8daab5-e810-4d93-b6c3-1befbe85c9e3" returned: 0 in 0.375s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:20 devstack cinder-volume[88413]: DEBUG cinder.coordination [req-d343c94e-69d0-43c4-a06c-ecc0abc0065a req-8107a4b3-e4b5-4a31-b69a-db88fd902229 tempest-VolumesGetTestJSON-666135609 None] Lock "cinder-quobyte-eb8daab5-e810-4d93-b6c3-1befbe85c9e3" released by "delete_volume" :: held 1.360s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:41:20 devstack cinder-volume[88413]: DEBUG cinder.quota [req-d343c94e-69d0-43c4-a06c-ecc0abc0065a req-8107a4b3-e4b5-4a31-b69a-db88fd902229 tempest-VolumesGetTestJSON-666135609 None] Created reservations ['80e7bda2-ea9b-4c6a-aa6b-2b90f128f795', '663ac072-420b-4a04-a43e-19aaa3d00557', '149b9dd6-5d8b-4fc0-89f3-ee77bd9dd4e3', '794d652d-ebb6-4ba3-b80c-fe07584be329'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:41:20 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-1a770dc5-639b-46ca-b565-09f415ed6dd3 tempest-GroupSnapshotsV319Test-2145290284 None] Created reservations ['df44e4e3-4e05-43b5-8c3d-f2b565e04862'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:41:20 devstack cinder-volume[88413]: WARNING cinder.quota [None req-1a770dc5-639b-46ca-b565-09f415ed6dd3 tempest-GroupSnapshotsV319Test-2145290284 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1579191516 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1579191516, it is now deprecated. Please use the default quota class for default quota. Jul 28 10:41:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-d343c94e-69d0-43c4-a06c-ecc0abc0065a req-8107a4b3-e4b5-4a31-b69a-db88fd902229 tempest-VolumesGetTestJSON-666135609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:41:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-d343c94e-69d0-43c4-a06c-ecc0abc0065a req-8107a4b3-e4b5-4a31-b69a-db88fd902229 tempest-VolumesGetTestJSON-666135609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:41:20 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [req-d343c94e-69d0-43c4-a06c-ecc0abc0065a req-8107a4b3-e4b5-4a31-b69a-db88fd902229 tempest-VolumesGetTestJSON-666135609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:41:20 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [req-d343c94e-69d0-43c4-a06c-ecc0abc0065a req-8107a4b3-e4b5-4a31-b69a-db88fd902229 tempest-VolumesGetTestJSON-666135609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:41:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-d343c94e-69d0-43c4-a06c-ecc0abc0065a req-8107a4b3-e4b5-4a31-b69a-db88fd902229 tempest-VolumesGetTestJSON-666135609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:41:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-d343c94e-69d0-43c4-a06c-ecc0abc0065a req-8107a4b3-e4b5-4a31-b69a-db88fd902229 tempest-VolumesGetTestJSON-666135609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:20 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-1a770dc5-639b-46ca-b565-09f415ed6dd3 tempest-GroupSnapshotsV319Test-2145290284 None] Created reservations ['ecab6977-dbd1-4bc5-90f4-a7dc961765f0', '7a07fe3b-788a-4ecb-ad63-2a440e7c2a91', 'aa15192c-ee20-4155-9e95-1dc60d3a01fb', '2246d697-0f15-42f4-b41e-31dbb89dff5b'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:41:20 devstack sudo[95353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:41:20 devstack sudo[95353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1a770dc5-639b-46ca-b565-09f415ed6dd3 tempest-GroupSnapshotsV319Test-2145290284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:41:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1a770dc5-639b-46ca-b565-09f415ed6dd3 tempest-GroupSnapshotsV319Test-2145290284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:41:20 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-1a770dc5-639b-46ca-b565-09f415ed6dd3 tempest-GroupSnapshotsV319Test-2145290284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:41:20 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-1a770dc5-639b-46ca-b565-09f415ed6dd3 tempest-GroupSnapshotsV319Test-2145290284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:41:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1a770dc5-639b-46ca-b565-09f415ed6dd3 tempest-GroupSnapshotsV319Test-2145290284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:41:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1a770dc5-639b-46ca-b565-09f415ed6dd3 tempest-GroupSnapshotsV319Test-2145290284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:20 devstack sudo[95356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:41:20 devstack sudo[95356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:20 devstack sudo[95353]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-d343c94e-69d0-43c4-a06c-ecc0abc0065a req-8107a4b3-e4b5-4a31-b69a-db88fd902229 tempest-VolumesGetTestJSON-666135609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.347s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:20 devstack cinder-volume[88413]: DEBUG cinder.manager [req-d343c94e-69d0-43c4-a06c-ecc0abc0065a req-8107a4b3-e4b5-4a31-b69a-db88fd902229 tempest-VolumesGetTestJSON-666135609 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:41:20 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-d343c94e-69d0-43c4-a06c-ecc0abc0065a req-8107a4b3-e4b5-4a31-b69a-db88fd902229 tempest-VolumesGetTestJSON-666135609 None] Deleted volume successfully. Jul 28 10:41:20 devstack cinder-volume[88413]: DEBUG cinder.coordination [req-d343c94e-69d0-43c4-a06c-ecc0abc0065a req-8107a4b3-e4b5-4a31-b69a-db88fd902229 tempest-VolumesGetTestJSON-666135609 None] Lock "cinder-eb8daab5-e810-4d93-b6c3-1befbe85c9e3-delete_volume" released by "delete_volume" :: held 2.288s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:41:21 devstack sudo[95356]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1a770dc5-639b-46ca-b565-09f415ed6dd3 tempest-GroupSnapshotsV319Test-2145290284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.391s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:21 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-1a770dc5-639b-46ca-b565-09f415ed6dd3 tempest-GroupSnapshotsV319Test-2145290284 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:41:21 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-1a770dc5-639b-46ca-b565-09f415ed6dd3 tempest-GroupSnapshotsV319Test-2145290284 None] Delete group completed successfully. Jul 28 10:41:25 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9a4050b-ce4d-4d22-a4b3-2754458000bc tempest-VolumesActionsTest-510530160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:41:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e9a4050b-ce4d-4d22-a4b3-2754458000bc tempest-VolumesActionsTest-510530160 None] Flow 'volume_create_manager' (09fa6b57-9c03-40ff-801c-36d42a150eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:41:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e9a4050b-ce4d-4d22-a4b3-2754458000bc tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79fa276b-f608-45a8-bda6-f4a58cd2006a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e9a4050b-ce4d-4d22-a4b3-2754458000bc tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79fa276b-f608-45a8-bda6-f4a58cd2006a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-811065526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cef48cd-ec0f-4f84-9c1a-f8c78b050eed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95375aecc7264185b1fbef4b61ea9c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:41:25Z,use_quota=True,user_id='784e408de64245578eb1a307088e85f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e9a4050b-ce4d-4d22-a4b3-2754458000bc tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03a9b3f-825b-4fa1-ad4c-121619005bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e9a4050b-ce4d-4d22-a4b3-2754458000bc tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03a9b3f-825b-4fa1-ad4c-121619005bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e9a4050b-ce4d-4d22-a4b3-2754458000bc tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af7baec4-208d-411e-a682-83b4f72a6b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e9a4050b-ce4d-4d22-a4b3-2754458000bc tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af7baec4-208d-411e-a682-83b4f72a6b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cef48cd-ec0f-4f84-9c1a-f8c78b050eed', 'volume_name': 'volume-8cef48cd-ec0f-4f84-9c1a-f8c78b050eed', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e9a4050b-ce4d-4d22-a4b3-2754458000bc tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bc0451b-7e33-4b49-9da1-bc4ef8b639d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e9a4050b-ce4d-4d22-a4b3-2754458000bc tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bc0451b-7e33-4b49-9da1-bc4ef8b639d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e9a4050b-ce4d-4d22-a4b3-2754458000bc tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e03f0dd7-f81e-4b80-9bf3-6c0bc41b61c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:25 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-e9a4050b-ce4d-4d22-a4b3-2754458000bc tempest-VolumesActionsTest-510530160 None] Volume 8cef48cd-ec0f-4f84-9c1a-f8c78b050eed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cef48cd-ec0f-4f84-9c1a-f8c78b050eed', 'volume_size': 1} Jul 28 10:41:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e9a4050b-ce4d-4d22-a4b3-2754458000bc tempest-VolumesActionsTest-510530160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:41:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e9a4050b-ce4d-4d22-a4b3-2754458000bc tempest-VolumesActionsTest-510530160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:41:25 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e9a4050b-ce4d-4d22-a4b3-2754458000bc tempest-VolumesActionsTest-510530160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-811065526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cef48cd-ec0f-4f84-9c1a-f8c78b050eed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95375aecc7264185b1fbef4b61ea9c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:41:25Z,use_quota=True,user_id='784e408de64245578eb1a307088e85f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:41:25 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-e9a4050b-ce4d-4d22-a4b3-2754458000bc tempest-VolumesActionsTest-510530160 None] Creating volume 8cef48cd-ec0f-4f84-9c1a-f8c78b050eed {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:41:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e9a4050b-ce4d-4d22-a4b3-2754458000bc tempest-VolumesActionsTest-510530160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:41:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e9a4050b-ce4d-4d22-a4b3-2754458000bc tempest-VolumesActionsTest-510530160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:41:25 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e9a4050b-ce4d-4d22-a4b3-2754458000bc tempest-VolumesActionsTest-510530160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:41:25 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e9a4050b-ce4d-4d22-a4b3-2754458000bc tempest-VolumesActionsTest-510530160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:41:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e9a4050b-ce4d-4d22-a4b3-2754458000bc tempest-VolumesActionsTest-510530160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:41:25 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e9a4050b-ce4d-4d22-a4b3-2754458000bc tempest-VolumesActionsTest-510530160 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:41:25 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-e9a4050b-ce4d-4d22-a4b3-2754458000bc tempest-VolumesActionsTest-510530160 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:41:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e9a4050b-ce4d-4d22-a4b3-2754458000bc tempest-VolumesActionsTest-510530160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-8cef48cd-ec0f-4f84-9c1a-f8c78b050eed 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:25 devstack sudo[95362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-8cef48cd-ec0f-4f84-9c1a-f8c78b050eed 1073741824 Jul 28 10:41:25 devstack sudo[95362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:26 devstack sudo[95362]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e9a4050b-ce4d-4d22-a4b3-2754458000bc tempest-VolumesActionsTest-510530160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-8cef48cd-ec0f-4f84-9c1a-f8c78b050eed 1073741824" returned: 0 in 0.823s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e9a4050b-ce4d-4d22-a4b3-2754458000bc tempest-VolumesActionsTest-510530160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-8cef48cd-ec0f-4f84-9c1a-f8c78b050eed {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:26 devstack sudo[95368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-8cef48cd-ec0f-4f84-9c1a-f8c78b050eed Jul 28 10:41:26 devstack sudo[95368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:27 devstack sudo[95368]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e9a4050b-ce4d-4d22-a4b3-2754458000bc tempest-VolumesActionsTest-510530160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-8cef48cd-ec0f-4f84-9c1a-f8c78b050eed" returned: 0 in 0.591s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e9a4050b-ce4d-4d22-a4b3-2754458000bc tempest-VolumesActionsTest-510530160 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:41:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e9a4050b-ce4d-4d22-a4b3-2754458000bc tempest-VolumesActionsTest-510530160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:41:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e9a4050b-ce4d-4d22-a4b3-2754458000bc tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e03f0dd7-f81e-4b80-9bf3-6c0bc41b61c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cef48cd-ec0f-4f84-9c1a-f8c78b050eed', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e9a4050b-ce4d-4d22-a4b3-2754458000bc tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d50edf6-f736-412a-9549-90d85701a4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:27 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-e9a4050b-ce4d-4d22-a4b3-2754458000bc tempest-VolumesActionsTest-510530160 None] Volume volume-8cef48cd-ec0f-4f84-9c1a-f8c78b050eed (8cef48cd-ec0f-4f84-9c1a-f8c78b050eed): created successfully Jul 28 10:41:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e9a4050b-ce4d-4d22-a4b3-2754458000bc tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d50edf6-f736-412a-9549-90d85701a4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e9a4050b-ce4d-4d22-a4b3-2754458000bc tempest-VolumesActionsTest-510530160 None] Flow 'volume_create_manager' (09fa6b57-9c03-40ff-801c-36d42a150eb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:41:27 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-e9a4050b-ce4d-4d22-a4b3-2754458000bc tempest-VolumesActionsTest-510530160 None] Created volume successfully. Jul 28 10:41:27 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-cb6e4945-09bc-4a47-b808-7af57b470e96 tempest-VolumesActionsTest-510530160 None] Acquiring lock "cinder-8cef48cd-ec0f-4f84-9c1a-f8c78b050eed" by "attach_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:41:27 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-cb6e4945-09bc-4a47-b808-7af57b470e96 tempest-VolumesActionsTest-510530160 None] Lock "cinder-8cef48cd-ec0f-4f84-9c1a-f8c78b050eed" acquired by "attach_volume" :: waited 0.038s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:41:27 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-cb6e4945-09bc-4a47-b808-7af57b470e96 tempest-VolumesActionsTest-510530160 None] Attaching volume 8cef48cd-ec0f-4f84-9c1a-f8c78b050eed to instance c5f7e1af-0743-44c1-96ba-f75e353431c8 at mountpoint /dev/vdb on host None. Jul 28 10:41:28 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-cb6e4945-09bc-4a47-b808-7af57b470e96 tempest-VolumesActionsTest-510530160 None] Attach volume completed successfully. Jul 28 10:41:28 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-cb6e4945-09bc-4a47-b808-7af57b470e96 tempest-VolumesActionsTest-510530160 None] Lock "cinder-8cef48cd-ec0f-4f84-9c1a-f8c78b050eed" released by "attach_volume" :: held 0.212s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:41:28 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:41:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:41:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:41:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:41:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:41:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:41:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:28 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-85386ffa-88a3-449f-a6c8-c5907b16e6c3 tempest-VolumesTestJSON-491418765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:41:28 devstack sudo[95371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:41:28 devstack sudo[95371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-85386ffa-88a3-449f-a6c8-c5907b16e6c3 tempest-VolumesTestJSON-491418765 None] Flow 'volume_create_manager' (aa7e20ba-fa2b-43ce-9486-740133ccd414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:41:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-85386ffa-88a3-449f-a6c8-c5907b16e6c3 tempest-VolumesTestJSON-491418765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08798a97-1f22-478a-9b4b-fee183473036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-85386ffa-88a3-449f-a6c8-c5907b16e6c3 tempest-VolumesTestJSON-491418765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08798a97-1f22-478a-9b4b-fee183473036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1095778529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b702c4b-f455-4619-8150-fc393c6f1227,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fd3cdd5d1a2341018f0c038123447d6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:41:28Z,use_quota=True,user_id='af106568f69e4a1eaf105688227470bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-85386ffa-88a3-449f-a6c8-c5907b16e6c3 tempest-VolumesTestJSON-491418765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f05aa60c-d9ca-4045-b645-63095eb7a1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-85386ffa-88a3-449f-a6c8-c5907b16e6c3 tempest-VolumesTestJSON-491418765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f05aa60c-d9ca-4045-b645-63095eb7a1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-85386ffa-88a3-449f-a6c8-c5907b16e6c3 tempest-VolumesTestJSON-491418765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6df0ab5d-19eb-440d-bdfd-ed339d924de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-85386ffa-88a3-449f-a6c8-c5907b16e6c3 tempest-VolumesTestJSON-491418765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6df0ab5d-19eb-440d-bdfd-ed339d924de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b702c4b-f455-4619-8150-fc393c6f1227', 'volume_name': 'volume-7b702c4b-f455-4619-8150-fc393c6f1227', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-85386ffa-88a3-449f-a6c8-c5907b16e6c3 tempest-VolumesTestJSON-491418765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d6c9204-0749-447c-8f20-aaeabe76ed0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-85386ffa-88a3-449f-a6c8-c5907b16e6c3 tempest-VolumesTestJSON-491418765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d6c9204-0749-447c-8f20-aaeabe76ed0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-85386ffa-88a3-449f-a6c8-c5907b16e6c3 tempest-VolumesTestJSON-491418765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60891b5b-c0ab-4e76-9c4f-85389bf11e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:28 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-85386ffa-88a3-449f-a6c8-c5907b16e6c3 tempest-VolumesTestJSON-491418765 None] Volume 7b702c4b-f455-4619-8150-fc393c6f1227: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b702c4b-f455-4619-8150-fc393c6f1227', 'volume_size': 1} Jul 28 10:41:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-85386ffa-88a3-449f-a6c8-c5907b16e6c3 tempest-VolumesTestJSON-491418765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:41:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-85386ffa-88a3-449f-a6c8-c5907b16e6c3 tempest-VolumesTestJSON-491418765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:41:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-85386ffa-88a3-449f-a6c8-c5907b16e6c3 tempest-VolumesTestJSON-491418765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1095778529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b702c4b-f455-4619-8150-fc393c6f1227,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fd3cdd5d1a2341018f0c038123447d6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:41:28Z,use_quota=True,user_id='af106568f69e4a1eaf105688227470bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:41:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-85386ffa-88a3-449f-a6c8-c5907b16e6c3 tempest-VolumesTestJSON-491418765 None] Creating volume 7b702c4b-f455-4619-8150-fc393c6f1227 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:41:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-85386ffa-88a3-449f-a6c8-c5907b16e6c3 tempest-VolumesTestJSON-491418765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:41:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-85386ffa-88a3-449f-a6c8-c5907b16e6c3 tempest-VolumesTestJSON-491418765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:41:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-85386ffa-88a3-449f-a6c8-c5907b16e6c3 tempest-VolumesTestJSON-491418765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:41:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-85386ffa-88a3-449f-a6c8-c5907b16e6c3 tempest-VolumesTestJSON-491418765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:41:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-85386ffa-88a3-449f-a6c8-c5907b16e6c3 tempest-VolumesTestJSON-491418765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:41:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-85386ffa-88a3-449f-a6c8-c5907b16e6c3 tempest-VolumesTestJSON-491418765 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:41:28 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-85386ffa-88a3-449f-a6c8-c5907b16e6c3 tempest-VolumesTestJSON-491418765 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:41:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-85386ffa-88a3-449f-a6c8-c5907b16e6c3 tempest-VolumesTestJSON-491418765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7b702c4b-f455-4619-8150-fc393c6f1227 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:28 devstack sudo[95373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7b702c4b-f455-4619-8150-fc393c6f1227 1073741824 Jul 28 10:41:28 devstack sudo[95373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:29 devstack sudo[95371]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.603s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:29 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:41:29 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager._thread_info {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:41:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread count: 8 {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 10:41:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread info: [<_MainThread(MainThread, started 137939890385024)>, , , , , , , ] {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 10:41:29 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-eb6c404d-4889-4981-9dc3-daf7fe179e90 tempest-VolumesActionsTest-1738740243 None] Terminate volume connection completed successfully. Jul 28 10:41:29 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-eb6c404d-4889-4981-9dc3-daf7fe179e90 tempest-VolumesActionsTest-1738740243 None] Acquiring lock "cinder-8cef48cd-ec0f-4f84-9c1a-f8c78b050eed-detach_volume" by "detach_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:41:29 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-eb6c404d-4889-4981-9dc3-daf7fe179e90 tempest-VolumesActionsTest-1738740243 None] Lock "cinder-8cef48cd-ec0f-4f84-9c1a-f8c78b050eed-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:41:29 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-eb6c404d-4889-4981-9dc3-daf7fe179e90 tempest-VolumesActionsTest-1738740243 None] Detaching volume 8cef48cd-ec0f-4f84-9c1a-f8c78b050eed from instance c5f7e1af-0743-44c1-96ba-f75e353431c8. Jul 28 10:41:29 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-eb6c404d-4889-4981-9dc3-daf7fe179e90 tempest-VolumesActionsTest-1738740243 None] Detach volume completed successfully. Jul 28 10:41:29 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-eb6c404d-4889-4981-9dc3-daf7fe179e90 tempest-VolumesActionsTest-1738740243 None] Lock "cinder-8cef48cd-ec0f-4f84-9c1a-f8c78b050eed-detach_volume" released by "detach_volume" :: held 0.146s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:41:29 devstack sudo[95373]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-85386ffa-88a3-449f-a6c8-c5907b16e6c3 tempest-VolumesTestJSON-491418765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7b702c4b-f455-4619-8150-fc393c6f1227 1073741824" returned: 0 in 0.787s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-85386ffa-88a3-449f-a6c8-c5907b16e6c3 tempest-VolumesTestJSON-491418765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7b702c4b-f455-4619-8150-fc393c6f1227 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:29 devstack sudo[95381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7b702c4b-f455-4619-8150-fc393c6f1227 Jul 28 10:41:29 devstack sudo[95381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:29 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-c065a2a8-0dc5-4f77-823c-b093ecf498a7 tempest-VolumesActionsTest-510530160 None] Acquiring lock "cinder-8cef48cd-ec0f-4f84-9c1a-f8c78b050eed-detach_volume" by "detach_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:41:29 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-c065a2a8-0dc5-4f77-823c-b093ecf498a7 tempest-VolumesActionsTest-510530160 None] Lock "cinder-8cef48cd-ec0f-4f84-9c1a-f8c78b050eed-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:41:29 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-c065a2a8-0dc5-4f77-823c-b093ecf498a7 tempest-VolumesActionsTest-510530160 None] Volume detach called, but volume not attached. Jul 28 10:41:29 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-c065a2a8-0dc5-4f77-823c-b093ecf498a7 tempest-VolumesActionsTest-510530160 None] Lock "cinder-8cef48cd-ec0f-4f84-9c1a-f8c78b050eed-detach_volume" released by "detach_volume" :: held 0.028s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:41:30 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-26244a9e-ef53-4224-8d7c-2307b3fd6d49 tempest-VolumesActionsTest-510530160 None] Acquiring lock "cinder-8cef48cd-ec0f-4f84-9c1a-f8c78b050eed-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:41:30 devstack sudo[95381]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-85386ffa-88a3-449f-a6c8-c5907b16e6c3 tempest-VolumesTestJSON-491418765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7b702c4b-f455-4619-8150-fc393c6f1227" returned: 0 in 0.561s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:30 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-85386ffa-88a3-449f-a6c8-c5907b16e6c3 tempest-VolumesTestJSON-491418765 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:41:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-85386ffa-88a3-449f-a6c8-c5907b16e6c3 tempest-VolumesTestJSON-491418765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.432s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:41:30 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-26244a9e-ef53-4224-8d7c-2307b3fd6d49 tempest-VolumesActionsTest-510530160 None] Lock "cinder-8cef48cd-ec0f-4f84-9c1a-f8c78b050eed-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:41:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-85386ffa-88a3-449f-a6c8-c5907b16e6c3 tempest-VolumesTestJSON-491418765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60891b5b-c0ab-4e76-9c4f-85389bf11e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b702c4b-f455-4619-8150-fc393c6f1227', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-85386ffa-88a3-449f-a6c8-c5907b16e6c3 tempest-VolumesTestJSON-491418765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d04fb85-d129-4791-915c-22957691136e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:30 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-85386ffa-88a3-449f-a6c8-c5907b16e6c3 tempest-VolumesTestJSON-491418765 None] Volume volume-7b702c4b-f455-4619-8150-fc393c6f1227 (7b702c4b-f455-4619-8150-fc393c6f1227): created successfully Jul 28 10:41:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-85386ffa-88a3-449f-a6c8-c5907b16e6c3 tempest-VolumesTestJSON-491418765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d04fb85-d129-4791-915c-22957691136e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-85386ffa-88a3-449f-a6c8-c5907b16e6c3 tempest-VolumesTestJSON-491418765 None] Flow 'volume_create_manager' (aa7e20ba-fa2b-43ce-9486-740133ccd414) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:41:30 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-26244a9e-ef53-4224-8d7c-2307b3fd6d49 tempest-VolumesActionsTest-510530160 None] Acquiring lock "cinder-quobyte-8cef48cd-ec0f-4f84-9c1a-f8c78b050eed" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:41:30 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-85386ffa-88a3-449f-a6c8-c5907b16e6c3 tempest-VolumesTestJSON-491418765 None] Created volume successfully. Jul 28 10:41:30 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-26244a9e-ef53-4224-8d7c-2307b3fd6d49 tempest-VolumesActionsTest-510530160 None] Lock "cinder-quobyte-8cef48cd-ec0f-4f84-9c1a-f8c78b050eed" acquired by "delete_volume" :: waited 0.034s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:41:30 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c28cf0c-47ba-4f90-a784-6f5fa7897efb]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:41:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-26244a9e-ef53-4224-8d7c-2307b3fd6d49 tempest-VolumesActionsTest-510530160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-8cef48cd-ec0f-4f84-9c1a-f8c78b050eed {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:30 devstack sudo[95384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-8cef48cd-ec0f-4f84-9c1a-f8c78b050eed Jul 28 10:41:30 devstack sudo[95384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:31 devstack sudo[95384]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-26244a9e-ef53-4224-8d7c-2307b3fd6d49 tempest-VolumesActionsTest-510530160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-8cef48cd-ec0f-4f84-9c1a-f8c78b050eed" returned: 0 in 0.759s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-26244a9e-ef53-4224-8d7c-2307b3fd6d49 tempest-VolumesActionsTest-510530160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-8cef48cd-ec0f-4f84-9c1a-f8c78b050eed {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:31 devstack sudo[95390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-8cef48cd-ec0f-4f84-9c1a-f8c78b050eed Jul 28 10:41:31 devstack sudo[95390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:31 devstack sudo[95390]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-26244a9e-ef53-4224-8d7c-2307b3fd6d49 tempest-VolumesActionsTest-510530160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-8cef48cd-ec0f-4f84-9c1a-f8c78b050eed" returned: 0 in 0.440s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:31 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-26244a9e-ef53-4224-8d7c-2307b3fd6d49 tempest-VolumesActionsTest-510530160 None] Lock "cinder-quobyte-8cef48cd-ec0f-4f84-9c1a-f8c78b050eed" released by "delete_volume" :: held 1.274s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:41:31 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-26244a9e-ef53-4224-8d7c-2307b3fd6d49 tempest-VolumesActionsTest-510530160 None] Created reservations ['8aafbdf1-01ff-4eb0-8929-bbcd9ecf2007', '5744e4c7-68f1-456b-81da-f369a5a20aa9', '1b8efa85-8d31-4dea-b6e3-774d9c4a071f', '02e7b030-d44d-4aa4-986d-d6ac630ffb9c'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:41:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-26244a9e-ef53-4224-8d7c-2307b3fd6d49 tempest-VolumesActionsTest-510530160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:41:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-26244a9e-ef53-4224-8d7c-2307b3fd6d49 tempest-VolumesActionsTest-510530160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:41:31 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-26244a9e-ef53-4224-8d7c-2307b3fd6d49 tempest-VolumesActionsTest-510530160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:41:31 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-26244a9e-ef53-4224-8d7c-2307b3fd6d49 tempest-VolumesActionsTest-510530160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:41:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-26244a9e-ef53-4224-8d7c-2307b3fd6d49 tempest-VolumesActionsTest-510530160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:41:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-26244a9e-ef53-4224-8d7c-2307b3fd6d49 tempest-VolumesActionsTest-510530160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:31 devstack sudo[95393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:41:31 devstack sudo[95393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:32 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d7b2b0e-d1a9-4b0e-b312-d501319a196f tempest-VolumesTestJSON-491418765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:41:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d7b2b0e-d1a9-4b0e-b312-d501319a196f tempest-VolumesTestJSON-491418765 None] Flow 'volume_create_manager' (83f99e53-b433-419b-b8d1-ea82da407788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:41:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d7b2b0e-d1a9-4b0e-b312-d501319a196f tempest-VolumesTestJSON-491418765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8419cc5b-1335-4dd9-a979-9611bf16156c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d7b2b0e-d1a9-4b0e-b312-d501319a196f tempest-VolumesTestJSON-491418765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8419cc5b-1335-4dd9-a979-9611bf16156c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-608772287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac99dc76-9860-4a93-ae74-a806d94ad0dc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fd3cdd5d1a2341018f0c038123447d6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:41:32Z,use_quota=True,user_id='af106568f69e4a1eaf105688227470bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d7b2b0e-d1a9-4b0e-b312-d501319a196f tempest-VolumesTestJSON-491418765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c74c6852-ec43-4cba-983d-8504be666e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d7b2b0e-d1a9-4b0e-b312-d501319a196f tempest-VolumesTestJSON-491418765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c74c6852-ec43-4cba-983d-8504be666e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d7b2b0e-d1a9-4b0e-b312-d501319a196f tempest-VolumesTestJSON-491418765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (477b8298-f4ce-4cd9-b673-b4397b4186d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d7b2b0e-d1a9-4b0e-b312-d501319a196f tempest-VolumesTestJSON-491418765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (477b8298-f4ce-4cd9-b673-b4397b4186d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac99dc76-9860-4a93-ae74-a806d94ad0dc', 'volume_name': 'volume-ac99dc76-9860-4a93-ae74-a806d94ad0dc', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d7b2b0e-d1a9-4b0e-b312-d501319a196f tempest-VolumesTestJSON-491418765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (698b12c9-4cbb-4e9b-ade3-4f7e40055caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d7b2b0e-d1a9-4b0e-b312-d501319a196f tempest-VolumesTestJSON-491418765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (698b12c9-4cbb-4e9b-ade3-4f7e40055caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d7b2b0e-d1a9-4b0e-b312-d501319a196f tempest-VolumesTestJSON-491418765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bac0981-bab4-4f33-811a-2a8450633fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:32 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-9d7b2b0e-d1a9-4b0e-b312-d501319a196f tempest-VolumesTestJSON-491418765 None] Volume ac99dc76-9860-4a93-ae74-a806d94ad0dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac99dc76-9860-4a93-ae74-a806d94ad0dc', 'volume_size': 1} Jul 28 10:41:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9d7b2b0e-d1a9-4b0e-b312-d501319a196f tempest-VolumesTestJSON-491418765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:41:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9d7b2b0e-d1a9-4b0e-b312-d501319a196f tempest-VolumesTestJSON-491418765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:41:32 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9d7b2b0e-d1a9-4b0e-b312-d501319a196f tempest-VolumesTestJSON-491418765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-608772287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac99dc76-9860-4a93-ae74-a806d94ad0dc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fd3cdd5d1a2341018f0c038123447d6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:41:32Z,use_quota=True,user_id='af106568f69e4a1eaf105688227470bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:41:32 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-9d7b2b0e-d1a9-4b0e-b312-d501319a196f tempest-VolumesTestJSON-491418765 None] Creating volume ac99dc76-9860-4a93-ae74-a806d94ad0dc {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:41:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9d7b2b0e-d1a9-4b0e-b312-d501319a196f tempest-VolumesTestJSON-491418765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:41:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9d7b2b0e-d1a9-4b0e-b312-d501319a196f tempest-VolumesTestJSON-491418765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:41:32 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9d7b2b0e-d1a9-4b0e-b312-d501319a196f tempest-VolumesTestJSON-491418765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:41:32 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9d7b2b0e-d1a9-4b0e-b312-d501319a196f tempest-VolumesTestJSON-491418765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:41:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9d7b2b0e-d1a9-4b0e-b312-d501319a196f tempest-VolumesTestJSON-491418765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:41:32 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9d7b2b0e-d1a9-4b0e-b312-d501319a196f tempest-VolumesTestJSON-491418765 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:41:32 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-9d7b2b0e-d1a9-4b0e-b312-d501319a196f tempest-VolumesTestJSON-491418765 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:41:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9d7b2b0e-d1a9-4b0e-b312-d501319a196f tempest-VolumesTestJSON-491418765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ac99dc76-9860-4a93-ae74-a806d94ad0dc 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:32 devstack sudo[95393]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-26244a9e-ef53-4224-8d7c-2307b3fd6d49 tempest-VolumesActionsTest-510530160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.553s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:32 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-26244a9e-ef53-4224-8d7c-2307b3fd6d49 tempest-VolumesActionsTest-510530160 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:41:32 devstack sudo[95399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ac99dc76-9860-4a93-ae74-a806d94ad0dc 1073741824 Jul 28 10:41:32 devstack sudo[95399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:32 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-26244a9e-ef53-4224-8d7c-2307b3fd6d49 tempest-VolumesActionsTest-510530160 None] Deleted volume successfully. Jul 28 10:41:32 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-26244a9e-ef53-4224-8d7c-2307b3fd6d49 tempest-VolumesActionsTest-510530160 None] Lock "cinder-8cef48cd-ec0f-4f84-9c1a-f8c78b050eed-delete_volume" released by "delete_volume" :: held 2.308s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:41:33 devstack sudo[95399]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9d7b2b0e-d1a9-4b0e-b312-d501319a196f tempest-VolumesTestJSON-491418765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ac99dc76-9860-4a93-ae74-a806d94ad0dc 1073741824" returned: 0 in 0.829s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9d7b2b0e-d1a9-4b0e-b312-d501319a196f tempest-VolumesTestJSON-491418765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ac99dc76-9860-4a93-ae74-a806d94ad0dc {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:33 devstack sudo[95413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ac99dc76-9860-4a93-ae74-a806d94ad0dc Jul 28 10:41:33 devstack sudo[95413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:33 devstack sudo[95413]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9d7b2b0e-d1a9-4b0e-b312-d501319a196f tempest-VolumesTestJSON-491418765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ac99dc76-9860-4a93-ae74-a806d94ad0dc" returned: 0 in 0.497s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:33 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9d7b2b0e-d1a9-4b0e-b312-d501319a196f tempest-VolumesTestJSON-491418765 None] <== create_volume: return (1393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:41:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9d7b2b0e-d1a9-4b0e-b312-d501319a196f tempest-VolumesTestJSON-491418765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:41:33 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d7b2b0e-d1a9-4b0e-b312-d501319a196f tempest-VolumesTestJSON-491418765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bac0981-bab4-4f33-811a-2a8450633fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac99dc76-9860-4a93-ae74-a806d94ad0dc', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:33 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d7b2b0e-d1a9-4b0e-b312-d501319a196f tempest-VolumesTestJSON-491418765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48dbead3-4907-4f3d-8685-a6437dea15a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:33 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-9d7b2b0e-d1a9-4b0e-b312-d501319a196f tempest-VolumesTestJSON-491418765 None] Volume volume-ac99dc76-9860-4a93-ae74-a806d94ad0dc (ac99dc76-9860-4a93-ae74-a806d94ad0dc): created successfully Jul 28 10:41:33 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d7b2b0e-d1a9-4b0e-b312-d501319a196f tempest-VolumesTestJSON-491418765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48dbead3-4907-4f3d-8685-a6437dea15a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:33 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d7b2b0e-d1a9-4b0e-b312-d501319a196f tempest-VolumesTestJSON-491418765 None] Flow 'volume_create_manager' (83f99e53-b433-419b-b8d1-ea82da407788) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:41:33 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-9d7b2b0e-d1a9-4b0e-b312-d501319a196f tempest-VolumesTestJSON-491418765 None] Created volume successfully. Jul 28 10:41:34 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e8f21bf-c253-417a-9f4d-80a698bceafc tempest-VolumesTestJSON-491418765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:41:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2e8f21bf-c253-417a-9f4d-80a698bceafc tempest-VolumesTestJSON-491418765 None] Flow 'volume_create_manager' (f91a2fa9-b43f-494b-bc3f-93fe5e070088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:41:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2e8f21bf-c253-417a-9f4d-80a698bceafc tempest-VolumesTestJSON-491418765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae8f781-342f-46b7-9e1d-db1cb530a149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2e8f21bf-c253-417a-9f4d-80a698bceafc tempest-VolumesTestJSON-491418765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae8f781-342f-46b7-9e1d-db1cb530a149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:41:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-580321721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3400cbda-61d7-4118-bb03-73f497943a0f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fd3cdd5d1a2341018f0c038123447d6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:41:35Z,use_quota=True,user_id='af106568f69e4a1eaf105688227470bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2e8f21bf-c253-417a-9f4d-80a698bceafc tempest-VolumesTestJSON-491418765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a0551f0-bd63-46bf-a9db-c39c984feb5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2e8f21bf-c253-417a-9f4d-80a698bceafc tempest-VolumesTestJSON-491418765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a0551f0-bd63-46bf-a9db-c39c984feb5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2e8f21bf-c253-417a-9f4d-80a698bceafc tempest-VolumesTestJSON-491418765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c3c616f-3df3-4987-94c3-dc7f4764444b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2e8f21bf-c253-417a-9f4d-80a698bceafc tempest-VolumesTestJSON-491418765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c3c616f-3df3-4987-94c3-dc7f4764444b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3400cbda-61d7-4118-bb03-73f497943a0f', 'volume_name': 'volume-3400cbda-61d7-4118-bb03-73f497943a0f', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2e8f21bf-c253-417a-9f4d-80a698bceafc tempest-VolumesTestJSON-491418765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e06e3b81-3034-4ad4-9d62-664a804705cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2e8f21bf-c253-417a-9f4d-80a698bceafc tempest-VolumesTestJSON-491418765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e06e3b81-3034-4ad4-9d62-664a804705cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2e8f21bf-c253-417a-9f4d-80a698bceafc tempest-VolumesTestJSON-491418765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55127635-f412-4952-805c-8de898b86483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:34 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-2e8f21bf-c253-417a-9f4d-80a698bceafc tempest-VolumesTestJSON-491418765 None] Volume 3400cbda-61d7-4118-bb03-73f497943a0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3400cbda-61d7-4118-bb03-73f497943a0f', 'volume_size': 1} Jul 28 10:41:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-2e8f21bf-c253-417a-9f4d-80a698bceafc tempest-VolumesTestJSON-491418765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:41:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-2e8f21bf-c253-417a-9f4d-80a698bceafc tempest-VolumesTestJSON-491418765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:41:34 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-2e8f21bf-c253-417a-9f4d-80a698bceafc tempest-VolumesTestJSON-491418765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:41:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-580321721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3400cbda-61d7-4118-bb03-73f497943a0f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fd3cdd5d1a2341018f0c038123447d6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:41:35Z,use_quota=True,user_id='af106568f69e4a1eaf105688227470bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:41:34 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-2e8f21bf-c253-417a-9f4d-80a698bceafc tempest-VolumesTestJSON-491418765 None] Creating volume 3400cbda-61d7-4118-bb03-73f497943a0f {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:41:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-2e8f21bf-c253-417a-9f4d-80a698bceafc tempest-VolumesTestJSON-491418765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:41:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-2e8f21bf-c253-417a-9f4d-80a698bceafc tempest-VolumesTestJSON-491418765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:41:34 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-2e8f21bf-c253-417a-9f4d-80a698bceafc tempest-VolumesTestJSON-491418765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:41:34 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-2e8f21bf-c253-417a-9f4d-80a698bceafc tempest-VolumesTestJSON-491418765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:41:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-2e8f21bf-c253-417a-9f4d-80a698bceafc tempest-VolumesTestJSON-491418765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:41:34 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-2e8f21bf-c253-417a-9f4d-80a698bceafc tempest-VolumesTestJSON-491418765 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:41:34 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-2e8f21bf-c253-417a-9f4d-80a698bceafc tempest-VolumesTestJSON-491418765 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:41:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2e8f21bf-c253-417a-9f4d-80a698bceafc tempest-VolumesTestJSON-491418765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3400cbda-61d7-4118-bb03-73f497943a0f 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:35 devstack sudo[95437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3400cbda-61d7-4118-bb03-73f497943a0f 1073741824 Jul 28 10:41:35 devstack sudo[95437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:35 devstack sudo[95437]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2e8f21bf-c253-417a-9f4d-80a698bceafc tempest-VolumesTestJSON-491418765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3400cbda-61d7-4118-bb03-73f497943a0f 1073741824" returned: 0 in 0.556s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2e8f21bf-c253-417a-9f4d-80a698bceafc tempest-VolumesTestJSON-491418765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3400cbda-61d7-4118-bb03-73f497943a0f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:35 devstack sudo[95445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3400cbda-61d7-4118-bb03-73f497943a0f Jul 28 10:41:35 devstack sudo[95445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:35 devstack sudo[95445]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2e8f21bf-c253-417a-9f4d-80a698bceafc tempest-VolumesTestJSON-491418765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3400cbda-61d7-4118-bb03-73f497943a0f" returned: 0 in 0.354s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:36 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-2e8f21bf-c253-417a-9f4d-80a698bceafc tempest-VolumesTestJSON-491418765 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:41:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-2e8f21bf-c253-417a-9f4d-80a698bceafc tempest-VolumesTestJSON-491418765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:41:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2e8f21bf-c253-417a-9f4d-80a698bceafc tempest-VolumesTestJSON-491418765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55127635-f412-4952-805c-8de898b86483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3400cbda-61d7-4118-bb03-73f497943a0f', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2e8f21bf-c253-417a-9f4d-80a698bceafc tempest-VolumesTestJSON-491418765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd32801-2e50-450b-b6ec-ac20df08ed68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:36 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-2e8f21bf-c253-417a-9f4d-80a698bceafc tempest-VolumesTestJSON-491418765 None] Volume volume-3400cbda-61d7-4118-bb03-73f497943a0f (3400cbda-61d7-4118-bb03-73f497943a0f): created successfully Jul 28 10:41:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2e8f21bf-c253-417a-9f4d-80a698bceafc tempest-VolumesTestJSON-491418765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd32801-2e50-450b-b6ec-ac20df08ed68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2e8f21bf-c253-417a-9f4d-80a698bceafc tempest-VolumesTestJSON-491418765 None] Flow 'volume_create_manager' (f91a2fa9-b43f-494b-bc3f-93fe5e070088) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:41:36 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-2e8f21bf-c253-417a-9f4d-80a698bceafc tempest-VolumesTestJSON-491418765 None] Created volume successfully. Jul 28 10:41:38 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3ce1ad3-e979-480e-bc3b-d193f2c87fe3 tempest-VolumesActionsTest-510530160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:41:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a3ce1ad3-e979-480e-bc3b-d193f2c87fe3 tempest-VolumesActionsTest-510530160 None] Flow 'volume_create_manager' (1443ea90-202a-4875-82e9-a915cf197772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:41:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a3ce1ad3-e979-480e-bc3b-d193f2c87fe3 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adce3a35-3d00-43fc-8dd6-ea282f92e274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:38 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f8981316-5691-4f86-89df-de26641643df tempest-VolumesTestJSON-491418765 None] Acquiring lock "cinder-3400cbda-61d7-4118-bb03-73f497943a0f-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:41:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a3ce1ad3-e979-480e-bc3b-d193f2c87fe3 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adce3a35-3d00-43fc-8dd6-ea282f92e274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:41:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1580922332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c91289c1-5f3b-4cfc-b35e-0fca047a81b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95375aecc7264185b1fbef4b61ea9c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:41:38Z,use_quota=True,user_id='784e408de64245578eb1a307088e85f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a3ce1ad3-e979-480e-bc3b-d193f2c87fe3 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a54284c-2723-4d20-b1bb-a57483c2351c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a3ce1ad3-e979-480e-bc3b-d193f2c87fe3 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a54284c-2723-4d20-b1bb-a57483c2351c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a3ce1ad3-e979-480e-bc3b-d193f2c87fe3 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df916f9f-b45d-46b4-b2d3-b24ab5ace7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a3ce1ad3-e979-480e-bc3b-d193f2c87fe3 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df916f9f-b45d-46b4-b2d3-b24ab5ace7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c91289c1-5f3b-4cfc-b35e-0fca047a81b3', 'volume_name': 'volume-c91289c1-5f3b-4cfc-b35e-0fca047a81b3', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a3ce1ad3-e979-480e-bc3b-d193f2c87fe3 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8065db90-2ecf-4e0b-a6d1-307586a683a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a3ce1ad3-e979-480e-bc3b-d193f2c87fe3 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8065db90-2ecf-4e0b-a6d1-307586a683a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a3ce1ad3-e979-480e-bc3b-d193f2c87fe3 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b7a1617-34f5-4183-88b6-1665e5c34244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:38 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-a3ce1ad3-e979-480e-bc3b-d193f2c87fe3 tempest-VolumesActionsTest-510530160 None] Volume c91289c1-5f3b-4cfc-b35e-0fca047a81b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c91289c1-5f3b-4cfc-b35e-0fca047a81b3', 'volume_size': 1} Jul 28 10:41:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a3ce1ad3-e979-480e-bc3b-d193f2c87fe3 tempest-VolumesActionsTest-510530160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:41:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a3ce1ad3-e979-480e-bc3b-d193f2c87fe3 tempest-VolumesActionsTest-510530160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:41:38 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-a3ce1ad3-e979-480e-bc3b-d193f2c87fe3 tempest-VolumesActionsTest-510530160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:41:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1580922332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c91289c1-5f3b-4cfc-b35e-0fca047a81b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95375aecc7264185b1fbef4b61ea9c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:41:38Z,use_quota=True,user_id='784e408de64245578eb1a307088e85f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:41:38 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-a3ce1ad3-e979-480e-bc3b-d193f2c87fe3 tempest-VolumesActionsTest-510530160 None] Creating volume c91289c1-5f3b-4cfc-b35e-0fca047a81b3 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:41:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a3ce1ad3-e979-480e-bc3b-d193f2c87fe3 tempest-VolumesActionsTest-510530160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:41:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a3ce1ad3-e979-480e-bc3b-d193f2c87fe3 tempest-VolumesActionsTest-510530160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:41:38 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-a3ce1ad3-e979-480e-bc3b-d193f2c87fe3 tempest-VolumesActionsTest-510530160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:41:38 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-a3ce1ad3-e979-480e-bc3b-d193f2c87fe3 tempest-VolumesActionsTest-510530160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:41:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a3ce1ad3-e979-480e-bc3b-d193f2c87fe3 tempest-VolumesActionsTest-510530160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:41:38 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-a3ce1ad3-e979-480e-bc3b-d193f2c87fe3 tempest-VolumesActionsTest-510530160 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:41:38 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-a3ce1ad3-e979-480e-bc3b-d193f2c87fe3 tempest-VolumesActionsTest-510530160 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:41:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a3ce1ad3-e979-480e-bc3b-d193f2c87fe3 tempest-VolumesActionsTest-510530160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c91289c1-5f3b-4cfc-b35e-0fca047a81b3 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:38 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f8981316-5691-4f86-89df-de26641643df tempest-VolumesTestJSON-491418765 None] Lock "cinder-3400cbda-61d7-4118-bb03-73f497943a0f-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:41:38 devstack sudo[95448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c91289c1-5f3b-4cfc-b35e-0fca047a81b3 1073741824 Jul 28 10:41:38 devstack sudo[95448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:38 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f8981316-5691-4f86-89df-de26641643df tempest-VolumesTestJSON-491418765 None] Acquiring lock "cinder-quobyte-3400cbda-61d7-4118-bb03-73f497943a0f" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:41:38 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f8981316-5691-4f86-89df-de26641643df tempest-VolumesTestJSON-491418765 None] Lock "cinder-quobyte-3400cbda-61d7-4118-bb03-73f497943a0f" acquired by "delete_volume" :: waited 0.024s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:41:38 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[af46698b-5d51-4e67-b5ec-7bf3ec4caec0]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:41:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f8981316-5691-4f86-89df-de26641643df tempest-VolumesTestJSON-491418765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3400cbda-61d7-4118-bb03-73f497943a0f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:38 devstack sudo[95450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3400cbda-61d7-4118-bb03-73f497943a0f Jul 28 10:41:38 devstack sudo[95450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:38 devstack sudo[95448]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a3ce1ad3-e979-480e-bc3b-d193f2c87fe3 tempest-VolumesActionsTest-510530160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c91289c1-5f3b-4cfc-b35e-0fca047a81b3 1073741824" returned: 0 in 0.607s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:38 devstack sudo[95450]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f8981316-5691-4f86-89df-de26641643df tempest-VolumesTestJSON-491418765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3400cbda-61d7-4118-bb03-73f497943a0f" returned: 0 in 0.487s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f8981316-5691-4f86-89df-de26641643df tempest-VolumesTestJSON-491418765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3400cbda-61d7-4118-bb03-73f497943a0f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:38 devstack sudo[95459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3400cbda-61d7-4118-bb03-73f497943a0f Jul 28 10:41:38 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a3ce1ad3-e979-480e-bc3b-d193f2c87fe3 tempest-VolumesActionsTest-510530160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c91289c1-5f3b-4cfc-b35e-0fca047a81b3 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:39 devstack sudo[95461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c91289c1-5f3b-4cfc-b35e-0fca047a81b3 Jul 28 10:41:39 devstack sudo[95461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:39 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:39 devstack sudo[95461]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f8981316-5691-4f86-89df-de26641643df tempest-VolumesTestJSON-491418765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3400cbda-61d7-4118-bb03-73f497943a0f" returned: 0 in 0.347s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a3ce1ad3-e979-480e-bc3b-d193f2c87fe3 tempest-VolumesActionsTest-510530160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c91289c1-5f3b-4cfc-b35e-0fca047a81b3" returned: 0 in 0.330s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:39 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-a3ce1ad3-e979-480e-bc3b-d193f2c87fe3 tempest-VolumesActionsTest-510530160 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:41:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a3ce1ad3-e979-480e-bc3b-d193f2c87fe3 tempest-VolumesActionsTest-510530160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:41:39 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f8981316-5691-4f86-89df-de26641643df tempest-VolumesTestJSON-491418765 None] Lock "cinder-quobyte-3400cbda-61d7-4118-bb03-73f497943a0f" released by "delete_volume" :: held 0.912s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:41:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a3ce1ad3-e979-480e-bc3b-d193f2c87fe3 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b7a1617-34f5-4183-88b6-1665e5c34244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c91289c1-5f3b-4cfc-b35e-0fca047a81b3', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a3ce1ad3-e979-480e-bc3b-d193f2c87fe3 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e700c73-1f32-4a57-839b-69a8176a00a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:39 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-a3ce1ad3-e979-480e-bc3b-d193f2c87fe3 tempest-VolumesActionsTest-510530160 None] Volume volume-c91289c1-5f3b-4cfc-b35e-0fca047a81b3 (c91289c1-5f3b-4cfc-b35e-0fca047a81b3): created successfully Jul 28 10:41:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a3ce1ad3-e979-480e-bc3b-d193f2c87fe3 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e700c73-1f32-4a57-839b-69a8176a00a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a3ce1ad3-e979-480e-bc3b-d193f2c87fe3 tempest-VolumesActionsTest-510530160 None] Flow 'volume_create_manager' (1443ea90-202a-4875-82e9-a915cf197772) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:41:39 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-a3ce1ad3-e979-480e-bc3b-d193f2c87fe3 tempest-VolumesActionsTest-510530160 None] Created volume successfully. Jul 28 10:41:39 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-f8981316-5691-4f86-89df-de26641643df tempest-VolumesTestJSON-491418765 None] Created reservations ['c05abbe3-cca1-452a-a128-d5c48210b45a', '2ee2bfbf-2f24-4363-b3a4-5d9418015de3', '8e0f32ab-5917-4b8f-8f23-c2639e02890f', 'ba54fd3d-3a36-4e44-bf57-0504a5c21105'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:41:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f8981316-5691-4f86-89df-de26641643df tempest-VolumesTestJSON-491418765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:41:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f8981316-5691-4f86-89df-de26641643df tempest-VolumesTestJSON-491418765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:41:39 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f8981316-5691-4f86-89df-de26641643df tempest-VolumesTestJSON-491418765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:41:39 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f8981316-5691-4f86-89df-de26641643df tempest-VolumesTestJSON-491418765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:41:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f8981316-5691-4f86-89df-de26641643df tempest-VolumesTestJSON-491418765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:41:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f8981316-5691-4f86-89df-de26641643df tempest-VolumesTestJSON-491418765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:39 devstack sudo[95466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:41:39 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:39 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f8981316-5691-4f86-89df-de26641643df tempest-VolumesTestJSON-491418765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.306s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:39 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-f8981316-5691-4f86-89df-de26641643df tempest-VolumesTestJSON-491418765 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:41:39 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-f8981316-5691-4f86-89df-de26641643df tempest-VolumesTestJSON-491418765 None] Deleted volume successfully. Jul 28 10:41:39 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f8981316-5691-4f86-89df-de26641643df tempest-VolumesTestJSON-491418765 None] Lock "cinder-3400cbda-61d7-4118-bb03-73f497943a0f-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:41:40 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9c977769-593c-414b-9dbd-790918ebf433 tempest-VolumesActionsTest-1738740243 None] Acquiring lock "cinder-c91289c1-5f3b-4cfc-b35e-0fca047a81b3-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:41:40 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9c977769-593c-414b-9dbd-790918ebf433 tempest-VolumesActionsTest-1738740243 None] Lock "cinder-c91289c1-5f3b-4cfc-b35e-0fca047a81b3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:41:40 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9dbf740a-d8d8-4172-985c-f82206cc4920 tempest-VolumesTestJSON-491418765 None] Acquiring lock "cinder-ac99dc76-9860-4a93-ae74-a806d94ad0dc-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:41:40 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9dbf740a-d8d8-4172-985c-f82206cc4920 tempest-VolumesTestJSON-491418765 None] Lock "cinder-ac99dc76-9860-4a93-ae74-a806d94ad0dc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:41:40 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9c977769-593c-414b-9dbd-790918ebf433 tempest-VolumesActionsTest-1738740243 None] Acquiring lock "cinder-quobyte-c91289c1-5f3b-4cfc-b35e-0fca047a81b3" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:41:40 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9c977769-593c-414b-9dbd-790918ebf433 tempest-VolumesActionsTest-1738740243 None] Lock "cinder-quobyte-c91289c1-5f3b-4cfc-b35e-0fca047a81b3" acquired by "delete_volume" :: waited 0.040s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:41:40 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9dbf740a-d8d8-4172-985c-f82206cc4920 tempest-VolumesTestJSON-491418765 None] Acquiring lock "cinder-quobyte-ac99dc76-9860-4a93-ae74-a806d94ad0dc" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:41:40 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a33caae-6d8d-452a-9a9c-3f5acf19f111]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:41:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9c977769-593c-414b-9dbd-790918ebf433 tempest-VolumesActionsTest-1738740243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c91289c1-5f3b-4cfc-b35e-0fca047a81b3 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:40 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9dbf740a-d8d8-4172-985c-f82206cc4920 tempest-VolumesTestJSON-491418765 None] Lock "cinder-quobyte-ac99dc76-9860-4a93-ae74-a806d94ad0dc" acquired by "delete_volume" :: waited 0.031s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:41:40 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[de401f2c-b8e6-4e97-b5ba-fa600993a928]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:41:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9dbf740a-d8d8-4172-985c-f82206cc4920 tempest-VolumesTestJSON-491418765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ac99dc76-9860-4a93-ae74-a806d94ad0dc {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:40 devstack sudo[95469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c91289c1-5f3b-4cfc-b35e-0fca047a81b3 Jul 28 10:41:40 devstack sudo[95469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:40 devstack sudo[95470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ac99dc76-9860-4a93-ae74-a806d94ad0dc Jul 28 10:41:40 devstack sudo[95470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:41 devstack sudo[95469]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9c977769-593c-414b-9dbd-790918ebf433 tempest-VolumesActionsTest-1738740243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c91289c1-5f3b-4cfc-b35e-0fca047a81b3" returned: 0 in 0.455s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9c977769-593c-414b-9dbd-790918ebf433 tempest-VolumesActionsTest-1738740243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c91289c1-5f3b-4cfc-b35e-0fca047a81b3 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:41 devstack sudo[95478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c91289c1-5f3b-4cfc-b35e-0fca047a81b3 Jul 28 10:41:41 devstack sudo[95478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:41 devstack sudo[95470]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9dbf740a-d8d8-4172-985c-f82206cc4920 tempest-VolumesTestJSON-491418765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ac99dc76-9860-4a93-ae74-a806d94ad0dc" returned: 0 in 0.523s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9dbf740a-d8d8-4172-985c-f82206cc4920 tempest-VolumesTestJSON-491418765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ac99dc76-9860-4a93-ae74-a806d94ad0dc {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:41 devstack sudo[95483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ac99dc76-9860-4a93-ae74-a806d94ad0dc Jul 28 10:41:41 devstack sudo[95483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:41 devstack sudo[95478]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9c977769-593c-414b-9dbd-790918ebf433 tempest-VolumesActionsTest-1738740243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c91289c1-5f3b-4cfc-b35e-0fca047a81b3" returned: 0 in 0.366s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:41 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9c977769-593c-414b-9dbd-790918ebf433 tempest-VolumesActionsTest-1738740243 None] Lock "cinder-quobyte-c91289c1-5f3b-4cfc-b35e-0fca047a81b3" released by "delete_volume" :: held 0.897s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:41:41 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-9c977769-593c-414b-9dbd-790918ebf433 tempest-VolumesActionsTest-1738740243 None] Created reservations ['a65e0a5d-30cb-4ea4-8cdd-345a50967074', '6da4c3b4-143b-4d69-8c6d-d6fa1c7c5d58', '0a0f9f6e-0e76-4fa4-9713-5b8308a1c217', 'fdba9865-5c8c-4302-a6c8-6f76e4832637'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:41:41 devstack sudo[95483]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9dbf740a-d8d8-4172-985c-f82206cc4920 tempest-VolumesTestJSON-491418765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ac99dc76-9860-4a93-ae74-a806d94ad0dc" returned: 0 in 0.366s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:41 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9dbf740a-d8d8-4172-985c-f82206cc4920 tempest-VolumesTestJSON-491418765 None] Lock "cinder-quobyte-ac99dc76-9860-4a93-ae74-a806d94ad0dc" released by "delete_volume" :: held 0.960s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:41:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9c977769-593c-414b-9dbd-790918ebf433 tempest-VolumesActionsTest-1738740243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:41:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9c977769-593c-414b-9dbd-790918ebf433 tempest-VolumesActionsTest-1738740243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:41:41 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9c977769-593c-414b-9dbd-790918ebf433 tempest-VolumesActionsTest-1738740243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:41:41 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9c977769-593c-414b-9dbd-790918ebf433 tempest-VolumesActionsTest-1738740243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:41:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9c977769-593c-414b-9dbd-790918ebf433 tempest-VolumesActionsTest-1738740243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:41:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9c977769-593c-414b-9dbd-790918ebf433 tempest-VolumesActionsTest-1738740243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:41 devstack sudo[95490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:41:41 devstack sudo[95490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:41 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-9dbf740a-d8d8-4172-985c-f82206cc4920 tempest-VolumesTestJSON-491418765 None] Created reservations ['69487122-5fa7-408f-ab1b-737b9b65440e', '796d47ec-b26c-45a6-8b20-8271ebbb61d7', '1fe22cc3-0a7d-43c3-9c5f-00ebe2c09daf', '869e6253-d5ed-43b5-a045-0d9a4670d0e7'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:41:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9dbf740a-d8d8-4172-985c-f82206cc4920 tempest-VolumesTestJSON-491418765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:41:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9dbf740a-d8d8-4172-985c-f82206cc4920 tempest-VolumesTestJSON-491418765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:41:41 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9dbf740a-d8d8-4172-985c-f82206cc4920 tempest-VolumesTestJSON-491418765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:41:41 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9dbf740a-d8d8-4172-985c-f82206cc4920 tempest-VolumesTestJSON-491418765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:41:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9dbf740a-d8d8-4172-985c-f82206cc4920 tempest-VolumesTestJSON-491418765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:41:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9dbf740a-d8d8-4172-985c-f82206cc4920 tempest-VolumesTestJSON-491418765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:41 devstack sudo[95492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:41:41 devstack sudo[95492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:41 devstack sudo[95490]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9c977769-593c-414b-9dbd-790918ebf433 tempest-VolumesActionsTest-1738740243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.302s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:41 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-9c977769-593c-414b-9dbd-790918ebf433 tempest-VolumesActionsTest-1738740243 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:41:41 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-9c977769-593c-414b-9dbd-790918ebf433 tempest-VolumesActionsTest-1738740243 None] Deleted volume successfully. Jul 28 10:41:42 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9c977769-593c-414b-9dbd-790918ebf433 tempest-VolumesActionsTest-1738740243 None] Lock "cinder-c91289c1-5f3b-4cfc-b35e-0fca047a81b3-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:41:42 devstack sudo[95492]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9dbf740a-d8d8-4172-985c-f82206cc4920 tempest-VolumesTestJSON-491418765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.373s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:42 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-9dbf740a-d8d8-4172-985c-f82206cc4920 tempest-VolumesTestJSON-491418765 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:41:42 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-9dbf740a-d8d8-4172-985c-f82206cc4920 tempest-VolumesTestJSON-491418765 None] Deleted volume successfully. Jul 28 10:41:42 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9dbf740a-d8d8-4172-985c-f82206cc4920 tempest-VolumesTestJSON-491418765 None] Lock "cinder-ac99dc76-9860-4a93-ae74-a806d94ad0dc-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:41:42 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-de1d6f95-531f-4d2a-85dc-7fc734228d50 tempest-VolumesTestJSON-491418765 None] Acquiring lock "cinder-7b702c4b-f455-4619-8150-fc393c6f1227-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:41:42 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-de1d6f95-531f-4d2a-85dc-7fc734228d50 tempest-VolumesTestJSON-491418765 None] Lock "cinder-7b702c4b-f455-4619-8150-fc393c6f1227-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:41:42 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-de1d6f95-531f-4d2a-85dc-7fc734228d50 tempest-VolumesTestJSON-491418765 None] Acquiring lock "cinder-quobyte-7b702c4b-f455-4619-8150-fc393c6f1227" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:41:42 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-de1d6f95-531f-4d2a-85dc-7fc734228d50 tempest-VolumesTestJSON-491418765 None] Lock "cinder-quobyte-7b702c4b-f455-4619-8150-fc393c6f1227" acquired by "delete_volume" :: waited 0.027s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:41:43 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a41c33-1a64-46d7-a3b6-35a6d921ae63]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:41:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-de1d6f95-531f-4d2a-85dc-7fc734228d50 tempest-VolumesTestJSON-491418765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7b702c4b-f455-4619-8150-fc393c6f1227 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:43 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bef3647-0cb9-4561-a404-006afa3745c7 tempest-VolumesActionsTest-510530160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:41:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7bef3647-0cb9-4561-a404-006afa3745c7 tempest-VolumesActionsTest-510530160 None] Flow 'volume_create_manager' (2c68a601-0a43-4a96-a3a9-9bcc8ac12103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:41:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7bef3647-0cb9-4561-a404-006afa3745c7 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (285fc547-a02a-4569-ada8-a7347cfb9790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7bef3647-0cb9-4561-a404-006afa3745c7 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (285fc547-a02a-4569-ada8-a7347cfb9790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1734794246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f650e4fe-e1be-4aa1-8e52-4ce5bb903e33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95375aecc7264185b1fbef4b61ea9c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:41:43Z,use_quota=True,user_id='784e408de64245578eb1a307088e85f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7bef3647-0cb9-4561-a404-006afa3745c7 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9a05a71-5d52-4a7e-ae9c-10d2bd370d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7bef3647-0cb9-4561-a404-006afa3745c7 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9a05a71-5d52-4a7e-ae9c-10d2bd370d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7bef3647-0cb9-4561-a404-006afa3745c7 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40768ed8-21eb-43c3-bb32-c0f1f6096fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7bef3647-0cb9-4561-a404-006afa3745c7 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40768ed8-21eb-43c3-bb32-c0f1f6096fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f650e4fe-e1be-4aa1-8e52-4ce5bb903e33', 'volume_name': 'volume-f650e4fe-e1be-4aa1-8e52-4ce5bb903e33', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7bef3647-0cb9-4561-a404-006afa3745c7 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (812f2c7f-657e-41cb-b122-86c83db496e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7bef3647-0cb9-4561-a404-006afa3745c7 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (812f2c7f-657e-41cb-b122-86c83db496e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7bef3647-0cb9-4561-a404-006afa3745c7 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9929d24f-f6b8-4c1a-9229-a39a06d73c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:43 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-7bef3647-0cb9-4561-a404-006afa3745c7 tempest-VolumesActionsTest-510530160 None] Volume f650e4fe-e1be-4aa1-8e52-4ce5bb903e33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f650e4fe-e1be-4aa1-8e52-4ce5bb903e33', 'volume_size': 1} Jul 28 10:41:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7bef3647-0cb9-4561-a404-006afa3745c7 tempest-VolumesActionsTest-510530160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:41:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7bef3647-0cb9-4561-a404-006afa3745c7 tempest-VolumesActionsTest-510530160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:41:43 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7bef3647-0cb9-4561-a404-006afa3745c7 tempest-VolumesActionsTest-510530160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1734794246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f650e4fe-e1be-4aa1-8e52-4ce5bb903e33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95375aecc7264185b1fbef4b61ea9c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:41:43Z,use_quota=True,user_id='784e408de64245578eb1a307088e85f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:41:43 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-7bef3647-0cb9-4561-a404-006afa3745c7 tempest-VolumesActionsTest-510530160 None] Creating volume f650e4fe-e1be-4aa1-8e52-4ce5bb903e33 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:41:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7bef3647-0cb9-4561-a404-006afa3745c7 tempest-VolumesActionsTest-510530160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:41:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7bef3647-0cb9-4561-a404-006afa3745c7 tempest-VolumesActionsTest-510530160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:41:43 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7bef3647-0cb9-4561-a404-006afa3745c7 tempest-VolumesActionsTest-510530160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:41:43 devstack sudo[95497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7b702c4b-f455-4619-8150-fc393c6f1227 Jul 28 10:41:43 devstack sudo[95497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:43 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7bef3647-0cb9-4561-a404-006afa3745c7 tempest-VolumesActionsTest-510530160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:41:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7bef3647-0cb9-4561-a404-006afa3745c7 tempest-VolumesActionsTest-510530160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:41:43 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7bef3647-0cb9-4561-a404-006afa3745c7 tempest-VolumesActionsTest-510530160 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:41:43 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-7bef3647-0cb9-4561-a404-006afa3745c7 tempest-VolumesActionsTest-510530160 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:41:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7bef3647-0cb9-4561-a404-006afa3745c7 tempest-VolumesActionsTest-510530160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f650e4fe-e1be-4aa1-8e52-4ce5bb903e33 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:43 devstack sudo[95499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f650e4fe-e1be-4aa1-8e52-4ce5bb903e33 1073741824 Jul 28 10:41:43 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:43 devstack sudo[95497]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-de1d6f95-531f-4d2a-85dc-7fc734228d50 tempest-VolumesTestJSON-491418765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7b702c4b-f455-4619-8150-fc393c6f1227" returned: 0 in 0.577s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-de1d6f95-531f-4d2a-85dc-7fc734228d50 tempest-VolumesTestJSON-491418765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7b702c4b-f455-4619-8150-fc393c6f1227 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:43 devstack sudo[95512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7b702c4b-f455-4619-8150-fc393c6f1227 Jul 28 10:41:43 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:43 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7bef3647-0cb9-4561-a404-006afa3745c7 tempest-VolumesActionsTest-510530160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f650e4fe-e1be-4aa1-8e52-4ce5bb903e33 1073741824" returned: 0 in 0.725s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7bef3647-0cb9-4561-a404-006afa3745c7 tempest-VolumesActionsTest-510530160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f650e4fe-e1be-4aa1-8e52-4ce5bb903e33 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:44 devstack sudo[95523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f650e4fe-e1be-4aa1-8e52-4ce5bb903e33 Jul 28 10:41:44 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:44 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-de1d6f95-531f-4d2a-85dc-7fc734228d50 tempest-VolumesTestJSON-491418765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7b702c4b-f455-4619-8150-fc393c6f1227" returned: 0 in 0.504s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:44 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-de1d6f95-531f-4d2a-85dc-7fc734228d50 tempest-VolumesTestJSON-491418765 None] Lock "cinder-quobyte-7b702c4b-f455-4619-8150-fc393c6f1227" released by "delete_volume" :: held 1.160s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:41:44 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-de1d6f95-531f-4d2a-85dc-7fc734228d50 tempest-VolumesTestJSON-491418765 None] Created reservations ['db530c02-a905-40f5-be72-507249656a59', '75f65721-5451-4f79-872d-dcb4155d200e', 'e6209223-e5a5-45c4-8075-5268c21ef9ec', '80cd0b61-eba8-4674-a40e-d9eea4c7e15f'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:41:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-de1d6f95-531f-4d2a-85dc-7fc734228d50 tempest-VolumesTestJSON-491418765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:41:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-de1d6f95-531f-4d2a-85dc-7fc734228d50 tempest-VolumesTestJSON-491418765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:41:44 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-de1d6f95-531f-4d2a-85dc-7fc734228d50 tempest-VolumesTestJSON-491418765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:41:44 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-de1d6f95-531f-4d2a-85dc-7fc734228d50 tempest-VolumesTestJSON-491418765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:41:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-de1d6f95-531f-4d2a-85dc-7fc734228d50 tempest-VolumesTestJSON-491418765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:41:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-de1d6f95-531f-4d2a-85dc-7fc734228d50 tempest-VolumesTestJSON-491418765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:44 devstack sudo[95530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:41:44 devstack sudo[95530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:44 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7bef3647-0cb9-4561-a404-006afa3745c7 tempest-VolumesActionsTest-510530160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f650e4fe-e1be-4aa1-8e52-4ce5bb903e33" returned: 0 in 0.448s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:44 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7bef3647-0cb9-4561-a404-006afa3745c7 tempest-VolumesActionsTest-510530160 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:41:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7bef3647-0cb9-4561-a404-006afa3745c7 tempest-VolumesActionsTest-510530160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:41:44 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7bef3647-0cb9-4561-a404-006afa3745c7 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9929d24f-f6b8-4c1a-9229-a39a06d73c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f650e4fe-e1be-4aa1-8e52-4ce5bb903e33', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:44 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7bef3647-0cb9-4561-a404-006afa3745c7 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd4be961-d2c5-43b0-a47f-a05a991ccb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:44 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-7bef3647-0cb9-4561-a404-006afa3745c7 tempest-VolumesActionsTest-510530160 None] Volume volume-f650e4fe-e1be-4aa1-8e52-4ce5bb903e33 (f650e4fe-e1be-4aa1-8e52-4ce5bb903e33): created successfully Jul 28 10:41:44 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7bef3647-0cb9-4561-a404-006afa3745c7 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd4be961-d2c5-43b0-a47f-a05a991ccb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:44 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7bef3647-0cb9-4561-a404-006afa3745c7 tempest-VolumesActionsTest-510530160 None] Flow 'volume_create_manager' (2c68a601-0a43-4a96-a3a9-9bcc8ac12103) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:41:44 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-7bef3647-0cb9-4561-a404-006afa3745c7 tempest-VolumesActionsTest-510530160 None] Created volume successfully. Jul 28 10:41:44 devstack sudo[95530]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-de1d6f95-531f-4d2a-85dc-7fc734228d50 tempest-VolumesTestJSON-491418765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.283s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:44 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-de1d6f95-531f-4d2a-85dc-7fc734228d50 tempest-VolumesTestJSON-491418765 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:41:44 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-de1d6f95-531f-4d2a-85dc-7fc734228d50 tempest-VolumesTestJSON-491418765 None] Deleted volume successfully. Jul 28 10:41:44 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-de1d6f95-531f-4d2a-85dc-7fc734228d50 tempest-VolumesTestJSON-491418765 None] Lock "cinder-7b702c4b-f455-4619-8150-fc393c6f1227-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:41:45 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8532f1e7-05f0-46c4-813d-ff53e91a4007 tempest-VolumesActionsTest-1738740243 None] Acquiring lock "cinder-f650e4fe-e1be-4aa1-8e52-4ce5bb903e33-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:41:45 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8532f1e7-05f0-46c4-813d-ff53e91a4007 tempest-VolumesActionsTest-1738740243 None] Lock "cinder-f650e4fe-e1be-4aa1-8e52-4ce5bb903e33-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:41:45 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8532f1e7-05f0-46c4-813d-ff53e91a4007 tempest-VolumesActionsTest-1738740243 None] Acquiring lock "cinder-quobyte-f650e4fe-e1be-4aa1-8e52-4ce5bb903e33" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:41:45 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8532f1e7-05f0-46c4-813d-ff53e91a4007 tempest-VolumesActionsTest-1738740243 None] Lock "cinder-quobyte-f650e4fe-e1be-4aa1-8e52-4ce5bb903e33" acquired by "delete_volume" :: waited 0.019s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:41:45 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[b904c2c4-f7c1-44e7-878c-c422736cc7d8]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:41:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8532f1e7-05f0-46c4-813d-ff53e91a4007 tempest-VolumesActionsTest-1738740243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f650e4fe-e1be-4aa1-8e52-4ce5bb903e33 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:45 devstack sudo[95534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f650e4fe-e1be-4aa1-8e52-4ce5bb903e33 Jul 28 10:41:45 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:45 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8532f1e7-05f0-46c4-813d-ff53e91a4007 tempest-VolumesActionsTest-1738740243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f650e4fe-e1be-4aa1-8e52-4ce5bb903e33" returned: 0 in 0.479s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8532f1e7-05f0-46c4-813d-ff53e91a4007 tempest-VolumesActionsTest-1738740243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f650e4fe-e1be-4aa1-8e52-4ce5bb903e33 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:45 devstack sudo[95541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f650e4fe-e1be-4aa1-8e52-4ce5bb903e33 Jul 28 10:41:45 devstack sudo[95541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:46 devstack sudo[95541]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8532f1e7-05f0-46c4-813d-ff53e91a4007 tempest-VolumesActionsTest-1738740243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f650e4fe-e1be-4aa1-8e52-4ce5bb903e33" returned: 0 in 0.363s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:46 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8532f1e7-05f0-46c4-813d-ff53e91a4007 tempest-VolumesActionsTest-1738740243 None] Lock "cinder-quobyte-f650e4fe-e1be-4aa1-8e52-4ce5bb903e33" released by "delete_volume" :: held 0.911s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:41:46 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-8532f1e7-05f0-46c4-813d-ff53e91a4007 tempest-VolumesActionsTest-1738740243 None] Created reservations ['819c5b5b-f3ee-4fdf-8950-ee430c759cc5', '98834c1b-f35c-4a6f-909a-b940dc6b6282', 'ad653134-94a2-4e07-a752-744e00aa4660', '7c9cf308-2b51-481b-9ac0-882c09ffef61'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:41:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8532f1e7-05f0-46c4-813d-ff53e91a4007 tempest-VolumesActionsTest-1738740243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:41:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8532f1e7-05f0-46c4-813d-ff53e91a4007 tempest-VolumesActionsTest-1738740243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:41:46 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8532f1e7-05f0-46c4-813d-ff53e91a4007 tempest-VolumesActionsTest-1738740243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:41:46 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8532f1e7-05f0-46c4-813d-ff53e91a4007 tempest-VolumesActionsTest-1738740243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:41:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8532f1e7-05f0-46c4-813d-ff53e91a4007 tempest-VolumesActionsTest-1738740243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:41:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8532f1e7-05f0-46c4-813d-ff53e91a4007 tempest-VolumesActionsTest-1738740243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:46 devstack sudo[95544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:41:46 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:46 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-5f500ad8-8f44-4711-9f81-cd058fd757d5 tempest-GroupsV314Test-1765692908 None] Group tempest-GroupsV314Test-Group-1381336109: creating Jul 28 10:41:46 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-5f500ad8-8f44-4711-9f81-cd058fd757d5 tempest-GroupsV314Test-1765692908 None] Group tempest-GroupsV314Test-Group-1381336109: created successfully Jul 28 10:41:46 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-5f500ad8-8f44-4711-9f81-cd058fd757d5 tempest-GroupsV314Test-1765692908 None] Create group completed successfully. Jul 28 10:41:47 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8532f1e7-05f0-46c4-813d-ff53e91a4007 tempest-VolumesActionsTest-1738740243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.669s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:47 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-8532f1e7-05f0-46c4-813d-ff53e91a4007 tempest-VolumesActionsTest-1738740243 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:41:47 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-8532f1e7-05f0-46c4-813d-ff53e91a4007 tempest-VolumesActionsTest-1738740243 None] Deleted volume successfully. Jul 28 10:41:47 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8532f1e7-05f0-46c4-813d-ff53e91a4007 tempest-VolumesActionsTest-1738740243 None] Lock "cinder-f650e4fe-e1be-4aa1-8e52-4ce5bb903e33-delete_volume" released by "delete_volume" :: held 1.936s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:41:48 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-db21caf8-6118-449c-b38a-2172c6e00cd8 tempest-VolumesActionsTest-510530160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:41:48 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-db21caf8-6118-449c-b38a-2172c6e00cd8 tempest-VolumesActionsTest-510530160 None] Flow 'volume_create_manager' (a8687042-f645-4b7e-802b-158de3241499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:41:48 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-db21caf8-6118-449c-b38a-2172c6e00cd8 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e1d5bb5-b3e6-4729-a472-9b60b34e3a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:48 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-db21caf8-6118-449c-b38a-2172c6e00cd8 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e1d5bb5-b3e6-4729-a472-9b60b34e3a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2012082799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18e10b13-8319-40b1-aaaf-13677e5e1873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95375aecc7264185b1fbef4b61ea9c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:41:49Z,use_quota=True,user_id='784e408de64245578eb1a307088e85f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:48 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-db21caf8-6118-449c-b38a-2172c6e00cd8 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1fa52e4-1340-4f57-9218-40f4d6fe8be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:48 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-db21caf8-6118-449c-b38a-2172c6e00cd8 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1fa52e4-1340-4f57-9218-40f4d6fe8be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:48 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-db21caf8-6118-449c-b38a-2172c6e00cd8 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cc79e2e-c19c-4624-8418-ea2591485438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:49 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-db21caf8-6118-449c-b38a-2172c6e00cd8 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cc79e2e-c19c-4624-8418-ea2591485438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18e10b13-8319-40b1-aaaf-13677e5e1873', 'volume_name': 'volume-18e10b13-8319-40b1-aaaf-13677e5e1873', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:49 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-db21caf8-6118-449c-b38a-2172c6e00cd8 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb9eb26f-fbc5-4e7a-9533-bdf8d0a3b6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:49 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-db21caf8-6118-449c-b38a-2172c6e00cd8 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb9eb26f-fbc5-4e7a-9533-bdf8d0a3b6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:49 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-db21caf8-6118-449c-b38a-2172c6e00cd8 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1816a810-de64-41b1-ac1e-d37b00e76277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:49 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-db21caf8-6118-449c-b38a-2172c6e00cd8 tempest-VolumesActionsTest-510530160 None] Volume 18e10b13-8319-40b1-aaaf-13677e5e1873: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18e10b13-8319-40b1-aaaf-13677e5e1873', 'volume_size': 1} Jul 28 10:41:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-db21caf8-6118-449c-b38a-2172c6e00cd8 tempest-VolumesActionsTest-510530160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:41:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-db21caf8-6118-449c-b38a-2172c6e00cd8 tempest-VolumesActionsTest-510530160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:41:49 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-db21caf8-6118-449c-b38a-2172c6e00cd8 tempest-VolumesActionsTest-510530160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2012082799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18e10b13-8319-40b1-aaaf-13677e5e1873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95375aecc7264185b1fbef4b61ea9c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:41:49Z,use_quota=True,user_id='784e408de64245578eb1a307088e85f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:41:49 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-db21caf8-6118-449c-b38a-2172c6e00cd8 tempest-VolumesActionsTest-510530160 None] Creating volume 18e10b13-8319-40b1-aaaf-13677e5e1873 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:41:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-db21caf8-6118-449c-b38a-2172c6e00cd8 tempest-VolumesActionsTest-510530160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:41:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-db21caf8-6118-449c-b38a-2172c6e00cd8 tempest-VolumesActionsTest-510530160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:41:49 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-db21caf8-6118-449c-b38a-2172c6e00cd8 tempest-VolumesActionsTest-510530160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:41:49 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-db21caf8-6118-449c-b38a-2172c6e00cd8 tempest-VolumesActionsTest-510530160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:41:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-db21caf8-6118-449c-b38a-2172c6e00cd8 tempest-VolumesActionsTest-510530160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:41:49 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-db21caf8-6118-449c-b38a-2172c6e00cd8 tempest-VolumesActionsTest-510530160 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:41:49 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-db21caf8-6118-449c-b38a-2172c6e00cd8 tempest-VolumesActionsTest-510530160 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:41:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-db21caf8-6118-449c-b38a-2172c6e00cd8 tempest-VolumesActionsTest-510530160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-18e10b13-8319-40b1-aaaf-13677e5e1873 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:49 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f84e136-5e02-4cd4-ba34-8847499ca332 tempest-GroupsV314Test-1765692908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:41:49 devstack sudo[95631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-18e10b13-8319-40b1-aaaf-13677e5e1873 1073741824 Jul 28 10:41:49 devstack sudo[95631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:49 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8f84e136-5e02-4cd4-ba34-8847499ca332 tempest-GroupsV314Test-1765692908 None] Flow 'volume_create_manager' (16c59657-5f2a-441e-bccd-5c046ec64260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:41:49 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8f84e136-5e02-4cd4-ba34-8847499ca332 tempest-GroupsV314Test-1765692908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a45a4d2d-d1a3-406d-a8f8-0f2cb62ec040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:49 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8f84e136-5e02-4cd4-ba34-8847499ca332 tempest-GroupsV314Test-1765692908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a45a4d2d-d1a3-406d-a8f8-0f2cb62ec040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1418990319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f2412963-42f1-4718-b4e8-5007d293bac4,host='devstack@QuobyteHD#QuobyteHD',id=d5c4c162-0f89-4985-a399-e572176f2620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da437e0267cf40ea969954a3c0beabe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:41:49Z,use_quota=True,user_id='ba7ad67a4d474c478dd82ed8960d948a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44fa8d20-5785-4fd0-bd2c-e329f60cc968),volume_type_id=44fa8d20-5785-4fd0-bd2c-e329f60cc968)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:49 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8f84e136-5e02-4cd4-ba34-8847499ca332 tempest-GroupsV314Test-1765692908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34eda544-8161-4c7f-9a2f-72d1c7fe63af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:49 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8f84e136-5e02-4cd4-ba34-8847499ca332 tempest-GroupsV314Test-1765692908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34eda544-8161-4c7f-9a2f-72d1c7fe63af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:49 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8f84e136-5e02-4cd4-ba34-8847499ca332 tempest-GroupsV314Test-1765692908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80e70950-ff5a-48c9-8944-45a28c84b4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:49 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8f84e136-5e02-4cd4-ba34-8847499ca332 tempest-GroupsV314Test-1765692908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80e70950-ff5a-48c9-8944-45a28c84b4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5c4c162-0f89-4985-a399-e572176f2620', 'volume_name': 'volume-d5c4c162-0f89-4985-a399-e572176f2620', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:49 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8f84e136-5e02-4cd4-ba34-8847499ca332 tempest-GroupsV314Test-1765692908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f872fe-c21b-4d3c-a3d4-52dd4885be67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:49 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8f84e136-5e02-4cd4-ba34-8847499ca332 tempest-GroupsV314Test-1765692908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f872fe-c21b-4d3c-a3d4-52dd4885be67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:49 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8f84e136-5e02-4cd4-ba34-8847499ca332 tempest-GroupsV314Test-1765692908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2edfd3b9-2554-4608-87ed-7ecef0141d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:49 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-8f84e136-5e02-4cd4-ba34-8847499ca332 tempest-GroupsV314Test-1765692908 None] Volume d5c4c162-0f89-4985-a399-e572176f2620: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5c4c162-0f89-4985-a399-e572176f2620', 'volume_size': 1} Jul 28 10:41:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8f84e136-5e02-4cd4-ba34-8847499ca332 tempest-GroupsV314Test-1765692908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:41:49 devstack sudo[95631]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-db21caf8-6118-449c-b38a-2172c6e00cd8 tempest-VolumesActionsTest-510530160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-18e10b13-8319-40b1-aaaf-13677e5e1873 1073741824" returned: 0 in 0.684s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-db21caf8-6118-449c-b38a-2172c6e00cd8 tempest-VolumesActionsTest-510530160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-18e10b13-8319-40b1-aaaf-13677e5e1873 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:49 devstack sudo[95641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-18e10b13-8319-40b1-aaaf-13677e5e1873 Jul 28 10:41:49 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:50 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-db21caf8-6118-449c-b38a-2172c6e00cd8 tempest-VolumesActionsTest-510530160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-18e10b13-8319-40b1-aaaf-13677e5e1873" returned: 0 in 0.356s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:50 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-db21caf8-6118-449c-b38a-2172c6e00cd8 tempest-VolumesActionsTest-510530160 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:41:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-db21caf8-6118-449c-b38a-2172c6e00cd8 tempest-VolumesActionsTest-510530160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:41:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8f84e136-5e02-4cd4-ba34-8847499ca332 tempest-GroupsV314Test-1765692908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.966s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:41:50 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8f84e136-5e02-4cd4-ba34-8847499ca332 tempest-GroupsV314Test-1765692908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f2412963-42f1-4718-b4e8-5007d293bac4,created_at=2026-07-28T08:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1418990319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f2412963-42f1-4718-b4e8-5007d293bac4,host='devstack@QuobyteHD#QuobyteHD',id=d5c4c162-0f89-4985-a399-e572176f2620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da437e0267cf40ea969954a3c0beabe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:41:49Z,use_quota=True,user_id='ba7ad67a4d474c478dd82ed8960d948a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44fa8d20-5785-4fd0-bd2c-e329f60cc968),volume_type_id=44fa8d20-5785-4fd0-bd2c-e329f60cc968)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:41:50 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-8f84e136-5e02-4cd4-ba34-8847499ca332 tempest-GroupsV314Test-1765692908 None] Creating volume d5c4c162-0f89-4985-a399-e572176f2620 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:41:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8f84e136-5e02-4cd4-ba34-8847499ca332 tempest-GroupsV314Test-1765692908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:41:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8f84e136-5e02-4cd4-ba34-8847499ca332 tempest-GroupsV314Test-1765692908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:41:50 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8f84e136-5e02-4cd4-ba34-8847499ca332 tempest-GroupsV314Test-1765692908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:41:50 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8f84e136-5e02-4cd4-ba34-8847499ca332 tempest-GroupsV314Test-1765692908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:41:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8f84e136-5e02-4cd4-ba34-8847499ca332 tempest-GroupsV314Test-1765692908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:41:50 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8f84e136-5e02-4cd4-ba34-8847499ca332 tempest-GroupsV314Test-1765692908 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:41:50 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-8f84e136-5e02-4cd4-ba34-8847499ca332 tempest-GroupsV314Test-1765692908 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:41:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8f84e136-5e02-4cd4-ba34-8847499ca332 tempest-GroupsV314Test-1765692908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:50 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-db21caf8-6118-449c-b38a-2172c6e00cd8 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1816a810-de64-41b1-ac1e-d37b00e76277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18e10b13-8319-40b1-aaaf-13677e5e1873', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:50 devstack sudo[95644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620 1073741824 Jul 28 10:41:50 devstack sudo[95644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:50 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-db21caf8-6118-449c-b38a-2172c6e00cd8 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (127f032b-00c4-438d-abda-99db8725abdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:50 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-db21caf8-6118-449c-b38a-2172c6e00cd8 tempest-VolumesActionsTest-510530160 None] Volume volume-18e10b13-8319-40b1-aaaf-13677e5e1873 (18e10b13-8319-40b1-aaaf-13677e5e1873): created successfully Jul 28 10:41:50 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-db21caf8-6118-449c-b38a-2172c6e00cd8 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (127f032b-00c4-438d-abda-99db8725abdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:50 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-db21caf8-6118-449c-b38a-2172c6e00cd8 tempest-VolumesActionsTest-510530160 None] Flow 'volume_create_manager' (a8687042-f645-4b7e-802b-158de3241499) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:41:50 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-db21caf8-6118-449c-b38a-2172c6e00cd8 tempest-VolumesActionsTest-510530160 None] Created volume successfully. Jul 28 10:41:50 devstack sudo[95644]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8f84e136-5e02-4cd4-ba34-8847499ca332 tempest-GroupsV314Test-1765692908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620 1073741824" returned: 0 in 0.690s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8f84e136-5e02-4cd4-ba34-8847499ca332 tempest-GroupsV314Test-1765692908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:50 devstack sudo[95650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620 Jul 28 10:41:50 devstack sudo[95650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ffd4a64f-5e1e-427d-8931-97a822411d06 tempest-VolumesActionsTest-1738740243 None] Acquiring lock "cinder-18e10b13-8319-40b1-aaaf-13677e5e1873-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:41:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ffd4a64f-5e1e-427d-8931-97a822411d06 tempest-VolumesActionsTest-1738740243 None] Lock "cinder-18e10b13-8319-40b1-aaaf-13677e5e1873-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:41:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ffd4a64f-5e1e-427d-8931-97a822411d06 tempest-VolumesActionsTest-1738740243 None] Acquiring lock "cinder-quobyte-18e10b13-8319-40b1-aaaf-13677e5e1873" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:41:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ffd4a64f-5e1e-427d-8931-97a822411d06 tempest-VolumesActionsTest-1738740243 None] Lock "cinder-quobyte-18e10b13-8319-40b1-aaaf-13677e5e1873" acquired by "delete_volume" :: waited 0.031s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:41:51 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2c0620-2502-4af6-bad9-dc049f15f542]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:41:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ffd4a64f-5e1e-427d-8931-97a822411d06 tempest-VolumesActionsTest-1738740243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-18e10b13-8319-40b1-aaaf-13677e5e1873 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:51 devstack sudo[95650]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8f84e136-5e02-4cd4-ba34-8847499ca332 tempest-GroupsV314Test-1765692908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620" returned: 0 in 0.542s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:51 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8f84e136-5e02-4cd4-ba34-8847499ca332 tempest-GroupsV314Test-1765692908 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:41:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8f84e136-5e02-4cd4-ba34-8847499ca332 tempest-GroupsV314Test-1765692908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:41:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8f84e136-5e02-4cd4-ba34-8847499ca332 tempest-GroupsV314Test-1765692908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2edfd3b9-2554-4608-87ed-7ecef0141d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5c4c162-0f89-4985-a399-e572176f2620', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8f84e136-5e02-4cd4-ba34-8847499ca332 tempest-GroupsV314Test-1765692908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f787f5d0-8f0b-4af2-b091-3f9236adb119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:51 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-8f84e136-5e02-4cd4-ba34-8847499ca332 tempest-GroupsV314Test-1765692908 None] Volume volume-d5c4c162-0f89-4985-a399-e572176f2620 (d5c4c162-0f89-4985-a399-e572176f2620): created successfully Jul 28 10:41:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8f84e136-5e02-4cd4-ba34-8847499ca332 tempest-GroupsV314Test-1765692908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f787f5d0-8f0b-4af2-b091-3f9236adb119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8f84e136-5e02-4cd4-ba34-8847499ca332 tempest-GroupsV314Test-1765692908 None] Flow 'volume_create_manager' (16c59657-5f2a-441e-bccd-5c046ec64260) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:41:51 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-8f84e136-5e02-4cd4-ba34-8847499ca332 tempest-GroupsV314Test-1765692908 None] Created volume successfully. Jul 28 10:41:51 devstack sudo[95652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-18e10b13-8319-40b1-aaaf-13677e5e1873 Jul 28 10:41:51 devstack sudo[95652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:52 devstack sudo[95652]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ffd4a64f-5e1e-427d-8931-97a822411d06 tempest-VolumesActionsTest-1738740243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-18e10b13-8319-40b1-aaaf-13677e5e1873" returned: 0 in 0.699s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ffd4a64f-5e1e-427d-8931-97a822411d06 tempest-VolumesActionsTest-1738740243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-18e10b13-8319-40b1-aaaf-13677e5e1873 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:52 devstack sudo[95660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-18e10b13-8319-40b1-aaaf-13677e5e1873 Jul 28 10:41:52 devstack sudo[95660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:52 devstack sudo[95660]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ffd4a64f-5e1e-427d-8931-97a822411d06 tempest-VolumesActionsTest-1738740243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-18e10b13-8319-40b1-aaaf-13677e5e1873" returned: 0 in 0.346s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:52 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ffd4a64f-5e1e-427d-8931-97a822411d06 tempest-VolumesActionsTest-1738740243 None] Lock "cinder-quobyte-18e10b13-8319-40b1-aaaf-13677e5e1873" released by "delete_volume" :: held 1.126s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:41:52 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-ffd4a64f-5e1e-427d-8931-97a822411d06 tempest-VolumesActionsTest-1738740243 None] Created reservations ['88318f6f-c33a-49d7-ab40-d5d99c16a85a', '7ff2a472-84fd-4c3f-bfaf-17125f4d6eef', '79fb5261-ce4b-44d9-b747-9fb5b45be4ca', '36c1285b-319b-4060-9317-b155a4c35f09'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:41:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ffd4a64f-5e1e-427d-8931-97a822411d06 tempest-VolumesActionsTest-1738740243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:41:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ffd4a64f-5e1e-427d-8931-97a822411d06 tempest-VolumesActionsTest-1738740243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:41:52 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-ffd4a64f-5e1e-427d-8931-97a822411d06 tempest-VolumesActionsTest-1738740243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:41:52 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-ffd4a64f-5e1e-427d-8931-97a822411d06 tempest-VolumesActionsTest-1738740243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:41:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ffd4a64f-5e1e-427d-8931-97a822411d06 tempest-VolumesActionsTest-1738740243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:41:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ffd4a64f-5e1e-427d-8931-97a822411d06 tempest-VolumesActionsTest-1738740243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:52 devstack sudo[95663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:41:52 devstack sudo[95663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:53 devstack sudo[95663]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ffd4a64f-5e1e-427d-8931-97a822411d06 tempest-VolumesActionsTest-1738740243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.389s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:53 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-ffd4a64f-5e1e-427d-8931-97a822411d06 tempest-VolumesActionsTest-1738740243 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:41:53 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-ffd4a64f-5e1e-427d-8931-97a822411d06 tempest-VolumesActionsTest-1738740243 None] Deleted volume successfully. Jul 28 10:41:53 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ffd4a64f-5e1e-427d-8931-97a822411d06 tempest-VolumesActionsTest-1738740243 None] Lock "cinder-18e10b13-8319-40b1-aaaf-13677e5e1873-delete_volume" released by "delete_volume" :: held 1.943s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:41:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:41:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:41:53 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] Cloning volume d5c4c162-0f89-4985-a399-e572176f2620 to volume 4b8dc96d-88eb-4265-b5a0-26a1a9940301 Jul 28 10:41:54 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] Creating offline snapshot cf241ff6-51cf-4f89-89a6-f25d47812020 of volume d5c4c162-0f89-4985-a399-e572176f2620 {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:41:54 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[45509b66-7c96-4d83-90db-496a3f3c42dc]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:41:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:54 devstack sudo[95667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620 Jul 28 10:41:54 devstack sudo[95667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:54 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-55b4b7c4-ad13-40fd-832d-1cd8a610c082 tempest-VolumesActionsTest-510530160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:41:54 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-55b4b7c4-ad13-40fd-832d-1cd8a610c082 tempest-VolumesActionsTest-510530160 None] Flow 'volume_create_manager' (75c5fe2d-6260-4c15-9f3d-bb1b24b2a65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:41:54 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-55b4b7c4-ad13-40fd-832d-1cd8a610c082 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d345ca7b-4730-460a-8d63-f4cf98612735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:54 devstack sudo[95667]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:54 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-55b4b7c4-ad13-40fd-832d-1cd8a610c082 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d345ca7b-4730-460a-8d63-f4cf98612735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-73792960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b086adf0-7b4f-494d-8573-57cff9f8f7b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95375aecc7264185b1fbef4b61ea9c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:41:55Z,use_quota=True,user_id='784e408de64245578eb1a307088e85f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:54 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-55b4b7c4-ad13-40fd-832d-1cd8a610c082 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1828cc0-9ebf-4551-b522-1f661d3ad01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:54 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-55b4b7c4-ad13-40fd-832d-1cd8a610c082 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1828cc0-9ebf-4551-b522-1f661d3ad01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:54 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-55b4b7c4-ad13-40fd-832d-1cd8a610c082 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19277d82-3678-4d14-90fe-dfb7425e2331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:54 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-55b4b7c4-ad13-40fd-832d-1cd8a610c082 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19277d82-3678-4d14-90fe-dfb7425e2331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b086adf0-7b4f-494d-8573-57cff9f8f7b9', 'volume_name': 'volume-b086adf0-7b4f-494d-8573-57cff9f8f7b9', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:54 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-55b4b7c4-ad13-40fd-832d-1cd8a610c082 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93e80142-0ac9-4b69-968a-32f8b0dff716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:54 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-55b4b7c4-ad13-40fd-832d-1cd8a610c082 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93e80142-0ac9-4b69-968a-32f8b0dff716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:41:54 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-55b4b7c4-ad13-40fd-832d-1cd8a610c082 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4b6eafb-ae99-484c-b819-a9ead94930ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:41:54 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-55b4b7c4-ad13-40fd-832d-1cd8a610c082 tempest-VolumesActionsTest-510530160 None] Volume b086adf0-7b4f-494d-8573-57cff9f8f7b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b086adf0-7b4f-494d-8573-57cff9f8f7b9', 'volume_size': 1} Jul 28 10:41:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-55b4b7c4-ad13-40fd-832d-1cd8a610c082 tempest-VolumesActionsTest-510530160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:41:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620" returned: 0 in 0.793s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620.cf241ff6-51cf-4f89-89a6-f25d47812020 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:54 devstack sudo[95672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620.cf241ff6-51cf-4f89-89a6-f25d47812020 1G Jul 28 10:41:54 devstack sudo[95672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:55 devstack sudo[95672]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620.cf241ff6-51cf-4f89-89a6-f25d47812020 1G" returned: 0 in 0.473s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5c4c162-0f89-4985-a399-e572176f2620 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620.cf241ff6-51cf-4f89-89a6-f25d47812020 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:55 devstack sudo[95677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5c4c162-0f89-4985-a399-e572176f2620 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620.cf241ff6-51cf-4f89-89a6-f25d47812020 Jul 28 10:41:55 devstack sudo[95677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:55 devstack sudo[95677]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5c4c162-0f89-4985-a399-e572176f2620 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620.cf241ff6-51cf-4f89-89a6-f25d47812020" returned: 0 in 0.359s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:55 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620.cf241ff6-51cf-4f89-89a6-f25d47812020 is being set with open permissions: ugo+rw: NotImplementedError Jul 28 10:41:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620.cf241ff6-51cf-4f89-89a6-f25d47812020 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:55 devstack sudo[95682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620.cf241ff6-51cf-4f89-89a6-f25d47812020 Jul 28 10:41:55 devstack sudo[95682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:56 devstack sudo[95682]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620.cf241ff6-51cf-4f89-89a6-f25d47812020" returned: 0 in 0.318s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:56 devstack sudo[95685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620.info Jul 28 10:41:56 devstack sudo[95685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:56 devstack sudo[95685]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620.info" returned: 0 in 0.281s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:56 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620.info is being set with open permissions: ugo+rw: NotImplementedError Jul 28 10:41:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:56 devstack sudo[95688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620.info Jul 28 10:41:56 devstack sudo[95688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:56 devstack sudo[95688]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620.info" returned: 0 in 0.266s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:56 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] Acquiring lock "cinder-quobyte-4b8dc96d-88eb-4265-b5a0-26a1a9940301" by "_copy_volume_from_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:41:56 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] Lock "cinder-quobyte-4b8dc96d-88eb-4265-b5a0-26a1a9940301" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:41:56 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] snapshot: cf241ff6-51cf-4f89-89a6-f25d47812020, volume: 4b8dc96d-88eb-4265-b5a0-26a1a9940301, {{(pid=88413) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 28 10:41:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:41:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:41:56 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:41:56 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:41:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:41:56 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5c106c-5900-45dc-8fd6-194dac2ee343]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:41:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620.cf241ff6-51cf-4f89-89a6-f25d47812020 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:56 devstack sudo[95691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620.cf241ff6-51cf-4f89-89a6-f25d47812020 Jul 28 10:41:56 devstack sudo[95691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:57 devstack sudo[95691]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620.cf241ff6-51cf-4f89-89a6-f25d47812020" returned: 0 in 0.395s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:57 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5c4c162-0f89-4985-a399-e572176f2620(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:41:57 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620 {{(pid=88413) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 28 10:41:57 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] Creating direct copy from snapshot {{(pid=88413) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 28 10:41:57 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccba8cc-ac03-423a-8958-1b7e8f24af92]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:41:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:57 devstack sudo[95696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620 Jul 28 10:41:57 devstack sudo[95696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:41:57 devstack sudo[95696]: pam_unix(sudo:session): session closed for user root Jul 28 10:41:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620" returned: 0 in 0.461s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:41:57 devstack cinder-volume[88413]: DEBUG cinder.utils [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] Path /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b8dc96d-88eb-4265-b5a0-26a1a9940301 not found in is_blk_device check {{(pid=88413) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 28 10:41:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b8dc96d-88eb-4265-b5a0-26a1a9940301 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:41:57 devstack sudo[95701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b8dc96d-88eb-4265-b5a0-26a1a9940301 Jul 28 10:41:57 devstack sudo[95701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:03 devstack sudo[95701]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b8dc96d-88eb-4265-b5a0-26a1a9940301" returned: 0 in 5.887s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:03 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[56306c4b-083c-425a-8b36-370f4be0ff98]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:42:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:03 devstack sudo[95718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620 Jul 28 10:42:03 devstack sudo[95718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:04 devstack sudo[95718]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620" returned: 0 in 0.594s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:04 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620, size 1024.00 MB, duration 5.89 sec, destination /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b8dc96d-88eb-4265-b5a0-26a1a9940301 {{(pid=88413) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 10:42:04 devstack cinder-volume[88413]: INFO cinder.image.image_utils [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] Converted 1024.00 MB image at 173.91 MB/s Jul 28 10:42:04 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b8dc96d-88eb-4265-b5a0-26a1a9940301 is being set with open permissions: ugo+rw: NotImplementedError Jul 28 10:42:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b8dc96d-88eb-4265-b5a0-26a1a9940301 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:04 devstack sudo[95747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b8dc96d-88eb-4265-b5a0-26a1a9940301 Jul 28 10:42:04 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:04 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b8dc96d-88eb-4265-b5a0-26a1a9940301" returned: 0 in 0.253s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:04 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] Lock "cinder-quobyte-4b8dc96d-88eb-4265-b5a0-26a1a9940301" released by "_copy_volume_from_snapshot" :: held 7.693s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:42:04 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] Acquiring lock "cinder-quobyte-cf241ff6-51cf-4f89-89a6-f25d47812020" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:42:04 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] Lock "cinder-quobyte-cf241ff6-51cf-4f89-89a6-f25d47812020" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:42:04 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] Deleting offline snapshot cf241ff6-51cf-4f89-89a6-f25d47812020 of volume d5c4c162-0f89-4985-a399-e572176f2620 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:42:04 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] snapshot_file for this snap is: volume-d5c4c162-0f89-4985-a399-e572176f2620.cf241ff6-51cf-4f89-89a6-f25d47812020 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:42:04 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbace83-20ec-4fa4-b6a1-3443304bd5ad]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:42:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620.cf241ff6-51cf-4f89-89a6-f25d47812020 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:04 devstack sudo[95750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620.cf241ff6-51cf-4f89-89a6-f25d47812020 Jul 28 10:42:04 devstack sudo[95750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:04 devstack sudo[95750]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620.cf241ff6-51cf-4f89-89a6-f25d47812020" returned: 0 in 0.382s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:04 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5c4c162-0f89-4985-a399-e572176f2620(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:42:04 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[828ed799-b3f8-4066-ad86-e0707c97406c]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:42:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:04 devstack sudo[95755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620 Jul 28 10:42:04 devstack sudo[95755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:05 devstack sudo[95755]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620" returned: 0 in 0.358s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620.cf241ff6-51cf-4f89-89a6-f25d47812020 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:05 devstack sudo[95761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620.cf241ff6-51cf-4f89-89a6-f25d47812020 Jul 28 10:42:05 devstack sudo[95761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:05 devstack sudo[95761]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620.cf241ff6-51cf-4f89-89a6-f25d47812020" returned: 0 in 0.352s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620.cf241ff6-51cf-4f89-89a6-f25d47812020 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:05 devstack sudo[95767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620.cf241ff6-51cf-4f89-89a6-f25d47812020 Jul 28 10:42:05 devstack sudo[95767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:05 devstack sudo[95767]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620.cf241ff6-51cf-4f89-89a6-f25d47812020" returned: 0 in 0.251s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:05 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] Lock "cinder-quobyte-cf241ff6-51cf-4f89-89a6-f25d47812020" released by "_delete_snapshot" :: held 1.460s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:42:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.893s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:42:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-55b4b7c4-ad13-40fd-832d-1cd8a610c082 tempest-VolumesActionsTest-510530160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.004s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:42:05 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-55b4b7c4-ad13-40fd-832d-1cd8a610c082 tempest-VolumesActionsTest-510530160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-73792960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b086adf0-7b4f-494d-8573-57cff9f8f7b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95375aecc7264185b1fbef4b61ea9c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:41:55Z,use_quota=True,user_id='784e408de64245578eb1a307088e85f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:42:05 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-55b4b7c4-ad13-40fd-832d-1cd8a610c082 tempest-VolumesActionsTest-510530160 None] Creating volume b086adf0-7b4f-494d-8573-57cff9f8f7b9 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:42:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-55b4b7c4-ad13-40fd-832d-1cd8a610c082 tempest-VolumesActionsTest-510530160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:42:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-55b4b7c4-ad13-40fd-832d-1cd8a610c082 tempest-VolumesActionsTest-510530160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:42:05 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-55b4b7c4-ad13-40fd-832d-1cd8a610c082 tempest-VolumesActionsTest-510530160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:42:05 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-55b4b7c4-ad13-40fd-832d-1cd8a610c082 tempest-VolumesActionsTest-510530160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:42:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-55b4b7c4-ad13-40fd-832d-1cd8a610c082 tempest-VolumesActionsTest-510530160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:42:05 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-55b4b7c4-ad13-40fd-832d-1cd8a610c082 tempest-VolumesActionsTest-510530160 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:42:05 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-55b4b7c4-ad13-40fd-832d-1cd8a610c082 tempest-VolumesActionsTest-510530160 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:42:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-55b4b7c4-ad13-40fd-832d-1cd8a610c082 tempest-VolumesActionsTest-510530160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b086adf0-7b4f-494d-8573-57cff9f8f7b9 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:05 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=125,cinder:INSERT=40,cinder:UPDATE=150,cinder:DELETE=12 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:42:05 devstack sudo[95770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b086adf0-7b4f-494d-8573-57cff9f8f7b9 1073741824 Jul 28 10:42:05 devstack sudo[95770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:05 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-b01c3aab-ee07-4b79-b21e-1b39b863cadd tempest-GroupsV314Test-1765692908 None] Create group from source-group-f2412963-42f1-4718-b4e8-5007d293bac4 completed successfully. Jul 28 10:42:06 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a80ae60-2fb8-4a2f-a84c-331f5ad303dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:42:06 devstack sudo[95770]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0a80ae60-2fb8-4a2f-a84c-331f5ad303dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Flow 'volume_create_manager' (7374b9cc-b33b-4cfe-8962-4fbc602b35f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:42:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0a80ae60-2fb8-4a2f-a84c-331f5ad303dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73993ebc-af25-4cd1-960c-4001af6435b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-55b4b7c4-ad13-40fd-832d-1cd8a610c082 tempest-VolumesActionsTest-510530160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b086adf0-7b4f-494d-8573-57cff9f8f7b9 1073741824" returned: 0 in 0.538s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0a80ae60-2fb8-4a2f-a84c-331f5ad303dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73993ebc-af25-4cd1-960c-4001af6435b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:42:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1367779210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a91a4c3-26b3-415e-a303-1d14749956af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff700b786ce94daea9a376c8b56edfaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:42:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:42:06Z,use_quota=True,user_id='5197663aaea445369815e6258795e4ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0a80ae60-2fb8-4a2f-a84c-331f5ad303dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25800c74-1909-4630-bb04-84f872d12895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0a80ae60-2fb8-4a2f-a84c-331f5ad303dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25800c74-1909-4630-bb04-84f872d12895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0a80ae60-2fb8-4a2f-a84c-331f5ad303dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef600ed0-3682-4c4b-b741-912c6941f993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0a80ae60-2fb8-4a2f-a84c-331f5ad303dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef600ed0-3682-4c4b-b741-912c6941f993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a91a4c3-26b3-415e-a303-1d14749956af', 'volume_name': 'volume-9a91a4c3-26b3-415e-a303-1d14749956af', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0a80ae60-2fb8-4a2f-a84c-331f5ad303dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a618ddf-5edc-497f-ab9d-b04588650c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0a80ae60-2fb8-4a2f-a84c-331f5ad303dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a618ddf-5edc-497f-ab9d-b04588650c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0a80ae60-2fb8-4a2f-a84c-331f5ad303dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f61bf1d8-0be1-4cfc-b596-df3eba191745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:06 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-0a80ae60-2fb8-4a2f-a84c-331f5ad303dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Volume 9a91a4c3-26b3-415e-a303-1d14749956af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a91a4c3-26b3-415e-a303-1d14749956af', 'volume_size': 1} Jul 28 10:42:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0a80ae60-2fb8-4a2f-a84c-331f5ad303dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:42:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-55b4b7c4-ad13-40fd-832d-1cd8a610c082 tempest-VolumesActionsTest-510530160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b086adf0-7b4f-494d-8573-57cff9f8f7b9 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:06 devstack sudo[95776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b086adf0-7b4f-494d-8573-57cff9f8f7b9 Jul 28 10:42:06 devstack sudo[95776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:06 devstack sudo[95776]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-55b4b7c4-ad13-40fd-832d-1cd8a610c082 tempest-VolumesActionsTest-510530160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b086adf0-7b4f-494d-8573-57cff9f8f7b9" returned: 0 in 0.244s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:06 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-55b4b7c4-ad13-40fd-832d-1cd8a610c082 tempest-VolumesActionsTest-510530160 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:42:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-55b4b7c4-ad13-40fd-832d-1cd8a610c082 tempest-VolumesActionsTest-510530160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:42:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0a80ae60-2fb8-4a2f-a84c-331f5ad303dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.270s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:42:06 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0a80ae60-2fb8-4a2f-a84c-331f5ad303dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:42:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1367779210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a91a4c3-26b3-415e-a303-1d14749956af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff700b786ce94daea9a376c8b56edfaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:42:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:42:06Z,use_quota=True,user_id='5197663aaea445369815e6258795e4ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:42:06 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-0a80ae60-2fb8-4a2f-a84c-331f5ad303dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Creating volume 9a91a4c3-26b3-415e-a303-1d14749956af {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:42:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0a80ae60-2fb8-4a2f-a84c-331f5ad303dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:42:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0a80ae60-2fb8-4a2f-a84c-331f5ad303dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:42:06 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0a80ae60-2fb8-4a2f-a84c-331f5ad303dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:42:06 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0a80ae60-2fb8-4a2f-a84c-331f5ad303dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:42:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0a80ae60-2fb8-4a2f-a84c-331f5ad303dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:42:06 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0a80ae60-2fb8-4a2f-a84c-331f5ad303dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:42:06 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-0a80ae60-2fb8-4a2f-a84c-331f5ad303dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:42:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0a80ae60-2fb8-4a2f-a84c-331f5ad303dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:06 devstack sudo[95779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af 1073741824 Jul 28 10:42:06 devstack sudo[95779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-55b4b7c4-ad13-40fd-832d-1cd8a610c082 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4b6eafb-ae99-484c-b819-a9ead94930ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b086adf0-7b4f-494d-8573-57cff9f8f7b9', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-55b4b7c4-ad13-40fd-832d-1cd8a610c082 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab08438a-576c-4988-9335-921614671e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:06 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-55b4b7c4-ad13-40fd-832d-1cd8a610c082 tempest-VolumesActionsTest-510530160 None] Volume volume-b086adf0-7b4f-494d-8573-57cff9f8f7b9 (b086adf0-7b4f-494d-8573-57cff9f8f7b9): created successfully Jul 28 10:42:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-55b4b7c4-ad13-40fd-832d-1cd8a610c082 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab08438a-576c-4988-9335-921614671e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-55b4b7c4-ad13-40fd-832d-1cd8a610c082 tempest-VolumesActionsTest-510530160 None] Flow 'volume_create_manager' (75c5fe2d-6260-4c15-9f3d-bb1b24b2a65c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:42:06 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-55b4b7c4-ad13-40fd-832d-1cd8a610c082 tempest-VolumesActionsTest-510530160 None] Created volume successfully. Jul 28 10:42:07 devstack sudo[95779]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0a80ae60-2fb8-4a2f-a84c-331f5ad303dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af 1073741824" returned: 0 in 0.443s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0a80ae60-2fb8-4a2f-a84c-331f5ad303dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:07 devstack sudo[95784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af Jul 28 10:42:07 devstack sudo[95784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:07 devstack sudo[95784]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0a80ae60-2fb8-4a2f-a84c-331f5ad303dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af" returned: 0 in 0.252s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:07 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0a80ae60-2fb8-4a2f-a84c-331f5ad303dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:42:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0a80ae60-2fb8-4a2f-a84c-331f5ad303dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:42:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0a80ae60-2fb8-4a2f-a84c-331f5ad303dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f61bf1d8-0be1-4cfc-b596-df3eba191745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a91a4c3-26b3-415e-a303-1d14749956af', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0a80ae60-2fb8-4a2f-a84c-331f5ad303dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fea9aa5-205c-433c-b965-98f15c08c612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:07 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-0a80ae60-2fb8-4a2f-a84c-331f5ad303dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Volume volume-9a91a4c3-26b3-415e-a303-1d14749956af (9a91a4c3-26b3-415e-a303-1d14749956af): created successfully Jul 28 10:42:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0a80ae60-2fb8-4a2f-a84c-331f5ad303dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fea9aa5-205c-433c-b965-98f15c08c612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0a80ae60-2fb8-4a2f-a84c-331f5ad303dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Flow 'volume_create_manager' (7374b9cc-b33b-4cfe-8962-4fbc602b35f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:42:07 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-0a80ae60-2fb8-4a2f-a84c-331f5ad303dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Created volume successfully. Jul 28 10:42:07 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-10ac0f71-c2c0-48ed-8375-1a887e2e2b90 tempest-GroupsV314Test-1765692908 None] Acquiring lock "cinder-quobyte-4b8dc96d-88eb-4265-b5a0-26a1a9940301" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:42:07 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-10ac0f71-c2c0-48ed-8375-1a887e2e2b90 tempest-GroupsV314Test-1765692908 None] Lock "cinder-quobyte-4b8dc96d-88eb-4265-b5a0-26a1a9940301" acquired by "delete_volume" :: waited 0.020s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:42:07 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ba9051-95de-4517-a9be-9d1e26e93290]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:42:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-10ac0f71-c2c0-48ed-8375-1a887e2e2b90 tempest-GroupsV314Test-1765692908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b8dc96d-88eb-4265-b5a0-26a1a9940301 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:07 devstack sudo[95787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b8dc96d-88eb-4265-b5a0-26a1a9940301 Jul 28 10:42:07 devstack sudo[95787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:07 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-10e37729-bb9a-4e43-b7f1-28ffb781c2d6 tempest-VolumesActionsTest-1738740243 None] Acquiring lock "cinder-b086adf0-7b4f-494d-8573-57cff9f8f7b9-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:42:07 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-10e37729-bb9a-4e43-b7f1-28ffb781c2d6 tempest-VolumesActionsTest-1738740243 None] Lock "cinder-b086adf0-7b4f-494d-8573-57cff9f8f7b9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:42:07 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-10e37729-bb9a-4e43-b7f1-28ffb781c2d6 tempest-VolumesActionsTest-1738740243 None] Acquiring lock "cinder-quobyte-b086adf0-7b4f-494d-8573-57cff9f8f7b9" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:42:08 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-10e37729-bb9a-4e43-b7f1-28ffb781c2d6 tempest-VolumesActionsTest-1738740243 None] Lock "cinder-quobyte-b086adf0-7b4f-494d-8573-57cff9f8f7b9" acquired by "delete_volume" :: waited 0.021s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:42:08 devstack sudo[95787]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-10ac0f71-c2c0-48ed-8375-1a887e2e2b90 tempest-GroupsV314Test-1765692908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b8dc96d-88eb-4265-b5a0-26a1a9940301" returned: 0 in 0.429s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-10ac0f71-c2c0-48ed-8375-1a887e2e2b90 tempest-GroupsV314Test-1765692908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b8dc96d-88eb-4265-b5a0-26a1a9940301 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:08 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d29dc4d-318e-4969-b92e-8416d67497eb]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:42:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-10e37729-bb9a-4e43-b7f1-28ffb781c2d6 tempest-VolumesActionsTest-1738740243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b086adf0-7b4f-494d-8573-57cff9f8f7b9 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:08 devstack sudo[95792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b8dc96d-88eb-4265-b5a0-26a1a9940301 Jul 28 10:42:08 devstack sudo[95792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:08 devstack sudo[95793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b086adf0-7b4f-494d-8573-57cff9f8f7b9 Jul 28 10:42:08 devstack sudo[95793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:08 devstack sudo[95792]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-10ac0f71-c2c0-48ed-8375-1a887e2e2b90 tempest-GroupsV314Test-1765692908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b8dc96d-88eb-4265-b5a0-26a1a9940301" returned: 0 in 0.243s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:08 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-10ac0f71-c2c0-48ed-8375-1a887e2e2b90 tempest-GroupsV314Test-1765692908 None] Lock "cinder-quobyte-4b8dc96d-88eb-4265-b5a0-26a1a9940301" released by "delete_volume" :: held 0.721s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:42:08 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-10ac0f71-c2c0-48ed-8375-1a887e2e2b90 tempest-GroupsV314Test-1765692908 None] Created reservations ['fa6a9317-2bff-4dd5-ae82-202ab9530a8c'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:42:08 devstack cinder-volume[88413]: WARNING cinder.quota [None req-10ac0f71-c2c0-48ed-8375-1a887e2e2b90 tempest-GroupsV314Test-1765692908 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2145191046 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2145191046, it is now deprecated. Please use the default quota class for default quota. Jul 28 10:42:08 devstack cinder-volume[88413]: WARNING cinder.quota [None req-10ac0f71-c2c0-48ed-8375-1a887e2e2b90 tempest-GroupsV314Test-1765692908 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2145191046 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2145191046, it is now deprecated. Please use the default quota class for default quota. Jul 28 10:42:08 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-10ac0f71-c2c0-48ed-8375-1a887e2e2b90 tempest-GroupsV314Test-1765692908 None] Created reservations ['4aef8c32-64b4-44a8-b1cf-d90795582caa', '3b3a2f98-58f3-46fc-ae61-41b89c1e5f37', 'cd4abb41-6849-4558-8552-9ecedf16e079', '201cd962-5e6c-4d36-a702-0ee49de4b9e7'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:42:08 devstack sudo[95793]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-10e37729-bb9a-4e43-b7f1-28ffb781c2d6 tempest-VolumesActionsTest-1738740243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b086adf0-7b4f-494d-8573-57cff9f8f7b9" returned: 0 in 0.393s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-10e37729-bb9a-4e43-b7f1-28ffb781c2d6 tempest-VolumesActionsTest-1738740243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b086adf0-7b4f-494d-8573-57cff9f8f7b9 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:08 devstack sudo[95800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b086adf0-7b4f-494d-8573-57cff9f8f7b9 Jul 28 10:42:08 devstack sudo[95800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-10ac0f71-c2c0-48ed-8375-1a887e2e2b90 tempest-GroupsV314Test-1765692908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:42:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-10ac0f71-c2c0-48ed-8375-1a887e2e2b90 tempest-GroupsV314Test-1765692908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:42:08 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-10ac0f71-c2c0-48ed-8375-1a887e2e2b90 tempest-GroupsV314Test-1765692908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:42:08 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-10ac0f71-c2c0-48ed-8375-1a887e2e2b90 tempest-GroupsV314Test-1765692908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:42:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-10ac0f71-c2c0-48ed-8375-1a887e2e2b90 tempest-GroupsV314Test-1765692908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:42:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-10ac0f71-c2c0-48ed-8375-1a887e2e2b90 tempest-GroupsV314Test-1765692908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:08 devstack sudo[95802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:42:08 devstack sudo[95802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-96224cbf-d36b-44cd-8365-9307a7b444b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:42:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-96224cbf-d36b-44cd-8365-9307a7b444b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:42:08 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-96224cbf-d36b-44cd-8365-9307a7b444b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Creating offline snapshot adc9a754-6786-429e-bc9d-0e5917bf594a of volume 9a91a4c3-26b3-415e-a303-1d14749956af {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:42:08 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee7c281-2bc6-4409-9123-5ec371dc68f8]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:42:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-96224cbf-d36b-44cd-8365-9307a7b444b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:08 devstack sudo[95800]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-10e37729-bb9a-4e43-b7f1-28ffb781c2d6 tempest-VolumesActionsTest-1738740243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b086adf0-7b4f-494d-8573-57cff9f8f7b9" returned: 0 in 0.297s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:08 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-10e37729-bb9a-4e43-b7f1-28ffb781c2d6 tempest-VolumesActionsTest-1738740243 None] Lock "cinder-quobyte-b086adf0-7b4f-494d-8573-57cff9f8f7b9" released by "delete_volume" :: held 0.738s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:42:08 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-10e37729-bb9a-4e43-b7f1-28ffb781c2d6 tempest-VolumesActionsTest-1738740243 None] Created reservations ['43f9cfe2-c4db-4d25-940c-d92433165e2f', 'd727979e-b347-475e-9278-5aaf67f088b8', '62908710-db34-4205-a754-de8c5f362ec4', '08f255ae-6e14-42e7-b6ae-558850b91acb'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:42:08 devstack sudo[95805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af Jul 28 10:42:08 devstack sudo[95805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:08 devstack sudo[95802]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-10ac0f71-c2c0-48ed-8375-1a887e2e2b90 tempest-GroupsV314Test-1765692908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.321s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:08 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-10ac0f71-c2c0-48ed-8375-1a887e2e2b90 tempest-GroupsV314Test-1765692908 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:42:08 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-10ac0f71-c2c0-48ed-8375-1a887e2e2b90 tempest-GroupsV314Test-1765692908 None] Delete group completed successfully. Jul 28 10:42:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-10e37729-bb9a-4e43-b7f1-28ffb781c2d6 tempest-VolumesActionsTest-1738740243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:42:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-10e37729-bb9a-4e43-b7f1-28ffb781c2d6 tempest-VolumesActionsTest-1738740243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:42:08 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-10e37729-bb9a-4e43-b7f1-28ffb781c2d6 tempest-VolumesActionsTest-1738740243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:42:08 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-10e37729-bb9a-4e43-b7f1-28ffb781c2d6 tempest-VolumesActionsTest-1738740243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:42:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-10e37729-bb9a-4e43-b7f1-28ffb781c2d6 tempest-VolumesActionsTest-1738740243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:42:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-10e37729-bb9a-4e43-b7f1-28ffb781c2d6 tempest-VolumesActionsTest-1738740243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:08 devstack sudo[95808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:42:08 devstack sudo[95808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:09 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9aa47b31-6b40-4218-ab8c-461e9b850a6f tempest-GroupsV314Test-1765692908 None] Acquiring lock "cinder-quobyte-d5c4c162-0f89-4985-a399-e572176f2620" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:42:09 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9aa47b31-6b40-4218-ab8c-461e9b850a6f tempest-GroupsV314Test-1765692908 None] Lock "cinder-quobyte-d5c4c162-0f89-4985-a399-e572176f2620" acquired by "delete_volume" :: waited 0.028s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:42:09 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe788757-b233-43f3-a14b-bc2650c8b588]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:42:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9aa47b31-6b40-4218-ab8c-461e9b850a6f tempest-GroupsV314Test-1765692908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:09 devstack sudo[95805]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-96224cbf-d36b-44cd-8365-9307a7b444b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af" returned: 0 in 0.490s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-96224cbf-d36b-44cd-8365-9307a7b444b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af.adc9a754-6786-429e-bc9d-0e5917bf594a 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:09 devstack sudo[95815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af.adc9a754-6786-429e-bc9d-0e5917bf594a 1G Jul 28 10:42:09 devstack sudo[95815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:09 devstack sudo[95808]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-10e37729-bb9a-4e43-b7f1-28ffb781c2d6 tempest-VolumesActionsTest-1738740243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.321s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:09 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-10e37729-bb9a-4e43-b7f1-28ffb781c2d6 tempest-VolumesActionsTest-1738740243 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:42:09 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-10e37729-bb9a-4e43-b7f1-28ffb781c2d6 tempest-VolumesActionsTest-1738740243 None] Deleted volume successfully. Jul 28 10:42:09 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-10e37729-bb9a-4e43-b7f1-28ffb781c2d6 tempest-VolumesActionsTest-1738740243 None] Lock "cinder-b086adf0-7b4f-494d-8573-57cff9f8f7b9-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:42:09 devstack sudo[95814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620 Jul 28 10:42:09 devstack sudo[95814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:09 devstack sudo[95814]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9aa47b31-6b40-4218-ab8c-461e9b850a6f tempest-GroupsV314Test-1765692908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620" returned: 0 in 0.463s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9aa47b31-6b40-4218-ab8c-461e9b850a6f tempest-GroupsV314Test-1765692908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:09 devstack sudo[95815]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-96224cbf-d36b-44cd-8365-9307a7b444b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af.adc9a754-6786-429e-bc9d-0e5917bf594a 1G" returned: 0 in 0.485s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:09 devstack sudo[95827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620 Jul 28 10:42:09 devstack sudo[95827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-96224cbf-d36b-44cd-8365-9307a7b444b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a91a4c3-26b3-415e-a303-1d14749956af -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af.adc9a754-6786-429e-bc9d-0e5917bf594a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:09 devstack sudo[95829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a91a4c3-26b3-415e-a303-1d14749956af -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af.adc9a754-6786-429e-bc9d-0e5917bf594a Jul 28 10:42:09 devstack sudo[95829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:09 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-aed13fcf-ca8d-4db9-93fd-d9df5240be17 tempest-VolumesActionsTest-510530160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:42:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aed13fcf-ca8d-4db9-93fd-d9df5240be17 tempest-VolumesActionsTest-510530160 None] Flow 'volume_create_manager' (81644415-4812-4f51-8f98-262aee574240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:42:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aed13fcf-ca8d-4db9-93fd-d9df5240be17 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3f89b0a-f43a-4a6a-89bc-f5f5b982dacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aed13fcf-ca8d-4db9-93fd-d9df5240be17 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3f89b0a-f43a-4a6a-89bc-f5f5b982dacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1465801169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a175db38-d06f-4829-847a-7a5f9d6d0421,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95375aecc7264185b1fbef4b61ea9c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:42:10Z,use_quota=True,user_id='784e408de64245578eb1a307088e85f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aed13fcf-ca8d-4db9-93fd-d9df5240be17 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7c2e273-60ca-47e9-99f6-b80595b43aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aed13fcf-ca8d-4db9-93fd-d9df5240be17 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7c2e273-60ca-47e9-99f6-b80595b43aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aed13fcf-ca8d-4db9-93fd-d9df5240be17 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7576775-7723-490e-8d45-a7185abd9cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aed13fcf-ca8d-4db9-93fd-d9df5240be17 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7576775-7723-490e-8d45-a7185abd9cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a175db38-d06f-4829-847a-7a5f9d6d0421', 'volume_name': 'volume-a175db38-d06f-4829-847a-7a5f9d6d0421', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aed13fcf-ca8d-4db9-93fd-d9df5240be17 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3da0cac2-cafb-4952-8914-7120bb162eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aed13fcf-ca8d-4db9-93fd-d9df5240be17 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3da0cac2-cafb-4952-8914-7120bb162eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aed13fcf-ca8d-4db9-93fd-d9df5240be17 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (562b37a9-3804-47b0-bb75-5b16064d1f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:09 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-aed13fcf-ca8d-4db9-93fd-d9df5240be17 tempest-VolumesActionsTest-510530160 None] Volume a175db38-d06f-4829-847a-7a5f9d6d0421: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a175db38-d06f-4829-847a-7a5f9d6d0421', 'volume_size': 1} Jul 28 10:42:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-aed13fcf-ca8d-4db9-93fd-d9df5240be17 tempest-VolumesActionsTest-510530160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:42:09 devstack sudo[95827]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9aa47b31-6b40-4218-ab8c-461e9b850a6f tempest-GroupsV314Test-1765692908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d5c4c162-0f89-4985-a399-e572176f2620" returned: 0 in 0.272s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:09 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9aa47b31-6b40-4218-ab8c-461e9b850a6f tempest-GroupsV314Test-1765692908 None] Lock "cinder-quobyte-d5c4c162-0f89-4985-a399-e572176f2620" released by "delete_volume" :: held 0.818s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:42:09 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-9aa47b31-6b40-4218-ab8c-461e9b850a6f tempest-GroupsV314Test-1765692908 None] Created reservations ['7519626b-1b64-44f9-9beb-0221fc9669d4'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:42:09 devstack sudo[95829]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-96224cbf-d36b-44cd-8365-9307a7b444b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a91a4c3-26b3-415e-a303-1d14749956af -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af.adc9a754-6786-429e-bc9d-0e5917bf594a" returned: 0 in 0.336s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:09 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-96224cbf-d36b-44cd-8365-9307a7b444b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af.adc9a754-6786-429e-bc9d-0e5917bf594a is being set with open permissions: ugo+rw Jul 28 10:42:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-96224cbf-d36b-44cd-8365-9307a7b444b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af.adc9a754-6786-429e-bc9d-0e5917bf594a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:10 devstack sudo[95835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af.adc9a754-6786-429e-bc9d-0e5917bf594a Jul 28 10:42:10 devstack sudo[95835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:10 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-9aa47b31-6b40-4218-ab8c-461e9b850a6f tempest-GroupsV314Test-1765692908 None] Created reservations ['78113a04-2608-4687-acb0-0bc604996767', 'c0626176-c9d7-45c2-88df-0bf644005e78', 'c15a3e17-9c6b-4c99-958d-1b4228b78477', '08d9bfe7-4b41-40b5-8cbc-97edf6533528'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:42:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9aa47b31-6b40-4218-ab8c-461e9b850a6f tempest-GroupsV314Test-1765692908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:42:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9aa47b31-6b40-4218-ab8c-461e9b850a6f tempest-GroupsV314Test-1765692908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:42:10 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9aa47b31-6b40-4218-ab8c-461e9b850a6f tempest-GroupsV314Test-1765692908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:42:10 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9aa47b31-6b40-4218-ab8c-461e9b850a6f tempest-GroupsV314Test-1765692908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:42:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9aa47b31-6b40-4218-ab8c-461e9b850a6f tempest-GroupsV314Test-1765692908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:42:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9aa47b31-6b40-4218-ab8c-461e9b850a6f tempest-GroupsV314Test-1765692908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:10 devstack sudo[95837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:42:10 devstack sudo[95837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:10 devstack sudo[95835]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-96224cbf-d36b-44cd-8365-9307a7b444b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af.adc9a754-6786-429e-bc9d-0e5917bf594a" returned: 0 in 0.279s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-96224cbf-d36b-44cd-8365-9307a7b444b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:10 devstack sudo[95840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af.info Jul 28 10:42:10 devstack sudo[95840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:10 devstack sudo[95837]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9aa47b31-6b40-4218-ab8c-461e9b850a6f tempest-GroupsV314Test-1765692908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.317s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:10 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-9aa47b31-6b40-4218-ab8c-461e9b850a6f tempest-GroupsV314Test-1765692908 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:42:10 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-9aa47b31-6b40-4218-ab8c-461e9b850a6f tempest-GroupsV314Test-1765692908 None] Delete group completed successfully. Jul 28 10:42:10 devstack sudo[95840]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-96224cbf-d36b-44cd-8365-9307a7b444b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af.info" returned: 0 in 0.346s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:10 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-96224cbf-d36b-44cd-8365-9307a7b444b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af.info is being set with open permissions: ugo+rw Jul 28 10:42:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-96224cbf-d36b-44cd-8365-9307a7b444b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:10 devstack sudo[95844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af.info Jul 28 10:42:10 devstack sudo[95844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:10 devstack sudo[95844]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-96224cbf-d36b-44cd-8365-9307a7b444b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af.info" returned: 0 in 0.279s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-96224cbf-d36b-44cd-8365-9307a7b444b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.353s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:42:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-aed13fcf-ca8d-4db9-93fd-d9df5240be17 tempest-VolumesActionsTest-510530160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.208s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:42:10 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-aed13fcf-ca8d-4db9-93fd-d9df5240be17 tempest-VolumesActionsTest-510530160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1465801169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a175db38-d06f-4829-847a-7a5f9d6d0421,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95375aecc7264185b1fbef4b61ea9c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:42:10Z,use_quota=True,user_id='784e408de64245578eb1a307088e85f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:42:10 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-aed13fcf-ca8d-4db9-93fd-d9df5240be17 tempest-VolumesActionsTest-510530160 None] Creating volume a175db38-d06f-4829-847a-7a5f9d6d0421 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:42:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-aed13fcf-ca8d-4db9-93fd-d9df5240be17 tempest-VolumesActionsTest-510530160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:42:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-aed13fcf-ca8d-4db9-93fd-d9df5240be17 tempest-VolumesActionsTest-510530160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:42:10 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-aed13fcf-ca8d-4db9-93fd-d9df5240be17 tempest-VolumesActionsTest-510530160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:42:10 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-aed13fcf-ca8d-4db9-93fd-d9df5240be17 tempest-VolumesActionsTest-510530160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:42:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-aed13fcf-ca8d-4db9-93fd-d9df5240be17 tempest-VolumesActionsTest-510530160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:42:10 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-aed13fcf-ca8d-4db9-93fd-d9df5240be17 tempest-VolumesActionsTest-510530160 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:42:10 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-aed13fcf-ca8d-4db9-93fd-d9df5240be17 tempest-VolumesActionsTest-510530160 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:42:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-aed13fcf-ca8d-4db9-93fd-d9df5240be17 tempest-VolumesActionsTest-510530160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a175db38-d06f-4829-847a-7a5f9d6d0421 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:11 devstack sudo[95847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a175db38-d06f-4829-847a-7a5f9d6d0421 1073741824 Jul 28 10:42:11 devstack sudo[95847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:11 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-96224cbf-d36b-44cd-8365-9307a7b444b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Create snapshot completed successfully Jul 28 10:42:11 devstack sudo[95847]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-aed13fcf-ca8d-4db9-93fd-d9df5240be17 tempest-VolumesActionsTest-510530160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a175db38-d06f-4829-847a-7a5f9d6d0421 1073741824" returned: 0 in 0.598s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-aed13fcf-ca8d-4db9-93fd-d9df5240be17 tempest-VolumesActionsTest-510530160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a175db38-d06f-4829-847a-7a5f9d6d0421 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:11 devstack sudo[95861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a175db38-d06f-4829-847a-7a5f9d6d0421 Jul 28 10:42:11 devstack sudo[95861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:12 devstack sudo[95861]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-aed13fcf-ca8d-4db9-93fd-d9df5240be17 tempest-VolumesActionsTest-510530160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a175db38-d06f-4829-847a-7a5f9d6d0421" returned: 0 in 0.363s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-aed13fcf-ca8d-4db9-93fd-d9df5240be17 tempest-VolumesActionsTest-510530160 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:42:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-aed13fcf-ca8d-4db9-93fd-d9df5240be17 tempest-VolumesActionsTest-510530160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:42:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aed13fcf-ca8d-4db9-93fd-d9df5240be17 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (562b37a9-3804-47b0-bb75-5b16064d1f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a175db38-d06f-4829-847a-7a5f9d6d0421', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aed13fcf-ca8d-4db9-93fd-d9df5240be17 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (723aad61-97d1-4668-a970-946a9dd5960f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:12 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-aed13fcf-ca8d-4db9-93fd-d9df5240be17 tempest-VolumesActionsTest-510530160 None] Volume volume-a175db38-d06f-4829-847a-7a5f9d6d0421 (a175db38-d06f-4829-847a-7a5f9d6d0421): created successfully Jul 28 10:42:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aed13fcf-ca8d-4db9-93fd-d9df5240be17 tempest-VolumesActionsTest-510530160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (723aad61-97d1-4668-a970-946a9dd5960f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aed13fcf-ca8d-4db9-93fd-d9df5240be17 tempest-VolumesActionsTest-510530160 None] Flow 'volume_create_manager' (81644415-4812-4f51-8f98-262aee574240) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:42:12 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-aed13fcf-ca8d-4db9-93fd-d9df5240be17 tempest-VolumesActionsTest-510530160 None] Created volume successfully. Jul 28 10:42:12 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b0342b91-a1fb-43b8-9907-dd750dca8e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Acquiring lock "cinder-adc9a754-6786-429e-bc9d-0e5917bf594a-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:42:12 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b0342b91-a1fb-43b8-9907-dd750dca8e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Lock "cinder-adc9a754-6786-429e-bc9d-0e5917bf594a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:42:12 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b0342b91-a1fb-43b8-9907-dd750dca8e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Acquiring lock "cinder-quobyte-9a91a4c3-26b3-415e-a303-1d14749956af" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:42:12 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b0342b91-a1fb-43b8-9907-dd750dca8e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Lock "cinder-quobyte-9a91a4c3-26b3-415e-a303-1d14749956af" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:42:12 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b0342b91-a1fb-43b8-9907-dd750dca8e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Acquiring lock "cinder-quobyte-adc9a754-6786-429e-bc9d-0e5917bf594a" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:42:12 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b0342b91-a1fb-43b8-9907-dd750dca8e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Lock "cinder-quobyte-adc9a754-6786-429e-bc9d-0e5917bf594a" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:42:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-b0342b91-a1fb-43b8-9907-dd750dca8e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Deleting offline snapshot adc9a754-6786-429e-bc9d-0e5917bf594a of volume 9a91a4c3-26b3-415e-a303-1d14749956af {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:42:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-b0342b91-a1fb-43b8-9907-dd750dca8e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] snapshot_file for this snap is: volume-9a91a4c3-26b3-415e-a303-1d14749956af.adc9a754-6786-429e-bc9d-0e5917bf594a {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:42:12 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e9adc8-70d4-4364-b744-6b1bea9ea7ca]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:42:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b0342b91-a1fb-43b8-9907-dd750dca8e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af.adc9a754-6786-429e-bc9d-0e5917bf594a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:12 devstack sudo[95866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af.adc9a754-6786-429e-bc9d-0e5917bf594a Jul 28 10:42:12 devstack sudo[95866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:13 devstack sudo[95866]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b0342b91-a1fb-43b8-9907-dd750dca8e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af.adc9a754-6786-429e-bc9d-0e5917bf594a" returned: 0 in 0.506s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:13 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-b0342b91-a1fb-43b8-9907-dd750dca8e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a91a4c3-26b3-415e-a303-1d14749956af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:42:13 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[771d4e48-140f-4dd4-9553-d1fe972426cc]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:42:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b0342b91-a1fb-43b8-9907-dd750dca8e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:13 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2683ead-25a9-4bc2-bfce-5e9530268414 tempest-AttachVolumeNegativeTest-1916507259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:42:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c2683ead-25a9-4bc2-bfce-5e9530268414 tempest-AttachVolumeNegativeTest-1916507259 None] Flow 'volume_create_manager' (622c4194-03fb-4e3f-be33-db4280c3d5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:42:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c2683ead-25a9-4bc2-bfce-5e9530268414 tempest-AttachVolumeNegativeTest-1916507259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26c5cb8c-0777-4f97-a9ff-93ed9142df8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c2683ead-25a9-4bc2-bfce-5e9530268414 tempest-AttachVolumeNegativeTest-1916507259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26c5cb8c-0777-4f97-a9ff-93ed9142df8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:42:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-376739056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d17af338-d10c-4940-974b-60bcdd2139dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8306ee0961b64f729ddf2ae1f6f7c568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:42:13Z,use_quota=True,user_id='212a545c1dd1403bba8809b9058c167a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c2683ead-25a9-4bc2-bfce-5e9530268414 tempest-AttachVolumeNegativeTest-1916507259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b579466c-1cce-427d-9d6c-4267862fb077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c2683ead-25a9-4bc2-bfce-5e9530268414 tempest-AttachVolumeNegativeTest-1916507259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b579466c-1cce-427d-9d6c-4267862fb077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c2683ead-25a9-4bc2-bfce-5e9530268414 tempest-AttachVolumeNegativeTest-1916507259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a4761f-6f61-4641-9343-8afe2072cfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c2683ead-25a9-4bc2-bfce-5e9530268414 tempest-AttachVolumeNegativeTest-1916507259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a4761f-6f61-4641-9343-8afe2072cfd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd17af338-d10c-4940-974b-60bcdd2139dd', 'volume_name': 'volume-d17af338-d10c-4940-974b-60bcdd2139dd', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c2683ead-25a9-4bc2-bfce-5e9530268414 tempest-AttachVolumeNegativeTest-1916507259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fd6aa0f-5cfd-44b5-9a1b-e0101679ccf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:13 devstack sudo[95871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af Jul 28 10:42:13 devstack sudo[95871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c2683ead-25a9-4bc2-bfce-5e9530268414 tempest-AttachVolumeNegativeTest-1916507259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fd6aa0f-5cfd-44b5-9a1b-e0101679ccf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c2683ead-25a9-4bc2-bfce-5e9530268414 tempest-AttachVolumeNegativeTest-1916507259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (064c09c3-900d-4834-9778-b5afd3faaa16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:13 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-c2683ead-25a9-4bc2-bfce-5e9530268414 tempest-AttachVolumeNegativeTest-1916507259 None] Volume d17af338-d10c-4940-974b-60bcdd2139dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d17af338-d10c-4940-974b-60bcdd2139dd', 'volume_size': 1} Jul 28 10:42:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c2683ead-25a9-4bc2-bfce-5e9530268414 tempest-AttachVolumeNegativeTest-1916507259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:42:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c2683ead-25a9-4bc2-bfce-5e9530268414 tempest-AttachVolumeNegativeTest-1916507259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:42:13 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c2683ead-25a9-4bc2-bfce-5e9530268414 tempest-AttachVolumeNegativeTest-1916507259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:42:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-376739056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d17af338-d10c-4940-974b-60bcdd2139dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8306ee0961b64f729ddf2ae1f6f7c568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:42:13Z,use_quota=True,user_id='212a545c1dd1403bba8809b9058c167a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:42:13 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-c2683ead-25a9-4bc2-bfce-5e9530268414 tempest-AttachVolumeNegativeTest-1916507259 None] Creating volume d17af338-d10c-4940-974b-60bcdd2139dd {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:42:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c2683ead-25a9-4bc2-bfce-5e9530268414 tempest-AttachVolumeNegativeTest-1916507259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:42:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c2683ead-25a9-4bc2-bfce-5e9530268414 tempest-AttachVolumeNegativeTest-1916507259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:42:13 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c2683ead-25a9-4bc2-bfce-5e9530268414 tempest-AttachVolumeNegativeTest-1916507259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:42:13 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c2683ead-25a9-4bc2-bfce-5e9530268414 tempest-AttachVolumeNegativeTest-1916507259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:42:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c2683ead-25a9-4bc2-bfce-5e9530268414 tempest-AttachVolumeNegativeTest-1916507259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:42:13 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c2683ead-25a9-4bc2-bfce-5e9530268414 tempest-AttachVolumeNegativeTest-1916507259 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:42:13 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-c2683ead-25a9-4bc2-bfce-5e9530268414 tempest-AttachVolumeNegativeTest-1916507259 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:42:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c2683ead-25a9-4bc2-bfce-5e9530268414 tempest-AttachVolumeNegativeTest-1916507259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d17af338-d10c-4940-974b-60bcdd2139dd 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:13 devstack sudo[95873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d17af338-d10c-4940-974b-60bcdd2139dd 1073741824 Jul 28 10:42:13 devstack sudo[95873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:13 devstack sudo[95871]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b0342b91-a1fb-43b8-9907-dd750dca8e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af" returned: 0 in 0.479s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b0342b91-a1fb-43b8-9907-dd750dca8e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af.adc9a754-6786-429e-bc9d-0e5917bf594a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:13 devstack sudo[95881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af.adc9a754-6786-429e-bc9d-0e5917bf594a Jul 28 10:42:13 devstack sudo[95881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:13 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-72aafeac-8578-4615-bef0-c304bcbc975d tempest-VolumesActionsTest-510530160 None] Acquiring lock "cinder-a175db38-d06f-4829-847a-7a5f9d6d0421-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:42:13 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-72aafeac-8578-4615-bef0-c304bcbc975d tempest-VolumesActionsTest-510530160 None] Lock "cinder-a175db38-d06f-4829-847a-7a5f9d6d0421-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:42:13 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-72aafeac-8578-4615-bef0-c304bcbc975d tempest-VolumesActionsTest-510530160 None] Acquiring lock "cinder-quobyte-a175db38-d06f-4829-847a-7a5f9d6d0421" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:42:13 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-72aafeac-8578-4615-bef0-c304bcbc975d tempest-VolumesActionsTest-510530160 None] Lock "cinder-quobyte-a175db38-d06f-4829-847a-7a5f9d6d0421" acquired by "delete_volume" :: waited 0.020s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:42:13 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0ce1fe-aed3-4492-8a81-6072bee6c9ea]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:42:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-72aafeac-8578-4615-bef0-c304bcbc975d tempest-VolumesActionsTest-510530160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a175db38-d06f-4829-847a-7a5f9d6d0421 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:13 devstack sudo[95873]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c2683ead-25a9-4bc2-bfce-5e9530268414 tempest-AttachVolumeNegativeTest-1916507259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d17af338-d10c-4940-974b-60bcdd2139dd 1073741824" returned: 0 in 0.660s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c2683ead-25a9-4bc2-bfce-5e9530268414 tempest-AttachVolumeNegativeTest-1916507259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d17af338-d10c-4940-974b-60bcdd2139dd {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:14 devstack sudo[95888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d17af338-d10c-4940-974b-60bcdd2139dd Jul 28 10:42:14 devstack sudo[95888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:14 devstack sudo[95886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a175db38-d06f-4829-847a-7a5f9d6d0421 Jul 28 10:42:14 devstack sudo[95886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:14 devstack sudo[95881]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b0342b91-a1fb-43b8-9907-dd750dca8e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af.adc9a754-6786-429e-bc9d-0e5917bf594a" returned: 0 in 0.515s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b0342b91-a1fb-43b8-9907-dd750dca8e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af.adc9a754-6786-429e-bc9d-0e5917bf594a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:14 devstack sudo[95891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af.adc9a754-6786-429e-bc9d-0e5917bf594a Jul 28 10:42:14 devstack sudo[95891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:14 devstack sudo[95888]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c2683ead-25a9-4bc2-bfce-5e9530268414 tempest-AttachVolumeNegativeTest-1916507259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d17af338-d10c-4940-974b-60bcdd2139dd" returned: 0 in 0.282s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:14 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c2683ead-25a9-4bc2-bfce-5e9530268414 tempest-AttachVolumeNegativeTest-1916507259 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:42:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c2683ead-25a9-4bc2-bfce-5e9530268414 tempest-AttachVolumeNegativeTest-1916507259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:42:14 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c2683ead-25a9-4bc2-bfce-5e9530268414 tempest-AttachVolumeNegativeTest-1916507259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (064c09c3-900d-4834-9778-b5afd3faaa16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d17af338-d10c-4940-974b-60bcdd2139dd', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:14 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c2683ead-25a9-4bc2-bfce-5e9530268414 tempest-AttachVolumeNegativeTest-1916507259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (997222a5-06d9-49dd-85df-62ec2e1685b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:14 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-c2683ead-25a9-4bc2-bfce-5e9530268414 tempest-AttachVolumeNegativeTest-1916507259 None] Volume volume-d17af338-d10c-4940-974b-60bcdd2139dd (d17af338-d10c-4940-974b-60bcdd2139dd): created successfully Jul 28 10:42:14 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c2683ead-25a9-4bc2-bfce-5e9530268414 tempest-AttachVolumeNegativeTest-1916507259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (997222a5-06d9-49dd-85df-62ec2e1685b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:14 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c2683ead-25a9-4bc2-bfce-5e9530268414 tempest-AttachVolumeNegativeTest-1916507259 None] Flow 'volume_create_manager' (622c4194-03fb-4e3f-be33-db4280c3d5b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:42:14 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-c2683ead-25a9-4bc2-bfce-5e9530268414 tempest-AttachVolumeNegativeTest-1916507259 None] Created volume successfully. Jul 28 10:42:14 devstack sudo[95886]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-72aafeac-8578-4615-bef0-c304bcbc975d tempest-VolumesActionsTest-510530160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a175db38-d06f-4829-847a-7a5f9d6d0421" returned: 0 in 0.474s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-72aafeac-8578-4615-bef0-c304bcbc975d tempest-VolumesActionsTest-510530160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a175db38-d06f-4829-847a-7a5f9d6d0421 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:14 devstack sudo[95898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a175db38-d06f-4829-847a-7a5f9d6d0421 Jul 28 10:42:14 devstack sudo[95898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:14 devstack sudo[95891]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b0342b91-a1fb-43b8-9907-dd750dca8e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af.adc9a754-6786-429e-bc9d-0e5917bf594a" returned: 0 in 0.331s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:14 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b0342b91-a1fb-43b8-9907-dd750dca8e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Lock "cinder-quobyte-adc9a754-6786-429e-bc9d-0e5917bf594a" released by "_delete_snapshot" :: held 1.994s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:42:14 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b0342b91-a1fb-43b8-9907-dd750dca8e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Lock "cinder-quobyte-9a91a4c3-26b3-415e-a303-1d14749956af" released by "delete_snapshot" :: held 2.028s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:42:14 devstack cinder-volume[88413]: WARNING cinder.quota [None req-b0342b91-a1fb-43b8-9907-dd750dca8e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 28 10:42:14 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-b0342b91-a1fb-43b8-9907-dd750dca8e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Created reservations ['0b25598b-bb65-4622-bfd0-ac6ed25b73db', 'abb7db08-fda3-4be7-ab28-3bb4cf16e356', '61900f06-b67a-4003-963f-7965fbec69fa', '8349b896-4c46-4e59-a2de-6c1fc5057c9d'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:42:14 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-b0342b91-a1fb-43b8-9907-dd750dca8e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Delete snapshot completed successfully. Jul 28 10:42:14 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b0342b91-a1fb-43b8-9907-dd750dca8e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Lock "cinder-adc9a754-6786-429e-bc9d-0e5917bf594a-delete_snapshot" released by "delete_snapshot" :: held 2.195s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:42:14 devstack sudo[95898]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-72aafeac-8578-4615-bef0-c304bcbc975d tempest-VolumesActionsTest-510530160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a175db38-d06f-4829-847a-7a5f9d6d0421" returned: 0 in 0.273s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:14 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-72aafeac-8578-4615-bef0-c304bcbc975d tempest-VolumesActionsTest-510530160 None] Lock "cinder-quobyte-a175db38-d06f-4829-847a-7a5f9d6d0421" released by "delete_volume" :: held 0.801s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:42:14 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-72aafeac-8578-4615-bef0-c304bcbc975d tempest-VolumesActionsTest-510530160 None] Created reservations ['f04e18d8-0e86-4105-9380-9881408ca003', '758b8d7f-0ff2-4aec-a68a-3f654015c56f', '6a38aceb-a044-4051-b35b-48b897472d6c', '60d5db2d-f036-4f7a-b029-901b831b693f'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:42:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-72aafeac-8578-4615-bef0-c304bcbc975d tempest-VolumesActionsTest-510530160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:42:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-72aafeac-8578-4615-bef0-c304bcbc975d tempest-VolumesActionsTest-510530160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:42:14 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-72aafeac-8578-4615-bef0-c304bcbc975d tempest-VolumesActionsTest-510530160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:42:14 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-72aafeac-8578-4615-bef0-c304bcbc975d tempest-VolumesActionsTest-510530160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:42:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-72aafeac-8578-4615-bef0-c304bcbc975d tempest-VolumesActionsTest-510530160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:42:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-72aafeac-8578-4615-bef0-c304bcbc975d tempest-VolumesActionsTest-510530160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:14 devstack sudo[95901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:42:14 devstack sudo[95901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:15 devstack sudo[95901]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-72aafeac-8578-4615-bef0-c304bcbc975d tempest-VolumesActionsTest-510530160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.272s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:15 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-72aafeac-8578-4615-bef0-c304bcbc975d tempest-VolumesActionsTest-510530160 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:42:15 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-72aafeac-8578-4615-bef0-c304bcbc975d tempest-VolumesActionsTest-510530160 None] Deleted volume successfully. Jul 28 10:42:15 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-72aafeac-8578-4615-bef0-c304bcbc975d tempest-VolumesActionsTest-510530160 None] Lock "cinder-a175db38-d06f-4829-847a-7a5f9d6d0421-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:42:15 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-99f30db7-881f-410a-94c5-53e6ca32b5f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Acquiring lock "cinder-9a91a4c3-26b3-415e-a303-1d14749956af-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:42:15 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-99f30db7-881f-410a-94c5-53e6ca32b5f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Lock "cinder-9a91a4c3-26b3-415e-a303-1d14749956af-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:42:15 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-99f30db7-881f-410a-94c5-53e6ca32b5f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Acquiring lock "cinder-quobyte-9a91a4c3-26b3-415e-a303-1d14749956af" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:42:15 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-99f30db7-881f-410a-94c5-53e6ca32b5f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Lock "cinder-quobyte-9a91a4c3-26b3-415e-a303-1d14749956af" acquired by "delete_volume" :: waited 0.020s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:42:16 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5416abc-0a9b-4e17-a96d-fd84d78d63e3]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:42:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-99f30db7-881f-410a-94c5-53e6ca32b5f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:16 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=123,cinder:UPDATE=186,cinder:INSERT=35,cinder:DELETE=12 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:42:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-6e8eed12-6652-4997-8769-cf3415e0a0d8 req-4414d933-cb2b-454f-aea8-d11a05b62add tempest-AttachVolumeNegativeTest-1916507259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:42:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-6e8eed12-6652-4997-8769-cf3415e0a0d8 req-4414d933-cb2b-454f-aea8-d11a05b62add tempest-AttachVolumeNegativeTest-1916507259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:42:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-6e8eed12-6652-4997-8769-cf3415e0a0d8 req-4414d933-cb2b-454f-aea8-d11a05b62add tempest-AttachVolumeNegativeTest-1916507259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:42:16 devstack sudo[95917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af Jul 28 10:42:16 devstack sudo[95917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:16 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-6e8eed12-6652-4997-8769-cf3415e0a0d8 req-4414d933-cb2b-454f-aea8-d11a05b62add tempest-AttachVolumeNegativeTest-1916507259 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7', 'name': 'volume-d17af338-d10c-4940-974b-60bcdd2139dd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f0f8873b-fd99-4f22-acaa-1cd5f17f6ff2', 'enforce_multipath': True} {{(pid=88413) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 10:42:16 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-6e8eed12-6652-4997-8769-cf3415e0a0d8 req-4414d933-cb2b-454f-aea8-d11a05b62add tempest-AttachVolumeNegativeTest-1916507259 None] attachment_update completed successfully. Jul 28 10:42:16 devstack sudo[95917]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-99f30db7-881f-410a-94c5-53e6ca32b5f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af" returned: 0 in 0.541s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-99f30db7-881f-410a-94c5-53e6ca32b5f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:16 devstack sudo[96021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af Jul 28 10:42:16 devstack sudo[96021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:17 devstack sudo[96021]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-99f30db7-881f-410a-94c5-53e6ca32b5f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a91a4c3-26b3-415e-a303-1d14749956af" returned: 0 in 0.457s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:17 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-99f30db7-881f-410a-94c5-53e6ca32b5f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Lock "cinder-quobyte-9a91a4c3-26b3-415e-a303-1d14749956af" released by "delete_volume" :: held 1.099s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:42:17 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-e51942d3-b0e8-41c8-8794-316699e7aee4 tempest-SnapshotsActionsTest-2037609075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:42:17 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e51942d3-b0e8-41c8-8794-316699e7aee4 tempest-SnapshotsActionsTest-2037609075 None] Flow 'volume_create_manager' (a063b267-770f-4103-ad38-88e8517585e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:42:17 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e51942d3-b0e8-41c8-8794-316699e7aee4 tempest-SnapshotsActionsTest-2037609075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5ffc51-da5a-489a-8e6e-9e0ac29e6409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:17 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e51942d3-b0e8-41c8-8794-316699e7aee4 tempest-SnapshotsActionsTest-2037609075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5ffc51-da5a-489a-8e6e-9e0ac29e6409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-641539553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d85ab57f-3144-4fab-a8c2-8a3d241e347b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65ac0611fdf84d369cb1f617a8fb1e4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:42:17Z,use_quota=True,user_id='64c166fc51aa4ebc945a28909c0da0f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:17 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e51942d3-b0e8-41c8-8794-316699e7aee4 tempest-SnapshotsActionsTest-2037609075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (677b6352-2737-4b7c-8566-6a44dcbea0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:17 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e51942d3-b0e8-41c8-8794-316699e7aee4 tempest-SnapshotsActionsTest-2037609075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (677b6352-2737-4b7c-8566-6a44dcbea0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:17 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e51942d3-b0e8-41c8-8794-316699e7aee4 tempest-SnapshotsActionsTest-2037609075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2d354e5-bd8c-4a41-9526-337dd23a0a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:17 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e51942d3-b0e8-41c8-8794-316699e7aee4 tempest-SnapshotsActionsTest-2037609075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2d354e5-bd8c-4a41-9526-337dd23a0a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd85ab57f-3144-4fab-a8c2-8a3d241e347b', 'volume_name': 'volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:17 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e51942d3-b0e8-41c8-8794-316699e7aee4 tempest-SnapshotsActionsTest-2037609075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb2e51e-449d-43ea-b787-442f608d42ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:17 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e51942d3-b0e8-41c8-8794-316699e7aee4 tempest-SnapshotsActionsTest-2037609075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb2e51e-449d-43ea-b787-442f608d42ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:17 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e51942d3-b0e8-41c8-8794-316699e7aee4 tempest-SnapshotsActionsTest-2037609075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f60f2b9c-1e4d-4018-bffe-108b74ebba49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:17 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-e51942d3-b0e8-41c8-8794-316699e7aee4 tempest-SnapshotsActionsTest-2037609075 None] Volume d85ab57f-3144-4fab-a8c2-8a3d241e347b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b', 'volume_size': 1} Jul 28 10:42:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e51942d3-b0e8-41c8-8794-316699e7aee4 tempest-SnapshotsActionsTest-2037609075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:42:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e51942d3-b0e8-41c8-8794-316699e7aee4 tempest-SnapshotsActionsTest-2037609075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:42:17 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e51942d3-b0e8-41c8-8794-316699e7aee4 tempest-SnapshotsActionsTest-2037609075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-641539553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d85ab57f-3144-4fab-a8c2-8a3d241e347b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65ac0611fdf84d369cb1f617a8fb1e4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:42:17Z,use_quota=True,user_id='64c166fc51aa4ebc945a28909c0da0f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:42:17 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-e51942d3-b0e8-41c8-8794-316699e7aee4 tempest-SnapshotsActionsTest-2037609075 None] Creating volume d85ab57f-3144-4fab-a8c2-8a3d241e347b {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:42:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e51942d3-b0e8-41c8-8794-316699e7aee4 tempest-SnapshotsActionsTest-2037609075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:42:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e51942d3-b0e8-41c8-8794-316699e7aee4 tempest-SnapshotsActionsTest-2037609075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:42:17 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e51942d3-b0e8-41c8-8794-316699e7aee4 tempest-SnapshotsActionsTest-2037609075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:42:17 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e51942d3-b0e8-41c8-8794-316699e7aee4 tempest-SnapshotsActionsTest-2037609075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:42:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e51942d3-b0e8-41c8-8794-316699e7aee4 tempest-SnapshotsActionsTest-2037609075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:42:17 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e51942d3-b0e8-41c8-8794-316699e7aee4 tempest-SnapshotsActionsTest-2037609075 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:42:17 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-e51942d3-b0e8-41c8-8794-316699e7aee4 tempest-SnapshotsActionsTest-2037609075 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:42:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e51942d3-b0e8-41c8-8794-316699e7aee4 tempest-SnapshotsActionsTest-2037609075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:17 devstack sudo[96347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b 1073741824 Jul 28 10:42:17 devstack sudo[96347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:17 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-99f30db7-881f-410a-94c5-53e6ca32b5f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Created reservations ['6fba218f-3b98-480c-9d6a-03f7477e0e41', 'dea8cbb4-9ee3-41d7-ad64-203e4fd553a7', '7f7e20a2-2a85-44c1-90b6-0e3b0dab5583', 'cccfb05a-78a3-4d93-a2e4-5e8dc7bb92aa'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:42:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-99f30db7-881f-410a-94c5-53e6ca32b5f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:42:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-99f30db7-881f-410a-94c5-53e6ca32b5f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:42:17 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-99f30db7-881f-410a-94c5-53e6ca32b5f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:42:17 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-99f30db7-881f-410a-94c5-53e6ca32b5f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:42:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-99f30db7-881f-410a-94c5-53e6ca32b5f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:42:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-99f30db7-881f-410a-94c5-53e6ca32b5f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:17 devstack sudo[96349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:42:17 devstack sudo[96349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:17 devstack sudo[96349]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-99f30db7-881f-410a-94c5-53e6ca32b5f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.338s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:17 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-99f30db7-881f-410a-94c5-53e6ca32b5f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:42:17 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-99f30db7-881f-410a-94c5-53e6ca32b5f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Deleted volume successfully. Jul 28 10:42:17 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-99f30db7-881f-410a-94c5-53e6ca32b5f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1332358247 None] Lock "cinder-9a91a4c3-26b3-415e-a303-1d14749956af-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:42:17 devstack sudo[96347]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e51942d3-b0e8-41c8-8794-316699e7aee4 tempest-SnapshotsActionsTest-2037609075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b 1073741824" returned: 0 in 0.613s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e51942d3-b0e8-41c8-8794-316699e7aee4 tempest-SnapshotsActionsTest-2037609075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:17 devstack sudo[96356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b Jul 28 10:42:17 devstack sudo[96356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:18 devstack sudo[96356]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e51942d3-b0e8-41c8-8794-316699e7aee4 tempest-SnapshotsActionsTest-2037609075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b" returned: 0 in 0.306s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:18 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e51942d3-b0e8-41c8-8794-316699e7aee4 tempest-SnapshotsActionsTest-2037609075 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:42:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e51942d3-b0e8-41c8-8794-316699e7aee4 tempest-SnapshotsActionsTest-2037609075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:42:18 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e51942d3-b0e8-41c8-8794-316699e7aee4 tempest-SnapshotsActionsTest-2037609075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f60f2b9c-1e4d-4018-bffe-108b74ebba49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:18 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e51942d3-b0e8-41c8-8794-316699e7aee4 tempest-SnapshotsActionsTest-2037609075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d993e2b5-6d47-4ac3-8652-c3c7310e09a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:18 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-e51942d3-b0e8-41c8-8794-316699e7aee4 tempest-SnapshotsActionsTest-2037609075 None] Volume volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b (d85ab57f-3144-4fab-a8c2-8a3d241e347b): created successfully Jul 28 10:42:18 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e51942d3-b0e8-41c8-8794-316699e7aee4 tempest-SnapshotsActionsTest-2037609075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d993e2b5-6d47-4ac3-8652-c3c7310e09a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:18 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e51942d3-b0e8-41c8-8794-316699e7aee4 tempest-SnapshotsActionsTest-2037609075 None] Flow 'volume_create_manager' (a063b267-770f-4103-ad38-88e8517585e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:42:18 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-e51942d3-b0e8-41c8-8794-316699e7aee4 tempest-SnapshotsActionsTest-2037609075 None] Created volume successfully. Jul 28 10:42:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0470668f-3461-4590-b62c-b90fc5772d20 tempest-SnapshotsActionsTest-2037609075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:42:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0470668f-3461-4590-b62c-b90fc5772d20 tempest-SnapshotsActionsTest-2037609075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:42:19 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-0470668f-3461-4590-b62c-b90fc5772d20 tempest-SnapshotsActionsTest-2037609075 None] Creating offline snapshot bf58dd49-9fd9-4b2b-825b-f06e3875aff1 of volume d85ab57f-3144-4fab-a8c2-8a3d241e347b {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:42:19 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8302e31-21c0-4031-9b92-811cad1087d5]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:42:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0470668f-3461-4590-b62c-b90fc5772d20 tempest-SnapshotsActionsTest-2037609075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:19 devstack sudo[96361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b Jul 28 10:42:19 devstack sudo[96361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:19 devstack sudo[96361]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0470668f-3461-4590-b62c-b90fc5772d20 tempest-SnapshotsActionsTest-2037609075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b" returned: 0 in 0.477s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0470668f-3461-4590-b62c-b90fc5772d20 tempest-SnapshotsActionsTest-2037609075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:20 devstack sudo[96366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 1G Jul 28 10:42:20 devstack sudo[96366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:20 devstack sudo[96366]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0470668f-3461-4590-b62c-b90fc5772d20 tempest-SnapshotsActionsTest-2037609075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 1G" returned: 0 in 0.518s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0470668f-3461-4590-b62c-b90fc5772d20 tempest-SnapshotsActionsTest-2037609075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:20 devstack sudo[96372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 Jul 28 10:42:20 devstack sudo[96372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:20 devstack sudo[96372]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0470668f-3461-4590-b62c-b90fc5772d20 tempest-SnapshotsActionsTest-2037609075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1" returned: 0 in 0.402s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:20 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-0470668f-3461-4590-b62c-b90fc5772d20 tempest-SnapshotsActionsTest-2037609075 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 is being set with open permissions: ugo+rw Jul 28 10:42:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0470668f-3461-4590-b62c-b90fc5772d20 tempest-SnapshotsActionsTest-2037609075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:20 devstack sudo[96377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 Jul 28 10:42:20 devstack sudo[96377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:21 devstack sudo[96377]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0470668f-3461-4590-b62c-b90fc5772d20 tempest-SnapshotsActionsTest-2037609075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1" returned: 0 in 0.259s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0470668f-3461-4590-b62c-b90fc5772d20 tempest-SnapshotsActionsTest-2037609075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:21 devstack sudo[96380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.info Jul 28 10:42:21 devstack sudo[96380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:21 devstack sudo[96380]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0470668f-3461-4590-b62c-b90fc5772d20 tempest-SnapshotsActionsTest-2037609075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.info" returned: 0 in 0.299s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:21 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-0470668f-3461-4590-b62c-b90fc5772d20 tempest-SnapshotsActionsTest-2037609075 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.info is being set with open permissions: ugo+rw Jul 28 10:42:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0470668f-3461-4590-b62c-b90fc5772d20 tempest-SnapshotsActionsTest-2037609075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:21 devstack sudo[96383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.info Jul 28 10:42:21 devstack sudo[96383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:21 devstack sudo[96383]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0470668f-3461-4590-b62c-b90fc5772d20 tempest-SnapshotsActionsTest-2037609075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.info" returned: 0 in 0.260s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0470668f-3461-4590-b62c-b90fc5772d20 tempest-SnapshotsActionsTest-2037609075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.339s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:42:21 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-0470668f-3461-4590-b62c-b90fc5772d20 tempest-SnapshotsActionsTest-2037609075 None] Create snapshot completed successfully Jul 28 10:42:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-bd9168c2-2adc-4237-a893-141faeb1f464 tempest-SnapshotsActionsTest-2037609075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:42:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-bd9168c2-2adc-4237-a893-141faeb1f464 tempest-SnapshotsActionsTest-2037609075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:42:23 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-bd9168c2-2adc-4237-a893-141faeb1f464 tempest-SnapshotsActionsTest-2037609075 None] Creating offline snapshot c5eef4f0-e47e-4aff-a663-3d387d6a75fe of volume d85ab57f-3144-4fab-a8c2-8a3d241e347b {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:42:24 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5acd356-9b72-466b-840d-d8e32ccc3959]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:42:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bd9168c2-2adc-4237-a893-141faeb1f464 tempest-SnapshotsActionsTest-2037609075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:24 devstack sudo[96391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 Jul 28 10:42:24 devstack sudo[96391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:24 devstack sudo[96391]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bd9168c2-2adc-4237-a893-141faeb1f464 tempest-SnapshotsActionsTest-2037609075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1" returned: 0 in 0.624s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:24 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-bd9168c2-2adc-4237-a893-141faeb1f464 tempest-SnapshotsActionsTest-2037609075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:42:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bd9168c2-2adc-4237-a893-141faeb1f464 tempest-SnapshotsActionsTest-2037609075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.c5eef4f0-e47e-4aff-a663-3d387d6a75fe 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:24 devstack sudo[96401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.c5eef4f0-e47e-4aff-a663-3d387d6a75fe 1G Jul 28 10:42:24 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:25 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bd9168c2-2adc-4237-a893-141faeb1f464 tempest-SnapshotsActionsTest-2037609075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.c5eef4f0-e47e-4aff-a663-3d387d6a75fe 1G" returned: 0 in 0.839s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bd9168c2-2adc-4237-a893-141faeb1f464 tempest-SnapshotsActionsTest-2037609075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.c5eef4f0-e47e-4aff-a663-3d387d6a75fe {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:25 devstack sudo[96419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.c5eef4f0-e47e-4aff-a663-3d387d6a75fe Jul 28 10:42:25 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:25 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bd9168c2-2adc-4237-a893-141faeb1f464 tempest-SnapshotsActionsTest-2037609075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.c5eef4f0-e47e-4aff-a663-3d387d6a75fe" returned: 0 in 0.426s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:25 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-bd9168c2-2adc-4237-a893-141faeb1f464 tempest-SnapshotsActionsTest-2037609075 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.c5eef4f0-e47e-4aff-a663-3d387d6a75fe is being set with open permissions: ugo+rw Jul 28 10:42:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bd9168c2-2adc-4237-a893-141faeb1f464 tempest-SnapshotsActionsTest-2037609075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.c5eef4f0-e47e-4aff-a663-3d387d6a75fe {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:26 devstack sudo[96424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.c5eef4f0-e47e-4aff-a663-3d387d6a75fe Jul 28 10:42:26 devstack sudo[96424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:26 devstack sudo[96424]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bd9168c2-2adc-4237-a893-141faeb1f464 tempest-SnapshotsActionsTest-2037609075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.c5eef4f0-e47e-4aff-a663-3d387d6a75fe" returned: 0 in 0.363s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-bd9168c2-2adc-4237-a893-141faeb1f464 tempest-SnapshotsActionsTest-2037609075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.538s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:42:26 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-bd9168c2-2adc-4237-a893-141faeb1f464 tempest-SnapshotsActionsTest-2037609075 None] Create snapshot completed successfully Jul 28 10:42:27 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b6f12983-d021-40a0-a1e9-0b6d1abb4866 tempest-SnapshotsActionsTest-1133738055 None] Acquiring lock "cinder-c5eef4f0-e47e-4aff-a663-3d387d6a75fe-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:42:27 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b6f12983-d021-40a0-a1e9-0b6d1abb4866 tempest-SnapshotsActionsTest-1133738055 None] Lock "cinder-c5eef4f0-e47e-4aff-a663-3d387d6a75fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:42:27 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b6f12983-d021-40a0-a1e9-0b6d1abb4866 tempest-SnapshotsActionsTest-1133738055 None] Acquiring lock "cinder-quobyte-d85ab57f-3144-4fab-a8c2-8a3d241e347b" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:42:27 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b6f12983-d021-40a0-a1e9-0b6d1abb4866 tempest-SnapshotsActionsTest-1133738055 None] Lock "cinder-quobyte-d85ab57f-3144-4fab-a8c2-8a3d241e347b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:42:27 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b6f12983-d021-40a0-a1e9-0b6d1abb4866 tempest-SnapshotsActionsTest-1133738055 None] Acquiring lock "cinder-quobyte-c5eef4f0-e47e-4aff-a663-3d387d6a75fe" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:42:27 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b6f12983-d021-40a0-a1e9-0b6d1abb4866 tempest-SnapshotsActionsTest-1133738055 None] Lock "cinder-quobyte-c5eef4f0-e47e-4aff-a663-3d387d6a75fe" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:42:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-b6f12983-d021-40a0-a1e9-0b6d1abb4866 tempest-SnapshotsActionsTest-1133738055 None] Deleting offline snapshot c5eef4f0-e47e-4aff-a663-3d387d6a75fe of volume d85ab57f-3144-4fab-a8c2-8a3d241e347b {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:42:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-b6f12983-d021-40a0-a1e9-0b6d1abb4866 tempest-SnapshotsActionsTest-1133738055 None] snapshot_file for this snap is: volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.c5eef4f0-e47e-4aff-a663-3d387d6a75fe {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:42:27 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc1cc05-a982-4b91-b38c-1b4a90cf38a4]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:42:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b6f12983-d021-40a0-a1e9-0b6d1abb4866 tempest-SnapshotsActionsTest-1133738055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.c5eef4f0-e47e-4aff-a663-3d387d6a75fe {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:27 devstack sudo[96428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.c5eef4f0-e47e-4aff-a663-3d387d6a75fe Jul 28 10:42:27 devstack sudo[96428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:28 devstack sudo[96428]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b6f12983-d021-40a0-a1e9-0b6d1abb4866 tempest-SnapshotsActionsTest-1133738055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.c5eef4f0-e47e-4aff-a663-3d387d6a75fe" returned: 0 in 0.752s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-b6f12983-d021-40a0-a1e9-0b6d1abb4866 tempest-SnapshotsActionsTest-1133738055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:42:28 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[689ec4c5-edc7-473e-9833-86d181efea5b]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:42:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b6f12983-d021-40a0-a1e9-0b6d1abb4866 tempest-SnapshotsActionsTest-1133738055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:28 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:42:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:42:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:42:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:42:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:42:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:42:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:28 devstack sudo[96460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:42:28 devstack sudo[96460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:28 devstack sudo[96455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 Jul 28 10:42:28 devstack sudo[96455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:28 devstack sudo[96455]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b6f12983-d021-40a0-a1e9-0b6d1abb4866 tempest-SnapshotsActionsTest-1133738055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1" returned: 0 in 0.600s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-b6f12983-d021-40a0-a1e9-0b6d1abb4866 tempest-SnapshotsActionsTest-1133738055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:42:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b6f12983-d021-40a0-a1e9-0b6d1abb4866 tempest-SnapshotsActionsTest-1133738055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.c5eef4f0-e47e-4aff-a663-3d387d6a75fe {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:28 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.c5eef4f0-e47e-4aff-a663-3d387d6a75fe Jul 28 10:42:28 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:28 devstack sudo[96460]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.572s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:28 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:42:28 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager._thread_info {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:42:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread count: 8 {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 10:42:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread info: [<_MainThread(MainThread, started 137939890385024)>, , , , , , , ] {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 10:42:29 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b6f12983-d021-40a0-a1e9-0b6d1abb4866 tempest-SnapshotsActionsTest-1133738055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.c5eef4f0-e47e-4aff-a663-3d387d6a75fe" returned: 0 in 0.636s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b6f12983-d021-40a0-a1e9-0b6d1abb4866 tempest-SnapshotsActionsTest-1133738055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.c5eef4f0-e47e-4aff-a663-3d387d6a75fe {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:29 devstack sudo[96497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.c5eef4f0-e47e-4aff-a663-3d387d6a75fe Jul 28 10:42:29 devstack sudo[96497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:29 devstack sudo[96497]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b6f12983-d021-40a0-a1e9-0b6d1abb4866 tempest-SnapshotsActionsTest-1133738055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.c5eef4f0-e47e-4aff-a663-3d387d6a75fe" returned: 0 in 0.469s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:29 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b6f12983-d021-40a0-a1e9-0b6d1abb4866 tempest-SnapshotsActionsTest-1133738055 None] Lock "cinder-quobyte-c5eef4f0-e47e-4aff-a663-3d387d6a75fe" released by "_delete_snapshot" :: held 2.669s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:42:29 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b6f12983-d021-40a0-a1e9-0b6d1abb4866 tempest-SnapshotsActionsTest-1133738055 None] Lock "cinder-quobyte-d85ab57f-3144-4fab-a8c2-8a3d241e347b" released by "delete_snapshot" :: held 2.707s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:42:30 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-b6f12983-d021-40a0-a1e9-0b6d1abb4866 tempest-SnapshotsActionsTest-1133738055 None] Created reservations ['085be243-c839-43bc-b1d1-28cbe8864fbd', '745fda16-dd6b-4c58-9920-9cf264aa1ebc', 'ff9aa860-5706-4285-bbdb-a31b21ea31ed', 'fc43b8ef-16f9-49a5-93e1-3b909b0ce0a7'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:42:30 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-b6f12983-d021-40a0-a1e9-0b6d1abb4866 tempest-SnapshotsActionsTest-1133738055 None] Delete snapshot completed successfully. Jul 28 10:42:30 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b6f12983-d021-40a0-a1e9-0b6d1abb4866 tempest-SnapshotsActionsTest-1133738055 None] Lock "cinder-c5eef4f0-e47e-4aff-a663-3d387d6a75fe-delete_snapshot" released by "delete_snapshot" :: held 2.887s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:42:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7de1ca4c-d59f-49f4-9b3b-573c9a492996 tempest-SnapshotsActionsTest-2037609075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:42:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7de1ca4c-d59f-49f4-9b3b-573c9a492996 tempest-SnapshotsActionsTest-2037609075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:42:31 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-7de1ca4c-d59f-49f4-9b3b-573c9a492996 tempest-SnapshotsActionsTest-2037609075 None] Creating offline snapshot 954a1b33-13a6-4337-b470-d30ab675527c of volume d85ab57f-3144-4fab-a8c2-8a3d241e347b {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:42:31 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[599be449-3a3d-4113-9fed-9980af1036ce]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:42:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7de1ca4c-d59f-49f4-9b3b-573c9a492996 tempest-SnapshotsActionsTest-2037609075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:31 devstack sudo[96509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 Jul 28 10:42:31 devstack sudo[96509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:31 devstack sudo[96509]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7de1ca4c-d59f-49f4-9b3b-573c9a492996 tempest-SnapshotsActionsTest-2037609075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1" returned: 0 in 0.529s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:31 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-7de1ca4c-d59f-49f4-9b3b-573c9a492996 tempest-SnapshotsActionsTest-2037609075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:42:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7de1ca4c-d59f-49f4-9b3b-573c9a492996 tempest-SnapshotsActionsTest-2037609075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.954a1b33-13a6-4337-b470-d30ab675527c 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:31 devstack sudo[96515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.954a1b33-13a6-4337-b470-d30ab675527c 1G Jul 28 10:42:31 devstack sudo[96515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:32 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-f31f60eb-584c-4959-ae84-83eaf87ac710 tempest-AbsoluteLimitsTests-1233982055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:42:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f31f60eb-584c-4959-ae84-83eaf87ac710 tempest-AbsoluteLimitsTests-1233982055 None] Flow 'volume_create_manager' (16ef8f4c-cdf3-4c1b-99ee-4aa2f3b29125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:42:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f31f60eb-584c-4959-ae84-83eaf87ac710 tempest-AbsoluteLimitsTests-1233982055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58c74b38-6485-4de8-9067-82edab32bec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f31f60eb-584c-4959-ae84-83eaf87ac710 tempest-AbsoluteLimitsTests-1233982055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58c74b38-6485-4de8-9067-82edab32bec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-205984412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb38feb9-9764-44dd-85d0-2f89bc8563e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1513f4e80e6242f889f975058d246bd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:42:32Z,use_quota=True,user_id='3806eae683c24034ba60c038d76caf01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f31f60eb-584c-4959-ae84-83eaf87ac710 tempest-AbsoluteLimitsTests-1233982055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f78a6109-87c8-458b-a3ed-d6b5cbb8ad8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f31f60eb-584c-4959-ae84-83eaf87ac710 tempest-AbsoluteLimitsTests-1233982055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f78a6109-87c8-458b-a3ed-d6b5cbb8ad8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f31f60eb-584c-4959-ae84-83eaf87ac710 tempest-AbsoluteLimitsTests-1233982055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c1dea6-6207-49c2-b8c0-28c9d6762292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f31f60eb-584c-4959-ae84-83eaf87ac710 tempest-AbsoluteLimitsTests-1233982055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c1dea6-6207-49c2-b8c0-28c9d6762292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb38feb9-9764-44dd-85d0-2f89bc8563e8', 'volume_name': 'volume-cb38feb9-9764-44dd-85d0-2f89bc8563e8', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f31f60eb-584c-4959-ae84-83eaf87ac710 tempest-AbsoluteLimitsTests-1233982055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (252a99d4-b887-45d9-8673-c6aefeeb65b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f31f60eb-584c-4959-ae84-83eaf87ac710 tempest-AbsoluteLimitsTests-1233982055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (252a99d4-b887-45d9-8673-c6aefeeb65b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f31f60eb-584c-4959-ae84-83eaf87ac710 tempest-AbsoluteLimitsTests-1233982055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7d9f349-9a7f-480b-95b8-9b399146becd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:32 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-f31f60eb-584c-4959-ae84-83eaf87ac710 tempest-AbsoluteLimitsTests-1233982055 None] Volume cb38feb9-9764-44dd-85d0-2f89bc8563e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb38feb9-9764-44dd-85d0-2f89bc8563e8', 'volume_size': 1} Jul 28 10:42:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f31f60eb-584c-4959-ae84-83eaf87ac710 tempest-AbsoluteLimitsTests-1233982055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:42:32 devstack sudo[96515]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7de1ca4c-d59f-49f4-9b3b-573c9a492996 tempest-SnapshotsActionsTest-2037609075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.954a1b33-13a6-4337-b470-d30ab675527c 1G" returned: 0 in 0.711s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7de1ca4c-d59f-49f4-9b3b-573c9a492996 tempest-SnapshotsActionsTest-2037609075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.954a1b33-13a6-4337-b470-d30ab675527c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:32 devstack sudo[96527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.954a1b33-13a6-4337-b470-d30ab675527c Jul 28 10:42:32 devstack sudo[96527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:33 devstack sudo[96527]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7de1ca4c-d59f-49f4-9b3b-573c9a492996 tempest-SnapshotsActionsTest-2037609075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.954a1b33-13a6-4337-b470-d30ab675527c" returned: 0 in 0.426s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:33 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-7de1ca4c-d59f-49f4-9b3b-573c9a492996 tempest-SnapshotsActionsTest-2037609075 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.954a1b33-13a6-4337-b470-d30ab675527c is being set with open permissions: ugo+rw Jul 28 10:42:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7de1ca4c-d59f-49f4-9b3b-573c9a492996 tempest-SnapshotsActionsTest-2037609075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.954a1b33-13a6-4337-b470-d30ab675527c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:33 devstack sudo[96532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.954a1b33-13a6-4337-b470-d30ab675527c Jul 28 10:42:33 devstack sudo[96532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:33 devstack sudo[96532]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7de1ca4c-d59f-49f4-9b3b-573c9a492996 tempest-SnapshotsActionsTest-2037609075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.954a1b33-13a6-4337-b470-d30ab675527c" returned: 0 in 0.339s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7de1ca4c-d59f-49f4-9b3b-573c9a492996 tempest-SnapshotsActionsTest-2037609075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.207s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:42:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f31f60eb-584c-4959-ae84-83eaf87ac710 tempest-AbsoluteLimitsTests-1233982055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.987s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:42:33 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f31f60eb-584c-4959-ae84-83eaf87ac710 tempest-AbsoluteLimitsTests-1233982055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-205984412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb38feb9-9764-44dd-85d0-2f89bc8563e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1513f4e80e6242f889f975058d246bd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:42:32Z,use_quota=True,user_id='3806eae683c24034ba60c038d76caf01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:42:33 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-f31f60eb-584c-4959-ae84-83eaf87ac710 tempest-AbsoluteLimitsTests-1233982055 None] Creating volume cb38feb9-9764-44dd-85d0-2f89bc8563e8 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:42:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f31f60eb-584c-4959-ae84-83eaf87ac710 tempest-AbsoluteLimitsTests-1233982055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:42:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f31f60eb-584c-4959-ae84-83eaf87ac710 tempest-AbsoluteLimitsTests-1233982055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:42:33 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f31f60eb-584c-4959-ae84-83eaf87ac710 tempest-AbsoluteLimitsTests-1233982055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:42:33 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f31f60eb-584c-4959-ae84-83eaf87ac710 tempest-AbsoluteLimitsTests-1233982055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:42:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f31f60eb-584c-4959-ae84-83eaf87ac710 tempest-AbsoluteLimitsTests-1233982055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:42:33 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f31f60eb-584c-4959-ae84-83eaf87ac710 tempest-AbsoluteLimitsTests-1233982055 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:42:33 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-f31f60eb-584c-4959-ae84-83eaf87ac710 tempest-AbsoluteLimitsTests-1233982055 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:42:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f31f60eb-584c-4959-ae84-83eaf87ac710 tempest-AbsoluteLimitsTests-1233982055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-cb38feb9-9764-44dd-85d0-2f89bc8563e8 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:33 devstack sudo[96535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-cb38feb9-9764-44dd-85d0-2f89bc8563e8 1073741824 Jul 28 10:42:33 devstack sudo[96535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:33 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-7de1ca4c-d59f-49f4-9b3b-573c9a492996 tempest-SnapshotsActionsTest-2037609075 None] Create snapshot completed successfully Jul 28 10:42:34 devstack sudo[96535]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f31f60eb-584c-4959-ae84-83eaf87ac710 tempest-AbsoluteLimitsTests-1233982055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-cb38feb9-9764-44dd-85d0-2f89bc8563e8 1073741824" returned: 0 in 0.566s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f31f60eb-584c-4959-ae84-83eaf87ac710 tempest-AbsoluteLimitsTests-1233982055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-cb38feb9-9764-44dd-85d0-2f89bc8563e8 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:34 devstack sudo[96542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-cb38feb9-9764-44dd-85d0-2f89bc8563e8 Jul 28 10:42:34 devstack sudo[96542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:34 devstack sudo[96542]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f31f60eb-584c-4959-ae84-83eaf87ac710 tempest-AbsoluteLimitsTests-1233982055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-cb38feb9-9764-44dd-85d0-2f89bc8563e8" returned: 0 in 0.286s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:34 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f31f60eb-584c-4959-ae84-83eaf87ac710 tempest-AbsoluteLimitsTests-1233982055 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:42:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f31f60eb-584c-4959-ae84-83eaf87ac710 tempest-AbsoluteLimitsTests-1233982055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:42:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f31f60eb-584c-4959-ae84-83eaf87ac710 tempest-AbsoluteLimitsTests-1233982055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7d9f349-9a7f-480b-95b8-9b399146becd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb38feb9-9764-44dd-85d0-2f89bc8563e8', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f31f60eb-584c-4959-ae84-83eaf87ac710 tempest-AbsoluteLimitsTests-1233982055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ea686c-d4db-45d8-9b32-68ec9a3b5064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:34 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-f31f60eb-584c-4959-ae84-83eaf87ac710 tempest-AbsoluteLimitsTests-1233982055 None] Volume volume-cb38feb9-9764-44dd-85d0-2f89bc8563e8 (cb38feb9-9764-44dd-85d0-2f89bc8563e8): created successfully Jul 28 10:42:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f31f60eb-584c-4959-ae84-83eaf87ac710 tempest-AbsoluteLimitsTests-1233982055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ea686c-d4db-45d8-9b32-68ec9a3b5064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f31f60eb-584c-4959-ae84-83eaf87ac710 tempest-AbsoluteLimitsTests-1233982055 None] Flow 'volume_create_manager' (16ef8f4c-cdf3-4c1b-99ee-4aa2f3b29125) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:42:34 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-f31f60eb-584c-4959-ae84-83eaf87ac710 tempest-AbsoluteLimitsTests-1233982055 None] Created volume successfully. Jul 28 10:42:34 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9d13e730-d197-425c-9c1a-08b24ddaa8db tempest-SnapshotsActionsTest-1133738055 None] Acquiring lock "cinder-954a1b33-13a6-4337-b470-d30ab675527c-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:42:34 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9d13e730-d197-425c-9c1a-08b24ddaa8db tempest-SnapshotsActionsTest-1133738055 None] Lock "cinder-954a1b33-13a6-4337-b470-d30ab675527c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:42:34 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9d13e730-d197-425c-9c1a-08b24ddaa8db tempest-SnapshotsActionsTest-1133738055 None] Acquiring lock "cinder-quobyte-d85ab57f-3144-4fab-a8c2-8a3d241e347b" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:42:34 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9d13e730-d197-425c-9c1a-08b24ddaa8db tempest-SnapshotsActionsTest-1133738055 None] Lock "cinder-quobyte-d85ab57f-3144-4fab-a8c2-8a3d241e347b" acquired by "delete_snapshot" :: waited 0.048s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:42:34 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9d13e730-d197-425c-9c1a-08b24ddaa8db tempest-SnapshotsActionsTest-1133738055 None] Acquiring lock "cinder-quobyte-954a1b33-13a6-4337-b470-d30ab675527c" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:42:34 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9d13e730-d197-425c-9c1a-08b24ddaa8db tempest-SnapshotsActionsTest-1133738055 None] Lock "cinder-quobyte-954a1b33-13a6-4337-b470-d30ab675527c" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:42:34 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-9d13e730-d197-425c-9c1a-08b24ddaa8db tempest-SnapshotsActionsTest-1133738055 None] Deleting offline snapshot 954a1b33-13a6-4337-b470-d30ab675527c of volume d85ab57f-3144-4fab-a8c2-8a3d241e347b {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:42:34 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-9d13e730-d197-425c-9c1a-08b24ddaa8db tempest-SnapshotsActionsTest-1133738055 None] snapshot_file for this snap is: volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.954a1b33-13a6-4337-b470-d30ab675527c {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:42:34 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[f627f72a-8e99-4d00-a7fa-222e3e85ba77]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:42:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9d13e730-d197-425c-9c1a-08b24ddaa8db tempest-SnapshotsActionsTest-1133738055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.954a1b33-13a6-4337-b470-d30ab675527c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:34 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.954a1b33-13a6-4337-b470-d30ab675527c Jul 28 10:42:34 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:35 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9d13e730-d197-425c-9c1a-08b24ddaa8db tempest-SnapshotsActionsTest-1133738055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.954a1b33-13a6-4337-b470-d30ab675527c" returned: 0 in 0.422s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:35 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-9d13e730-d197-425c-9c1a-08b24ddaa8db tempest-SnapshotsActionsTest-1133738055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:42:35 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[808f5f77-cc08-492f-a754-81f8eb574195]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:42:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9d13e730-d197-425c-9c1a-08b24ddaa8db tempest-SnapshotsActionsTest-1133738055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:35 devstack sudo[96552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 Jul 28 10:42:35 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:35 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9d13e730-d197-425c-9c1a-08b24ddaa8db tempest-SnapshotsActionsTest-1133738055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1" returned: 0 in 0.461s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:35 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-9d13e730-d197-425c-9c1a-08b24ddaa8db tempest-SnapshotsActionsTest-1133738055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:42:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9d13e730-d197-425c-9c1a-08b24ddaa8db tempest-SnapshotsActionsTest-1133738055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.954a1b33-13a6-4337-b470-d30ab675527c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:35 devstack sudo[96557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.954a1b33-13a6-4337-b470-d30ab675527c Jul 28 10:42:35 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:36 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9b0e0014-f755-4a7e-ac33-8817c31a232d tempest-AbsoluteLimitsTests-1233982055 None] Acquiring lock "cinder-cb38feb9-9764-44dd-85d0-2f89bc8563e8-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:42:36 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9b0e0014-f755-4a7e-ac33-8817c31a232d tempest-AbsoluteLimitsTests-1233982055 None] Lock "cinder-cb38feb9-9764-44dd-85d0-2f89bc8563e8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:42:36 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9b0e0014-f755-4a7e-ac33-8817c31a232d tempest-AbsoluteLimitsTests-1233982055 None] Acquiring lock "cinder-quobyte-cb38feb9-9764-44dd-85d0-2f89bc8563e8" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:42:36 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9b0e0014-f755-4a7e-ac33-8817c31a232d tempest-AbsoluteLimitsTests-1233982055 None] Lock "cinder-quobyte-cb38feb9-9764-44dd-85d0-2f89bc8563e8" acquired by "delete_volume" :: waited 0.037s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:42:36 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[094c2eb7-a6d3-45c0-b1f5-c248af313e53]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:42:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9b0e0014-f755-4a7e-ac33-8817c31a232d tempest-AbsoluteLimitsTests-1233982055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-cb38feb9-9764-44dd-85d0-2f89bc8563e8 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:36 devstack sudo[96561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-cb38feb9-9764-44dd-85d0-2f89bc8563e8 Jul 28 10:42:36 devstack sudo[96561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:36 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9d13e730-d197-425c-9c1a-08b24ddaa8db tempest-SnapshotsActionsTest-1133738055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.954a1b33-13a6-4337-b470-d30ab675527c" returned: 0 in 0.519s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9d13e730-d197-425c-9c1a-08b24ddaa8db tempest-SnapshotsActionsTest-1133738055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.954a1b33-13a6-4337-b470-d30ab675527c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:36 devstack sudo[96564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.954a1b33-13a6-4337-b470-d30ab675527c Jul 28 10:42:36 devstack sudo[96564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:36 devstack sudo[96561]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:36 devstack sudo[96564]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9b0e0014-f755-4a7e-ac33-8817c31a232d tempest-AbsoluteLimitsTests-1233982055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-cb38feb9-9764-44dd-85d0-2f89bc8563e8" returned: 0 in 0.459s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9b0e0014-f755-4a7e-ac33-8817c31a232d tempest-AbsoluteLimitsTests-1233982055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-cb38feb9-9764-44dd-85d0-2f89bc8563e8 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9d13e730-d197-425c-9c1a-08b24ddaa8db tempest-SnapshotsActionsTest-1133738055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.954a1b33-13a6-4337-b470-d30ab675527c" returned: 0 in 0.279s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:36 devstack sudo[96594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-cb38feb9-9764-44dd-85d0-2f89bc8563e8 Jul 28 10:42:36 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:36 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9d13e730-d197-425c-9c1a-08b24ddaa8db tempest-SnapshotsActionsTest-1133738055 None] Lock "cinder-quobyte-954a1b33-13a6-4337-b470-d30ab675527c" released by "_delete_snapshot" :: held 1.822s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:42:36 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9d13e730-d197-425c-9c1a-08b24ddaa8db tempest-SnapshotsActionsTest-1133738055 None] Lock "cinder-quobyte-d85ab57f-3144-4fab-a8c2-8a3d241e347b" released by "delete_snapshot" :: held 1.858s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:42:36 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-9d13e730-d197-425c-9c1a-08b24ddaa8db tempest-SnapshotsActionsTest-1133738055 None] Created reservations ['769d9a60-9ba3-4cc1-aecd-1c28ddb24fdc', 'd399652e-a88a-43dc-9335-9ec667e2d7e5', 'f575dd96-6747-4712-98f4-24727c93b87f', '113c93b7-8b0f-45e2-823e-279bc793c73b'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:42:36 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-9d13e730-d197-425c-9c1a-08b24ddaa8db tempest-SnapshotsActionsTest-1133738055 None] Delete snapshot completed successfully. Jul 28 10:42:36 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9d13e730-d197-425c-9c1a-08b24ddaa8db tempest-SnapshotsActionsTest-1133738055 None] Lock "cinder-954a1b33-13a6-4337-b470-d30ab675527c-delete_snapshot" released by "delete_snapshot" :: held 2.113s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:42:36 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9b0e0014-f755-4a7e-ac33-8817c31a232d tempest-AbsoluteLimitsTests-1233982055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-cb38feb9-9764-44dd-85d0-2f89bc8563e8" returned: 0 in 0.351s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:36 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9b0e0014-f755-4a7e-ac33-8817c31a232d tempest-AbsoluteLimitsTests-1233982055 None] Lock "cinder-quobyte-cb38feb9-9764-44dd-85d0-2f89bc8563e8" released by "delete_volume" :: held 0.863s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:42:37 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-9b0e0014-f755-4a7e-ac33-8817c31a232d tempest-AbsoluteLimitsTests-1233982055 None] Created reservations ['7c698ee9-b0f9-4e15-b26a-3ac38f356b1f', 'bf726313-8663-4247-a09b-5449fe9c8c1f', 'e87824ac-a736-4c1b-a0a2-ff528ab977fc', 'a51638cb-c1ea-4bfd-8df2-bbff8c3a1c05'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:42:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9b0e0014-f755-4a7e-ac33-8817c31a232d tempest-AbsoluteLimitsTests-1233982055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:42:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9b0e0014-f755-4a7e-ac33-8817c31a232d tempest-AbsoluteLimitsTests-1233982055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:42:37 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9b0e0014-f755-4a7e-ac33-8817c31a232d tempest-AbsoluteLimitsTests-1233982055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:42:37 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9b0e0014-f755-4a7e-ac33-8817c31a232d tempest-AbsoluteLimitsTests-1233982055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:42:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9b0e0014-f755-4a7e-ac33-8817c31a232d tempest-AbsoluteLimitsTests-1233982055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:42:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9b0e0014-f755-4a7e-ac33-8817c31a232d tempest-AbsoluteLimitsTests-1233982055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:37 devstack sudo[96597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:42:37 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ded1dabb-7de2-444a-b649-ed16b49bc198 tempest-SnapshotsActionsTest-2037609075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:42:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ded1dabb-7de2-444a-b649-ed16b49bc198 tempest-SnapshotsActionsTest-2037609075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:42:37 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-ded1dabb-7de2-444a-b649-ed16b49bc198 tempest-SnapshotsActionsTest-2037609075 None] Creating offline snapshot 1d43fe3a-605c-4f85-8b36-ac79e6cf9f72 of volume d85ab57f-3144-4fab-a8c2-8a3d241e347b {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:42:37 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[16258623-587d-4e9f-931c-cedae10ce940]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:42:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ded1dabb-7de2-444a-b649-ed16b49bc198 tempest-SnapshotsActionsTest-2037609075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:37 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9b0e0014-f755-4a7e-ac33-8817c31a232d tempest-AbsoluteLimitsTests-1233982055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.483s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:37 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-9b0e0014-f755-4a7e-ac33-8817c31a232d tempest-AbsoluteLimitsTests-1233982055 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:42:37 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-9b0e0014-f755-4a7e-ac33-8817c31a232d tempest-AbsoluteLimitsTests-1233982055 None] Deleted volume successfully. Jul 28 10:42:37 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9b0e0014-f755-4a7e-ac33-8817c31a232d tempest-AbsoluteLimitsTests-1233982055 None] Lock "cinder-cb38feb9-9764-44dd-85d0-2f89bc8563e8-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:42:37 devstack sudo[96600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 Jul 28 10:42:37 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:38 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ded1dabb-7de2-444a-b649-ed16b49bc198 tempest-SnapshotsActionsTest-2037609075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1" returned: 0 in 0.484s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:38 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-ded1dabb-7de2-444a-b649-ed16b49bc198 tempest-SnapshotsActionsTest-2037609075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:42:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ded1dabb-7de2-444a-b649-ed16b49bc198 tempest-SnapshotsActionsTest-2037609075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.1d43fe3a-605c-4f85-8b36-ac79e6cf9f72 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:38 devstack sudo[96606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.1d43fe3a-605c-4f85-8b36-ac79e6cf9f72 1G Jul 28 10:42:38 devstack sudo[96606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:38 devstack sudo[96606]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ded1dabb-7de2-444a-b649-ed16b49bc198 tempest-SnapshotsActionsTest-2037609075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.1d43fe3a-605c-4f85-8b36-ac79e6cf9f72 1G" returned: 0 in 0.633s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ded1dabb-7de2-444a-b649-ed16b49bc198 tempest-SnapshotsActionsTest-2037609075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.1d43fe3a-605c-4f85-8b36-ac79e6cf9f72 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:38 devstack sudo[96612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.1d43fe3a-605c-4f85-8b36-ac79e6cf9f72 Jul 28 10:42:38 devstack sudo[96612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:39 devstack sudo[96612]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ded1dabb-7de2-444a-b649-ed16b49bc198 tempest-SnapshotsActionsTest-2037609075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.1d43fe3a-605c-4f85-8b36-ac79e6cf9f72" returned: 0 in 0.433s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:39 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-ded1dabb-7de2-444a-b649-ed16b49bc198 tempest-SnapshotsActionsTest-2037609075 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.1d43fe3a-605c-4f85-8b36-ac79e6cf9f72 is being set with open permissions: ugo+rw Jul 28 10:42:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ded1dabb-7de2-444a-b649-ed16b49bc198 tempest-SnapshotsActionsTest-2037609075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.1d43fe3a-605c-4f85-8b36-ac79e6cf9f72 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:39 devstack sudo[96617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.1d43fe3a-605c-4f85-8b36-ac79e6cf9f72 Jul 28 10:42:39 devstack sudo[96617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:39 devstack sudo[96617]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ded1dabb-7de2-444a-b649-ed16b49bc198 tempest-SnapshotsActionsTest-2037609075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.1d43fe3a-605c-4f85-8b36-ac79e6cf9f72" returned: 0 in 0.317s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ded1dabb-7de2-444a-b649-ed16b49bc198 tempest-SnapshotsActionsTest-2037609075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.046s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:42:39 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-ded1dabb-7de2-444a-b649-ed16b49bc198 tempest-SnapshotsActionsTest-2037609075 None] Create snapshot completed successfully Jul 28 10:42:40 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-c7dc0f66-3669-4e7a-a254-b5981095ac1c tempest-SnapshotsActionsTest-1133738055 None] Acquiring lock "cinder-1d43fe3a-605c-4f85-8b36-ac79e6cf9f72-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:42:40 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-c7dc0f66-3669-4e7a-a254-b5981095ac1c tempest-SnapshotsActionsTest-1133738055 None] Lock "cinder-1d43fe3a-605c-4f85-8b36-ac79e6cf9f72-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:42:40 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-c7dc0f66-3669-4e7a-a254-b5981095ac1c tempest-SnapshotsActionsTest-1133738055 None] Acquiring lock "cinder-quobyte-d85ab57f-3144-4fab-a8c2-8a3d241e347b" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:42:40 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-c7dc0f66-3669-4e7a-a254-b5981095ac1c tempest-SnapshotsActionsTest-1133738055 None] Lock "cinder-quobyte-d85ab57f-3144-4fab-a8c2-8a3d241e347b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:42:40 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-c7dc0f66-3669-4e7a-a254-b5981095ac1c tempest-SnapshotsActionsTest-1133738055 None] Acquiring lock "cinder-quobyte-1d43fe3a-605c-4f85-8b36-ac79e6cf9f72" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:42:40 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-c7dc0f66-3669-4e7a-a254-b5981095ac1c tempest-SnapshotsActionsTest-1133738055 None] Lock "cinder-quobyte-1d43fe3a-605c-4f85-8b36-ac79e6cf9f72" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:42:40 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-c7dc0f66-3669-4e7a-a254-b5981095ac1c tempest-SnapshotsActionsTest-1133738055 None] Deleting offline snapshot 1d43fe3a-605c-4f85-8b36-ac79e6cf9f72 of volume d85ab57f-3144-4fab-a8c2-8a3d241e347b {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:42:40 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-c7dc0f66-3669-4e7a-a254-b5981095ac1c tempest-SnapshotsActionsTest-1133738055 None] snapshot_file for this snap is: volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.1d43fe3a-605c-4f85-8b36-ac79e6cf9f72 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:42:40 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[a081f97e-a588-4378-a9a6-8baba3129355]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:42:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c7dc0f66-3669-4e7a-a254-b5981095ac1c tempest-SnapshotsActionsTest-1133738055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.1d43fe3a-605c-4f85-8b36-ac79e6cf9f72 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:41 devstack sudo[96621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.1d43fe3a-605c-4f85-8b36-ac79e6cf9f72 Jul 28 10:42:41 devstack sudo[96621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:41 devstack sudo[96621]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c7dc0f66-3669-4e7a-a254-b5981095ac1c tempest-SnapshotsActionsTest-1133738055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.1d43fe3a-605c-4f85-8b36-ac79e6cf9f72" returned: 0 in 0.472s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:41 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-c7dc0f66-3669-4e7a-a254-b5981095ac1c tempest-SnapshotsActionsTest-1133738055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:42:41 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[79274288-c9f9-4b00-a590-eb932941a8d6]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:42:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c7dc0f66-3669-4e7a-a254-b5981095ac1c tempest-SnapshotsActionsTest-1133738055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:41 devstack sudo[96626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 Jul 28 10:42:41 devstack sudo[96626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:42 devstack sudo[96626]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c7dc0f66-3669-4e7a-a254-b5981095ac1c tempest-SnapshotsActionsTest-1133738055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1" returned: 0 in 0.667s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:42 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-c7dc0f66-3669-4e7a-a254-b5981095ac1c tempest-SnapshotsActionsTest-1133738055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:42:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c7dc0f66-3669-4e7a-a254-b5981095ac1c tempest-SnapshotsActionsTest-1133738055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.1d43fe3a-605c-4f85-8b36-ac79e6cf9f72 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:42 devstack sudo[96631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.1d43fe3a-605c-4f85-8b36-ac79e6cf9f72 Jul 28 10:42:42 devstack sudo[96631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:42 devstack sudo[96631]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c7dc0f66-3669-4e7a-a254-b5981095ac1c tempest-SnapshotsActionsTest-1133738055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.1d43fe3a-605c-4f85-8b36-ac79e6cf9f72" returned: 0 in 0.568s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c7dc0f66-3669-4e7a-a254-b5981095ac1c tempest-SnapshotsActionsTest-1133738055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.1d43fe3a-605c-4f85-8b36-ac79e6cf9f72 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:42 devstack sudo[96636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.1d43fe3a-605c-4f85-8b36-ac79e6cf9f72 Jul 28 10:42:42 devstack sudo[96636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:43 devstack sudo[96636]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c7dc0f66-3669-4e7a-a254-b5981095ac1c tempest-SnapshotsActionsTest-1133738055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.1d43fe3a-605c-4f85-8b36-ac79e6cf9f72" returned: 0 in 0.534s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:43 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-c7dc0f66-3669-4e7a-a254-b5981095ac1c tempest-SnapshotsActionsTest-1133738055 None] Lock "cinder-quobyte-1d43fe3a-605c-4f85-8b36-ac79e6cf9f72" released by "_delete_snapshot" :: held 2.382s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:42:43 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-c7dc0f66-3669-4e7a-a254-b5981095ac1c tempest-SnapshotsActionsTest-1133738055 None] Lock "cinder-quobyte-d85ab57f-3144-4fab-a8c2-8a3d241e347b" released by "delete_snapshot" :: held 2.413s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:42:43 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-c7dc0f66-3669-4e7a-a254-b5981095ac1c tempest-SnapshotsActionsTest-1133738055 None] Created reservations ['e83511d2-9e4a-40d5-8fb8-a37c9026d480', '26820fab-f18e-43a7-87a8-cde17dfedf5f', '93472c99-c69e-4da3-81a7-5eb208aa5bee', '257851bf-7fbc-47d6-8c08-fe0b4a97cfef'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:42:43 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-c7dc0f66-3669-4e7a-a254-b5981095ac1c tempest-SnapshotsActionsTest-1133738055 None] Delete snapshot completed successfully. Jul 28 10:42:43 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-c7dc0f66-3669-4e7a-a254-b5981095ac1c tempest-SnapshotsActionsTest-1133738055 None] Lock "cinder-1d43fe3a-605c-4f85-8b36-ac79e6cf9f72-delete_snapshot" released by "delete_snapshot" :: held 2.643s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:42:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-199fdade-225d-4001-8a92-75ddde5a8c12 tempest-SnapshotsActionsTest-2037609075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:42:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-199fdade-225d-4001-8a92-75ddde5a8c12 tempest-SnapshotsActionsTest-2037609075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:42:44 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-199fdade-225d-4001-8a92-75ddde5a8c12 tempest-SnapshotsActionsTest-2037609075 None] Creating offline snapshot 31db8e45-b0d4-4d0c-b8c0-149cb4a2b0e4 of volume d85ab57f-3144-4fab-a8c2-8a3d241e347b {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:42:44 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3da52d-d41c-4926-8de8-16605c962357]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:42:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-199fdade-225d-4001-8a92-75ddde5a8c12 tempest-SnapshotsActionsTest-2037609075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:44 devstack sudo[96660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 Jul 28 10:42:44 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:45 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-199fdade-225d-4001-8a92-75ddde5a8c12 tempest-SnapshotsActionsTest-2037609075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1" returned: 0 in 0.487s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:45 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-199fdade-225d-4001-8a92-75ddde5a8c12 tempest-SnapshotsActionsTest-2037609075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:42:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-199fdade-225d-4001-8a92-75ddde5a8c12 tempest-SnapshotsActionsTest-2037609075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.31db8e45-b0d4-4d0c-b8c0-149cb4a2b0e4 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:45 devstack sudo[96666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.31db8e45-b0d4-4d0c-b8c0-149cb4a2b0e4 1G Jul 28 10:42:45 devstack sudo[96666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:45 devstack sudo[96666]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-199fdade-225d-4001-8a92-75ddde5a8c12 tempest-SnapshotsActionsTest-2037609075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.31db8e45-b0d4-4d0c-b8c0-149cb4a2b0e4 1G" returned: 0 in 0.578s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-199fdade-225d-4001-8a92-75ddde5a8c12 tempest-SnapshotsActionsTest-2037609075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.31db8e45-b0d4-4d0c-b8c0-149cb4a2b0e4 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:45 devstack sudo[96672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.31db8e45-b0d4-4d0c-b8c0-149cb4a2b0e4 Jul 28 10:42:45 devstack sudo[96672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:45 devstack sudo[96672]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-199fdade-225d-4001-8a92-75ddde5a8c12 tempest-SnapshotsActionsTest-2037609075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.31db8e45-b0d4-4d0c-b8c0-149cb4a2b0e4" returned: 0 in 0.348s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:45 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-199fdade-225d-4001-8a92-75ddde5a8c12 tempest-SnapshotsActionsTest-2037609075 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.31db8e45-b0d4-4d0c-b8c0-149cb4a2b0e4 is being set with open permissions: ugo+rw Jul 28 10:42:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-199fdade-225d-4001-8a92-75ddde5a8c12 tempest-SnapshotsActionsTest-2037609075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.31db8e45-b0d4-4d0c-b8c0-149cb4a2b0e4 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:46 devstack sudo[96677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.31db8e45-b0d4-4d0c-b8c0-149cb4a2b0e4 Jul 28 10:42:46 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:46 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-199fdade-225d-4001-8a92-75ddde5a8c12 tempest-SnapshotsActionsTest-2037609075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.31db8e45-b0d4-4d0c-b8c0-149cb4a2b0e4" returned: 0 in 0.308s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-199fdade-225d-4001-8a92-75ddde5a8c12 tempest-SnapshotsActionsTest-2037609075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.890s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:42:46 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-199fdade-225d-4001-8a92-75ddde5a8c12 tempest-SnapshotsActionsTest-2037609075 None] Create snapshot completed successfully Jul 28 10:42:46 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3ae09121-c36a-424e-9725-97dcda5e274e tempest-SnapshotsActionsTest-1133738055 None] Acquiring lock "cinder-31db8e45-b0d4-4d0c-b8c0-149cb4a2b0e4-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:42:46 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3ae09121-c36a-424e-9725-97dcda5e274e tempest-SnapshotsActionsTest-1133738055 None] Lock "cinder-31db8e45-b0d4-4d0c-b8c0-149cb4a2b0e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:42:46 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3ae09121-c36a-424e-9725-97dcda5e274e tempest-SnapshotsActionsTest-1133738055 None] Acquiring lock "cinder-quobyte-d85ab57f-3144-4fab-a8c2-8a3d241e347b" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:42:46 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3ae09121-c36a-424e-9725-97dcda5e274e tempest-SnapshotsActionsTest-1133738055 None] Lock "cinder-quobyte-d85ab57f-3144-4fab-a8c2-8a3d241e347b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:42:46 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3ae09121-c36a-424e-9725-97dcda5e274e tempest-SnapshotsActionsTest-1133738055 None] Acquiring lock "cinder-quobyte-31db8e45-b0d4-4d0c-b8c0-149cb4a2b0e4" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:42:46 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3ae09121-c36a-424e-9725-97dcda5e274e tempest-SnapshotsActionsTest-1133738055 None] Lock "cinder-quobyte-31db8e45-b0d4-4d0c-b8c0-149cb4a2b0e4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:42:46 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-3ae09121-c36a-424e-9725-97dcda5e274e tempest-SnapshotsActionsTest-1133738055 None] Deleting offline snapshot 31db8e45-b0d4-4d0c-b8c0-149cb4a2b0e4 of volume d85ab57f-3144-4fab-a8c2-8a3d241e347b {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:42:46 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-3ae09121-c36a-424e-9725-97dcda5e274e tempest-SnapshotsActionsTest-1133738055 None] snapshot_file for this snap is: volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.31db8e45-b0d4-4d0c-b8c0-149cb4a2b0e4 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:42:46 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be2e8b0-99d1-4045-8ad7-47b8ca0835e6]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:42:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3ae09121-c36a-424e-9725-97dcda5e274e tempest-SnapshotsActionsTest-1133738055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.31db8e45-b0d4-4d0c-b8c0-149cb4a2b0e4 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:46 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.31db8e45-b0d4-4d0c-b8c0-149cb4a2b0e4 Jul 28 10:42:46 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:47 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3ae09121-c36a-424e-9725-97dcda5e274e tempest-SnapshotsActionsTest-1133738055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.31db8e45-b0d4-4d0c-b8c0-149cb4a2b0e4" returned: 0 in 0.409s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:47 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-3ae09121-c36a-424e-9725-97dcda5e274e tempest-SnapshotsActionsTest-1133738055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:42:47 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd46b70-da2b-4f1c-9ba9-8b893da1709b]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:42:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3ae09121-c36a-424e-9725-97dcda5e274e tempest-SnapshotsActionsTest-1133738055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:47 devstack sudo[96686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 Jul 28 10:42:47 devstack sudo[96686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:47 devstack sudo[96686]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3ae09121-c36a-424e-9725-97dcda5e274e tempest-SnapshotsActionsTest-1133738055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1" returned: 0 in 0.555s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:47 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-3ae09121-c36a-424e-9725-97dcda5e274e tempest-SnapshotsActionsTest-1133738055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:42:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3ae09121-c36a-424e-9725-97dcda5e274e tempest-SnapshotsActionsTest-1133738055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.31db8e45-b0d4-4d0c-b8c0-149cb4a2b0e4 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:47 devstack sudo[96691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.31db8e45-b0d4-4d0c-b8c0-149cb4a2b0e4 Jul 28 10:42:47 devstack sudo[96691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:48 devstack sudo[96691]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3ae09121-c36a-424e-9725-97dcda5e274e tempest-SnapshotsActionsTest-1133738055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.31db8e45-b0d4-4d0c-b8c0-149cb4a2b0e4" returned: 0 in 0.485s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3ae09121-c36a-424e-9725-97dcda5e274e tempest-SnapshotsActionsTest-1133738055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.31db8e45-b0d4-4d0c-b8c0-149cb4a2b0e4 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:48 devstack sudo[96697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.31db8e45-b0d4-4d0c-b8c0-149cb4a2b0e4 Jul 28 10:42:48 devstack sudo[96697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:48 devstack sudo[96697]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3ae09121-c36a-424e-9725-97dcda5e274e tempest-SnapshotsActionsTest-1133738055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.31db8e45-b0d4-4d0c-b8c0-149cb4a2b0e4" returned: 0 in 0.341s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3ae09121-c36a-424e-9725-97dcda5e274e tempest-SnapshotsActionsTest-1133738055 None] Lock "cinder-quobyte-31db8e45-b0d4-4d0c-b8c0-149cb4a2b0e4" released by "_delete_snapshot" :: held 1.977s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:42:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3ae09121-c36a-424e-9725-97dcda5e274e tempest-SnapshotsActionsTest-1133738055 None] Lock "cinder-quobyte-d85ab57f-3144-4fab-a8c2-8a3d241e347b" released by "delete_snapshot" :: held 2.021s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:42:48 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d66cc8f-c8f8-45f3-b33b-7a4a2d970e5c tempest-VolumesListAdminTestJSON-329818275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:42:48 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0d66cc8f-c8f8-45f3-b33b-7a4a2d970e5c tempest-VolumesListAdminTestJSON-329818275 None] Flow 'volume_create_manager' (3c40e1ea-d7a7-4499-bb29-af54154ef35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:42:48 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0d66cc8f-c8f8-45f3-b33b-7a4a2d970e5c tempest-VolumesListAdminTestJSON-329818275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b339131-07b1-4ca7-bf48-7253ef16b284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:48 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0d66cc8f-c8f8-45f3-b33b-7a4a2d970e5c tempest-VolumesListAdminTestJSON-329818275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b339131-07b1-4ca7-bf48-7253ef16b284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-508115135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3905edf-dbea-467d-a783-b5f67d25c2e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='900929b56f10415d94e2fc0199f55331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:42:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:42:49Z,use_quota=True,user_id='b123c0a0d67241ab9d3b66cb0fe037ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:48 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0d66cc8f-c8f8-45f3-b33b-7a4a2d970e5c tempest-VolumesListAdminTestJSON-329818275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac1afda0-350d-4721-ad58-e0b119d42156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:48 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0d66cc8f-c8f8-45f3-b33b-7a4a2d970e5c tempest-VolumesListAdminTestJSON-329818275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac1afda0-350d-4721-ad58-e0b119d42156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:48 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0d66cc8f-c8f8-45f3-b33b-7a4a2d970e5c tempest-VolumesListAdminTestJSON-329818275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dcb72cf-59e1-41f1-9060-5f7dbf5ae2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:48 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0d66cc8f-c8f8-45f3-b33b-7a4a2d970e5c tempest-VolumesListAdminTestJSON-329818275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dcb72cf-59e1-41f1-9060-5f7dbf5ae2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3905edf-dbea-467d-a783-b5f67d25c2e9', 'volume_name': 'volume-b3905edf-dbea-467d-a783-b5f67d25c2e9', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:48 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0d66cc8f-c8f8-45f3-b33b-7a4a2d970e5c tempest-VolumesListAdminTestJSON-329818275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (459bc91e-32e2-48bb-b37b-273bb21b1990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:48 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0d66cc8f-c8f8-45f3-b33b-7a4a2d970e5c tempest-VolumesListAdminTestJSON-329818275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (459bc91e-32e2-48bb-b37b-273bb21b1990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:48 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0d66cc8f-c8f8-45f3-b33b-7a4a2d970e5c tempest-VolumesListAdminTestJSON-329818275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7b91331-0d74-4e72-b86f-cb7cb28987ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:48 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-0d66cc8f-c8f8-45f3-b33b-7a4a2d970e5c tempest-VolumesListAdminTestJSON-329818275 None] Volume b3905edf-dbea-467d-a783-b5f67d25c2e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3905edf-dbea-467d-a783-b5f67d25c2e9', 'volume_size': 1} Jul 28 10:42:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0d66cc8f-c8f8-45f3-b33b-7a4a2d970e5c tempest-VolumesListAdminTestJSON-329818275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:42:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0d66cc8f-c8f8-45f3-b33b-7a4a2d970e5c tempest-VolumesListAdminTestJSON-329818275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:42:48 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0d66cc8f-c8f8-45f3-b33b-7a4a2d970e5c tempest-VolumesListAdminTestJSON-329818275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-508115135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3905edf-dbea-467d-a783-b5f67d25c2e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='900929b56f10415d94e2fc0199f55331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:42:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:42:49Z,use_quota=True,user_id='b123c0a0d67241ab9d3b66cb0fe037ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:42:48 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-0d66cc8f-c8f8-45f3-b33b-7a4a2d970e5c tempest-VolumesListAdminTestJSON-329818275 None] Creating volume b3905edf-dbea-467d-a783-b5f67d25c2e9 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:42:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0d66cc8f-c8f8-45f3-b33b-7a4a2d970e5c tempest-VolumesListAdminTestJSON-329818275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:42:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0d66cc8f-c8f8-45f3-b33b-7a4a2d970e5c tempest-VolumesListAdminTestJSON-329818275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:42:48 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0d66cc8f-c8f8-45f3-b33b-7a4a2d970e5c tempest-VolumesListAdminTestJSON-329818275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:42:48 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0d66cc8f-c8f8-45f3-b33b-7a4a2d970e5c tempest-VolumesListAdminTestJSON-329818275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:42:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0d66cc8f-c8f8-45f3-b33b-7a4a2d970e5c tempest-VolumesListAdminTestJSON-329818275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:42:48 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0d66cc8f-c8f8-45f3-b33b-7a4a2d970e5c tempest-VolumesListAdminTestJSON-329818275 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:42:48 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-0d66cc8f-c8f8-45f3-b33b-7a4a2d970e5c tempest-VolumesListAdminTestJSON-329818275 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:42:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0d66cc8f-c8f8-45f3-b33b-7a4a2d970e5c tempest-VolumesListAdminTestJSON-329818275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b3905edf-dbea-467d-a783-b5f67d25c2e9 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:48 devstack sudo[96700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b3905edf-dbea-467d-a783-b5f67d25c2e9 1073741824 Jul 28 10:42:48 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:48 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-3ae09121-c36a-424e-9725-97dcda5e274e tempest-SnapshotsActionsTest-1133738055 None] Created reservations ['a87bfe01-0912-4487-b104-1d2fb2c6e9f5', '8f788601-1071-4bac-86cf-56a10f8b2c0a', '017b0461-6d6f-4064-be32-86c0e83f3383', 'd2e5d538-332b-43aa-865e-cd58cf4790fb'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:42:49 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-3ae09121-c36a-424e-9725-97dcda5e274e tempest-SnapshotsActionsTest-1133738055 None] Delete snapshot completed successfully. Jul 28 10:42:49 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3ae09121-c36a-424e-9725-97dcda5e274e tempest-SnapshotsActionsTest-1133738055 None] Lock "cinder-31db8e45-b0d4-4d0c-b8c0-149cb4a2b0e4-delete_snapshot" released by "delete_snapshot" :: held 2.370s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:42:49 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0d66cc8f-c8f8-45f3-b33b-7a4a2d970e5c tempest-VolumesListAdminTestJSON-329818275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b3905edf-dbea-467d-a783-b5f67d25c2e9 1073741824" returned: 0 in 0.602s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0d66cc8f-c8f8-45f3-b33b-7a4a2d970e5c tempest-VolumesListAdminTestJSON-329818275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b3905edf-dbea-467d-a783-b5f67d25c2e9 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:49 devstack sudo[96707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b3905edf-dbea-467d-a783-b5f67d25c2e9 Jul 28 10:42:49 devstack sudo[96707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:49 devstack sudo[96707]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0d66cc8f-c8f8-45f3-b33b-7a4a2d970e5c tempest-VolumesListAdminTestJSON-329818275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b3905edf-dbea-467d-a783-b5f67d25c2e9" returned: 0 in 0.295s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:49 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0d66cc8f-c8f8-45f3-b33b-7a4a2d970e5c tempest-VolumesListAdminTestJSON-329818275 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:42:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0d66cc8f-c8f8-45f3-b33b-7a4a2d970e5c tempest-VolumesListAdminTestJSON-329818275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:42:49 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0d66cc8f-c8f8-45f3-b33b-7a4a2d970e5c tempest-VolumesListAdminTestJSON-329818275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7b91331-0d74-4e72-b86f-cb7cb28987ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3905edf-dbea-467d-a783-b5f67d25c2e9', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:49 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0d66cc8f-c8f8-45f3-b33b-7a4a2d970e5c tempest-VolumesListAdminTestJSON-329818275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e548025a-3726-40af-b9e7-9326adfb7505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:49 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-0d66cc8f-c8f8-45f3-b33b-7a4a2d970e5c tempest-VolumesListAdminTestJSON-329818275 None] Volume volume-b3905edf-dbea-467d-a783-b5f67d25c2e9 (b3905edf-dbea-467d-a783-b5f67d25c2e9): created successfully Jul 28 10:42:49 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0d66cc8f-c8f8-45f3-b33b-7a4a2d970e5c tempest-VolumesListAdminTestJSON-329818275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e548025a-3726-40af-b9e7-9326adfb7505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:49 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0d66cc8f-c8f8-45f3-b33b-7a4a2d970e5c tempest-VolumesListAdminTestJSON-329818275 None] Flow 'volume_create_manager' (3c40e1ea-d7a7-4499-bb29-af54154ef35e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:42:49 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-0d66cc8f-c8f8-45f3-b33b-7a4a2d970e5c tempest-VolumesListAdminTestJSON-329818275 None] Created volume successfully. Jul 28 10:42:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3a7b16c8-789e-4eeb-86ed-891b37f81381 tempest-SnapshotsActionsTest-2037609075 None] Acquiring lock "cinder-bf58dd49-9fd9-4b2b-825b-f06e3875aff1-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:42:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3a7b16c8-789e-4eeb-86ed-891b37f81381 tempest-SnapshotsActionsTest-2037609075 None] Lock "cinder-bf58dd49-9fd9-4b2b-825b-f06e3875aff1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:42:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3a7b16c8-789e-4eeb-86ed-891b37f81381 tempest-SnapshotsActionsTest-2037609075 None] Acquiring lock "cinder-quobyte-d85ab57f-3144-4fab-a8c2-8a3d241e347b" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:42:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3a7b16c8-789e-4eeb-86ed-891b37f81381 tempest-SnapshotsActionsTest-2037609075 None] Lock "cinder-quobyte-d85ab57f-3144-4fab-a8c2-8a3d241e347b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:42:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3a7b16c8-789e-4eeb-86ed-891b37f81381 tempest-SnapshotsActionsTest-2037609075 None] Acquiring lock "cinder-quobyte-bf58dd49-9fd9-4b2b-825b-f06e3875aff1" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:42:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3a7b16c8-789e-4eeb-86ed-891b37f81381 tempest-SnapshotsActionsTest-2037609075 None] Lock "cinder-quobyte-bf58dd49-9fd9-4b2b-825b-f06e3875aff1" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:42:50 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-3a7b16c8-789e-4eeb-86ed-891b37f81381 tempest-SnapshotsActionsTest-2037609075 None] Deleting offline snapshot bf58dd49-9fd9-4b2b-825b-f06e3875aff1 of volume d85ab57f-3144-4fab-a8c2-8a3d241e347b {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:42:50 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-3a7b16c8-789e-4eeb-86ed-891b37f81381 tempest-SnapshotsActionsTest-2037609075 None] snapshot_file for this snap is: volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:42:50 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[94adca3b-36b8-4b45-967b-c53bc62b8cd3]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:42:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3a7b16c8-789e-4eeb-86ed-891b37f81381 tempest-SnapshotsActionsTest-2037609075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:50 devstack sudo[96710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 Jul 28 10:42:50 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:51 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3a7b16c8-789e-4eeb-86ed-891b37f81381 tempest-SnapshotsActionsTest-2037609075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1" returned: 0 in 0.576s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:51 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-3a7b16c8-789e-4eeb-86ed-891b37f81381 tempest-SnapshotsActionsTest-2037609075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:42:51 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[40664fb8-862f-4874-9958-ad03c9551f10]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:42:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3a7b16c8-789e-4eeb-86ed-891b37f81381 tempest-SnapshotsActionsTest-2037609075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:51 devstack sudo[96715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b Jul 28 10:42:51 devstack sudo[96715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:51 devstack sudo[96715]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3a7b16c8-789e-4eeb-86ed-891b37f81381 tempest-SnapshotsActionsTest-2037609075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b" returned: 0 in 0.485s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3a7b16c8-789e-4eeb-86ed-891b37f81381 tempest-SnapshotsActionsTest-2037609075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:51 devstack sudo[96720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 Jul 28 10:42:51 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:51 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-348817d8-2996-41ff-ab4d-a66d324798a2 tempest-VolumesListAdminTestJSON-329818275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:42:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-348817d8-2996-41ff-ab4d-a66d324798a2 tempest-VolumesListAdminTestJSON-329818275 None] Flow 'volume_create_manager' (da862de4-a617-4831-94c3-f8c176d5a6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:42:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-348817d8-2996-41ff-ab4d-a66d324798a2 tempest-VolumesListAdminTestJSON-329818275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f1fec03-53b8-4b01-b65f-3fa7c631aba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-348817d8-2996-41ff-ab4d-a66d324798a2 tempest-VolumesListAdminTestJSON-329818275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f1fec03-53b8-4b01-b65f-3fa7c631aba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-615269947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a13e602-d4a0-44d7-9a8d-76ca418097d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='900929b56f10415d94e2fc0199f55331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:42:52Z,use_quota=True,user_id='b123c0a0d67241ab9d3b66cb0fe037ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-348817d8-2996-41ff-ab4d-a66d324798a2 tempest-VolumesListAdminTestJSON-329818275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0161f04b-9c31-4e9c-916f-dad9abbbc186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-348817d8-2996-41ff-ab4d-a66d324798a2 tempest-VolumesListAdminTestJSON-329818275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0161f04b-9c31-4e9c-916f-dad9abbbc186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-348817d8-2996-41ff-ab4d-a66d324798a2 tempest-VolumesListAdminTestJSON-329818275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d479db2-4801-4641-8ef1-67377b36b840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-348817d8-2996-41ff-ab4d-a66d324798a2 tempest-VolumesListAdminTestJSON-329818275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d479db2-4801-4641-8ef1-67377b36b840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a13e602-d4a0-44d7-9a8d-76ca418097d5', 'volume_name': 'volume-6a13e602-d4a0-44d7-9a8d-76ca418097d5', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-348817d8-2996-41ff-ab4d-a66d324798a2 tempest-VolumesListAdminTestJSON-329818275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (865318cf-3a7d-4bf3-9dd7-5005c286e066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-348817d8-2996-41ff-ab4d-a66d324798a2 tempest-VolumesListAdminTestJSON-329818275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (865318cf-3a7d-4bf3-9dd7-5005c286e066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-348817d8-2996-41ff-ab4d-a66d324798a2 tempest-VolumesListAdminTestJSON-329818275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a38aeacb-d01e-443e-a9d9-da599cc07b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:51 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-348817d8-2996-41ff-ab4d-a66d324798a2 tempest-VolumesListAdminTestJSON-329818275 None] Volume 6a13e602-d4a0-44d7-9a8d-76ca418097d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a13e602-d4a0-44d7-9a8d-76ca418097d5', 'volume_size': 1} Jul 28 10:42:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-348817d8-2996-41ff-ab4d-a66d324798a2 tempest-VolumesListAdminTestJSON-329818275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:42:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-348817d8-2996-41ff-ab4d-a66d324798a2 tempest-VolumesListAdminTestJSON-329818275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:42:51 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-348817d8-2996-41ff-ab4d-a66d324798a2 tempest-VolumesListAdminTestJSON-329818275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-615269947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a13e602-d4a0-44d7-9a8d-76ca418097d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='900929b56f10415d94e2fc0199f55331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:42:52Z,use_quota=True,user_id='b123c0a0d67241ab9d3b66cb0fe037ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:42:51 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-348817d8-2996-41ff-ab4d-a66d324798a2 tempest-VolumesListAdminTestJSON-329818275 None] Creating volume 6a13e602-d4a0-44d7-9a8d-76ca418097d5 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:42:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-348817d8-2996-41ff-ab4d-a66d324798a2 tempest-VolumesListAdminTestJSON-329818275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:42:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-348817d8-2996-41ff-ab4d-a66d324798a2 tempest-VolumesListAdminTestJSON-329818275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:42:51 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-348817d8-2996-41ff-ab4d-a66d324798a2 tempest-VolumesListAdminTestJSON-329818275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:42:51 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-348817d8-2996-41ff-ab4d-a66d324798a2 tempest-VolumesListAdminTestJSON-329818275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:42:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-348817d8-2996-41ff-ab4d-a66d324798a2 tempest-VolumesListAdminTestJSON-329818275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:42:51 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-348817d8-2996-41ff-ab4d-a66d324798a2 tempest-VolumesListAdminTestJSON-329818275 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:42:51 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-348817d8-2996-41ff-ab4d-a66d324798a2 tempest-VolumesListAdminTestJSON-329818275 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:42:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-348817d8-2996-41ff-ab4d-a66d324798a2 tempest-VolumesListAdminTestJSON-329818275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6a13e602-d4a0-44d7-9a8d-76ca418097d5 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:51 devstack sudo[96722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6a13e602-d4a0-44d7-9a8d-76ca418097d5 1073741824 Jul 28 10:42:51 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:52 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3a7b16c8-789e-4eeb-86ed-891b37f81381 tempest-SnapshotsActionsTest-2037609075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1" returned: 0 in 0.456s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3a7b16c8-789e-4eeb-86ed-891b37f81381 tempest-SnapshotsActionsTest-2037609075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:52 devstack sudo[96729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1 Jul 28 10:42:52 devstack sudo[96729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:52 devstack sudo[96729]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3a7b16c8-789e-4eeb-86ed-891b37f81381 tempest-SnapshotsActionsTest-2037609075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b.bf58dd49-9fd9-4b2b-825b-f06e3875aff1" returned: 0 in 0.510s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:52 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-348817d8-2996-41ff-ab4d-a66d324798a2 tempest-VolumesListAdminTestJSON-329818275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6a13e602-d4a0-44d7-9a8d-76ca418097d5 1073741824" returned: 0 in 0.800s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:52 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3a7b16c8-789e-4eeb-86ed-891b37f81381 tempest-SnapshotsActionsTest-2037609075 None] Lock "cinder-quobyte-bf58dd49-9fd9-4b2b-825b-f06e3875aff1" released by "_delete_snapshot" :: held 2.221s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:42:52 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3a7b16c8-789e-4eeb-86ed-891b37f81381 tempest-SnapshotsActionsTest-2037609075 None] Lock "cinder-quobyte-d85ab57f-3144-4fab-a8c2-8a3d241e347b" released by "delete_snapshot" :: held 2.250s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:42:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-348817d8-2996-41ff-ab4d-a66d324798a2 tempest-VolumesListAdminTestJSON-329818275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6a13e602-d4a0-44d7-9a8d-76ca418097d5 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:52 devstack sudo[96735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6a13e602-d4a0-44d7-9a8d-76ca418097d5 Jul 28 10:42:52 devstack sudo[96735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:52 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-3a7b16c8-789e-4eeb-86ed-891b37f81381 tempest-SnapshotsActionsTest-2037609075 None] Created reservations ['daf0489f-d7f8-4a56-a3e0-430b73800591', '8d635deb-ede5-4d24-9b76-217be82dae34', '826b5994-b4a3-4e0d-8ea5-89859ab0fbb8', 'ed15050e-fae2-40c7-b2f5-0a79d8459cf1'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:42:52 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-3a7b16c8-789e-4eeb-86ed-891b37f81381 tempest-SnapshotsActionsTest-2037609075 None] Delete snapshot completed successfully. Jul 28 10:42:52 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3a7b16c8-789e-4eeb-86ed-891b37f81381 tempest-SnapshotsActionsTest-2037609075 None] Lock "cinder-bf58dd49-9fd9-4b2b-825b-f06e3875aff1-delete_snapshot" released by "delete_snapshot" :: held 2.439s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:42:53 devstack sudo[96735]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-348817d8-2996-41ff-ab4d-a66d324798a2 tempest-VolumesListAdminTestJSON-329818275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6a13e602-d4a0-44d7-9a8d-76ca418097d5" returned: 0 in 0.275s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:53 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-348817d8-2996-41ff-ab4d-a66d324798a2 tempest-VolumesListAdminTestJSON-329818275 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:42:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-348817d8-2996-41ff-ab4d-a66d324798a2 tempest-VolumesListAdminTestJSON-329818275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:42:53 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-348817d8-2996-41ff-ab4d-a66d324798a2 tempest-VolumesListAdminTestJSON-329818275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a38aeacb-d01e-443e-a9d9-da599cc07b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a13e602-d4a0-44d7-9a8d-76ca418097d5', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:53 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-348817d8-2996-41ff-ab4d-a66d324798a2 tempest-VolumesListAdminTestJSON-329818275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aad66518-6b50-490a-9e1d-f434eeb66ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:53 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-348817d8-2996-41ff-ab4d-a66d324798a2 tempest-VolumesListAdminTestJSON-329818275 None] Volume volume-6a13e602-d4a0-44d7-9a8d-76ca418097d5 (6a13e602-d4a0-44d7-9a8d-76ca418097d5): created successfully Jul 28 10:42:53 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-348817d8-2996-41ff-ab4d-a66d324798a2 tempest-VolumesListAdminTestJSON-329818275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aad66518-6b50-490a-9e1d-f434eeb66ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:53 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-348817d8-2996-41ff-ab4d-a66d324798a2 tempest-VolumesListAdminTestJSON-329818275 None] Flow 'volume_create_manager' (da862de4-a617-4831-94c3-f8c176d5a6de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:42:53 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-348817d8-2996-41ff-ab4d-a66d324798a2 tempest-VolumesListAdminTestJSON-329818275 None] Created volume successfully. Jul 28 10:42:53 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7e8388a-794d-4f2b-ac78-7cdd2cdcdacf tempest-VolumesActionsTest-1170390702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:42:53 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f7e8388a-794d-4f2b-ac78-7cdd2cdcdacf tempest-VolumesActionsTest-1170390702 None] Flow 'volume_create_manager' (584fbc91-6868-4dc7-b4c2-35b1fdeb43bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:42:53 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f7e8388a-794d-4f2b-ac78-7cdd2cdcdacf tempest-VolumesActionsTest-1170390702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (606e3806-76d4-41e3-b8d0-6e1c40b57065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:53 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f7e8388a-794d-4f2b-ac78-7cdd2cdcdacf tempest-VolumesActionsTest-1170390702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (606e3806-76d4-41e3-b8d0-6e1c40b57065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1128508944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fb0f975-0837-4556-b6b8-a887b89fe198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fdff3db007c4084b5678794aa198e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:42:53Z,use_quota=True,user_id='bd9fe607ab9e4bdaa35c41ce5e6d231d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:53 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f7e8388a-794d-4f2b-ac78-7cdd2cdcdacf tempest-VolumesActionsTest-1170390702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bdbe5b0-d6d4-4f2f-8b99-6a51af7b56f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:53 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f7e8388a-794d-4f2b-ac78-7cdd2cdcdacf tempest-VolumesActionsTest-1170390702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bdbe5b0-d6d4-4f2f-8b99-6a51af7b56f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:53 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f7e8388a-794d-4f2b-ac78-7cdd2cdcdacf tempest-VolumesActionsTest-1170390702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83ff12f2-2fa9-4278-88a5-1a727dcfc95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:53 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f7e8388a-794d-4f2b-ac78-7cdd2cdcdacf tempest-VolumesActionsTest-1170390702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83ff12f2-2fa9-4278-88a5-1a727dcfc95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fb0f975-0837-4556-b6b8-a887b89fe198', 'volume_name': 'volume-3fb0f975-0837-4556-b6b8-a887b89fe198', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:53 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f7e8388a-794d-4f2b-ac78-7cdd2cdcdacf tempest-VolumesActionsTest-1170390702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8be219fa-b321-488b-8463-73044c425bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:53 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f7e8388a-794d-4f2b-ac78-7cdd2cdcdacf tempest-VolumesActionsTest-1170390702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8be219fa-b321-488b-8463-73044c425bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:53 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f7e8388a-794d-4f2b-ac78-7cdd2cdcdacf tempest-VolumesActionsTest-1170390702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfae5ee2-efdc-44b9-8e58-27cf8bd482cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:53 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-f7e8388a-794d-4f2b-ac78-7cdd2cdcdacf tempest-VolumesActionsTest-1170390702 None] Volume 3fb0f975-0837-4556-b6b8-a887b89fe198: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fb0f975-0837-4556-b6b8-a887b89fe198', 'volume_size': 1} Jul 28 10:42:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f7e8388a-794d-4f2b-ac78-7cdd2cdcdacf tempest-VolumesActionsTest-1170390702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:42:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f7e8388a-794d-4f2b-ac78-7cdd2cdcdacf tempest-VolumesActionsTest-1170390702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:42:53 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f7e8388a-794d-4f2b-ac78-7cdd2cdcdacf tempest-VolumesActionsTest-1170390702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1128508944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fb0f975-0837-4556-b6b8-a887b89fe198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fdff3db007c4084b5678794aa198e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:42:53Z,use_quota=True,user_id='bd9fe607ab9e4bdaa35c41ce5e6d231d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:42:53 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-f7e8388a-794d-4f2b-ac78-7cdd2cdcdacf tempest-VolumesActionsTest-1170390702 None] Creating volume 3fb0f975-0837-4556-b6b8-a887b89fe198 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:42:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f7e8388a-794d-4f2b-ac78-7cdd2cdcdacf tempest-VolumesActionsTest-1170390702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:42:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f7e8388a-794d-4f2b-ac78-7cdd2cdcdacf tempest-VolumesActionsTest-1170390702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:42:53 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f7e8388a-794d-4f2b-ac78-7cdd2cdcdacf tempest-VolumesActionsTest-1170390702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:42:53 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f7e8388a-794d-4f2b-ac78-7cdd2cdcdacf tempest-VolumesActionsTest-1170390702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:42:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f7e8388a-794d-4f2b-ac78-7cdd2cdcdacf tempest-VolumesActionsTest-1170390702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:42:53 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f7e8388a-794d-4f2b-ac78-7cdd2cdcdacf tempest-VolumesActionsTest-1170390702 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:42:53 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-f7e8388a-794d-4f2b-ac78-7cdd2cdcdacf tempest-VolumesActionsTest-1170390702 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:42:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f7e8388a-794d-4f2b-ac78-7cdd2cdcdacf tempest-VolumesActionsTest-1170390702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3fb0f975-0837-4556-b6b8-a887b89fe198 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:53 devstack sudo[96738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3fb0f975-0837-4556-b6b8-a887b89fe198 1073741824 Jul 28 10:42:53 devstack sudo[96738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:53 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-33e5f422-750a-4ac5-86a4-6db8d4b098e4 tempest-SnapshotsActionsTest-2037609075 None] Acquiring lock "cinder-d85ab57f-3144-4fab-a8c2-8a3d241e347b-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:42:53 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-33e5f422-750a-4ac5-86a4-6db8d4b098e4 tempest-SnapshotsActionsTest-2037609075 None] Lock "cinder-d85ab57f-3144-4fab-a8c2-8a3d241e347b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:42:53 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-33e5f422-750a-4ac5-86a4-6db8d4b098e4 tempest-SnapshotsActionsTest-2037609075 None] Acquiring lock "cinder-quobyte-d85ab57f-3144-4fab-a8c2-8a3d241e347b" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:42:53 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-33e5f422-750a-4ac5-86a4-6db8d4b098e4 tempest-SnapshotsActionsTest-2037609075 None] Lock "cinder-quobyte-d85ab57f-3144-4fab-a8c2-8a3d241e347b" acquired by "delete_volume" :: waited 0.017s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:42:53 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ea9b61-d1c0-40fe-aadd-e42b9e7fd803]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:42:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-33e5f422-750a-4ac5-86a4-6db8d4b098e4 tempest-SnapshotsActionsTest-2037609075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:54 devstack sudo[96738]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f7e8388a-794d-4f2b-ac78-7cdd2cdcdacf tempest-VolumesActionsTest-1170390702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3fb0f975-0837-4556-b6b8-a887b89fe198 1073741824" returned: 0 in 0.502s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:54 devstack sudo[96744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b Jul 28 10:42:54 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f7e8388a-794d-4f2b-ac78-7cdd2cdcdacf tempest-VolumesActionsTest-1170390702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3fb0f975-0837-4556-b6b8-a887b89fe198 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:54 devstack sudo[96746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3fb0f975-0837-4556-b6b8-a887b89fe198 Jul 28 10:42:54 devstack sudo[96746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bb78ff7-e5c2-481a-bda5-107f2ba899d6 tempest-VolumesListAdminTestJSON-329818275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0bb78ff7-e5c2-481a-bda5-107f2ba899d6 tempest-VolumesListAdminTestJSON-329818275 None] Flow 'volume_create_manager' (8db74cbb-dd4d-4805-a06a-18d797c81c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0bb78ff7-e5c2-481a-bda5-107f2ba899d6 tempest-VolumesListAdminTestJSON-329818275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d7ba177-3e74-47e9-a444-2f13d5406df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:54 devstack sudo[96746]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:54 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0bb78ff7-e5c2-481a-bda5-107f2ba899d6 tempest-VolumesListAdminTestJSON-329818275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d7ba177-3e74-47e9-a444-2f13d5406df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-93493653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=456a7512-5177-4499-92c8-8cbae543d628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='900929b56f10415d94e2fc0199f55331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:42:54Z,use_quota=True,user_id='b123c0a0d67241ab9d3b66cb0fe037ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0bb78ff7-e5c2-481a-bda5-107f2ba899d6 tempest-VolumesListAdminTestJSON-329818275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd785584-43c7-45a3-976c-f99f4068f9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0bb78ff7-e5c2-481a-bda5-107f2ba899d6 tempest-VolumesListAdminTestJSON-329818275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd785584-43c7-45a3-976c-f99f4068f9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0bb78ff7-e5c2-481a-bda5-107f2ba899d6 tempest-VolumesListAdminTestJSON-329818275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c2567ef-1e35-48e5-8a04-591872a5b689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0bb78ff7-e5c2-481a-bda5-107f2ba899d6 tempest-VolumesListAdminTestJSON-329818275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c2567ef-1e35-48e5-8a04-591872a5b689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '456a7512-5177-4499-92c8-8cbae543d628', 'volume_name': 'volume-456a7512-5177-4499-92c8-8cbae543d628', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0bb78ff7-e5c2-481a-bda5-107f2ba899d6 tempest-VolumesListAdminTestJSON-329818275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f91d6c8b-2875-4801-89e3-efc64902e8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0bb78ff7-e5c2-481a-bda5-107f2ba899d6 tempest-VolumesListAdminTestJSON-329818275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f91d6c8b-2875-4801-89e3-efc64902e8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0bb78ff7-e5c2-481a-bda5-107f2ba899d6 tempest-VolumesListAdminTestJSON-329818275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (827360f6-401a-4884-b107-e477218c6150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:54 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-0bb78ff7-e5c2-481a-bda5-107f2ba899d6 tempest-VolumesListAdminTestJSON-329818275 None] Volume 456a7512-5177-4499-92c8-8cbae543d628: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-456a7512-5177-4499-92c8-8cbae543d628', 'volume_size': 1} Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0bb78ff7-e5c2-481a-bda5-107f2ba899d6 tempest-VolumesListAdminTestJSON-329818275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-33e5f422-750a-4ac5-86a4-6db8d4b098e4 tempest-SnapshotsActionsTest-2037609075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b" returned: 0 in 0.497s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f7e8388a-794d-4f2b-ac78-7cdd2cdcdacf tempest-VolumesActionsTest-1170390702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3fb0f975-0837-4556-b6b8-a887b89fe198" returned: 0 in 0.354s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-33e5f422-750a-4ac5-86a4-6db8d4b098e4 tempest-SnapshotsActionsTest-2037609075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f7e8388a-794d-4f2b-ac78-7cdd2cdcdacf tempest-VolumesActionsTest-1170390702 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f7e8388a-794d-4f2b-ac78-7cdd2cdcdacf tempest-VolumesActionsTest-1170390702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0bb78ff7-e5c2-481a-bda5-107f2ba899d6 tempest-VolumesListAdminTestJSON-329818275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.025s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0bb78ff7-e5c2-481a-bda5-107f2ba899d6 tempest-VolumesListAdminTestJSON-329818275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-93493653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=456a7512-5177-4499-92c8-8cbae543d628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='900929b56f10415d94e2fc0199f55331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:42:54Z,use_quota=True,user_id='b123c0a0d67241ab9d3b66cb0fe037ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-0bb78ff7-e5c2-481a-bda5-107f2ba899d6 tempest-VolumesListAdminTestJSON-329818275 None] Creating volume 456a7512-5177-4499-92c8-8cbae543d628 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0bb78ff7-e5c2-481a-bda5-107f2ba899d6 tempest-VolumesListAdminTestJSON-329818275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0bb78ff7-e5c2-481a-bda5-107f2ba899d6 tempest-VolumesListAdminTestJSON-329818275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0bb78ff7-e5c2-481a-bda5-107f2ba899d6 tempest-VolumesListAdminTestJSON-329818275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:42:54 devstack sudo[96754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b Jul 28 10:42:54 devstack sudo[96754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0bb78ff7-e5c2-481a-bda5-107f2ba899d6 tempest-VolumesListAdminTestJSON-329818275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0bb78ff7-e5c2-481a-bda5-107f2ba899d6 tempest-VolumesListAdminTestJSON-329818275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0bb78ff7-e5c2-481a-bda5-107f2ba899d6 tempest-VolumesListAdminTestJSON-329818275 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:42:54 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-0bb78ff7-e5c2-481a-bda5-107f2ba899d6 tempest-VolumesListAdminTestJSON-329818275 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0bb78ff7-e5c2-481a-bda5-107f2ba899d6 tempest-VolumesListAdminTestJSON-329818275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-456a7512-5177-4499-92c8-8cbae543d628 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f7e8388a-794d-4f2b-ac78-7cdd2cdcdacf tempest-VolumesActionsTest-1170390702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfae5ee2-efdc-44b9-8e58-27cf8bd482cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fb0f975-0837-4556-b6b8-a887b89fe198', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f7e8388a-794d-4f2b-ac78-7cdd2cdcdacf tempest-VolumesActionsTest-1170390702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e81d85f2-b55f-4254-8775-724605924428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:54 devstack sudo[96756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-456a7512-5177-4499-92c8-8cbae543d628 1073741824 Jul 28 10:42:54 devstack sudo[96756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:54 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-f7e8388a-794d-4f2b-ac78-7cdd2cdcdacf tempest-VolumesActionsTest-1170390702 None] Volume volume-3fb0f975-0837-4556-b6b8-a887b89fe198 (3fb0f975-0837-4556-b6b8-a887b89fe198): created successfully Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f7e8388a-794d-4f2b-ac78-7cdd2cdcdacf tempest-VolumesActionsTest-1170390702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e81d85f2-b55f-4254-8775-724605924428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f7e8388a-794d-4f2b-ac78-7cdd2cdcdacf tempest-VolumesActionsTest-1170390702 None] Flow 'volume_create_manager' (584fbc91-6868-4dc7-b4c2-35b1fdeb43bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:42:54 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-f7e8388a-794d-4f2b-ac78-7cdd2cdcdacf tempest-VolumesActionsTest-1170390702 None] Created volume successfully. Jul 28 10:42:54 devstack sudo[96754]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-33e5f422-750a-4ac5-86a4-6db8d4b098e4 tempest-SnapshotsActionsTest-2037609075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d85ab57f-3144-4fab-a8c2-8a3d241e347b" returned: 0 in 0.290s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-33e5f422-750a-4ac5-86a4-6db8d4b098e4 tempest-SnapshotsActionsTest-2037609075 None] Lock "cinder-quobyte-d85ab57f-3144-4fab-a8c2-8a3d241e347b" released by "delete_volume" :: held 0.861s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-33e5f422-750a-4ac5-86a4-6db8d4b098e4 tempest-SnapshotsActionsTest-2037609075 None] Created reservations ['ef24753c-0ad6-4335-9d40-d2bbc6251f93', '99347fba-f38b-4600-84bf-e9e240300df9', 'b3697a20-b400-40b5-a86a-bef5340a9fe9', '18f71a08-cc90-4919-9b21-77280ec21d7e'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-33e5f422-750a-4ac5-86a4-6db8d4b098e4 tempest-SnapshotsActionsTest-2037609075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-33e5f422-750a-4ac5-86a4-6db8d4b098e4 tempest-SnapshotsActionsTest-2037609075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-33e5f422-750a-4ac5-86a4-6db8d4b098e4 tempest-SnapshotsActionsTest-2037609075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-33e5f422-750a-4ac5-86a4-6db8d4b098e4 tempest-SnapshotsActionsTest-2037609075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-33e5f422-750a-4ac5-86a4-6db8d4b098e4 tempest-SnapshotsActionsTest-2037609075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:42:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-33e5f422-750a-4ac5-86a4-6db8d4b098e4 tempest-SnapshotsActionsTest-2037609075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:55 devstack sudo[96766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:42:55 devstack sudo[96766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:55 devstack sudo[96756]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0bb78ff7-e5c2-481a-bda5-107f2ba899d6 tempest-VolumesListAdminTestJSON-329818275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-456a7512-5177-4499-92c8-8cbae543d628 1073741824" returned: 0 in 0.661s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0bb78ff7-e5c2-481a-bda5-107f2ba899d6 tempest-VolumesListAdminTestJSON-329818275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-456a7512-5177-4499-92c8-8cbae543d628 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:55 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-456a7512-5177-4499-92c8-8cbae543d628 Jul 28 10:42:55 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:55 devstack sudo[96766]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-33e5f422-750a-4ac5-86a4-6db8d4b098e4 tempest-SnapshotsActionsTest-2037609075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.313s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:55 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-33e5f422-750a-4ac5-86a4-6db8d4b098e4 tempest-SnapshotsActionsTest-2037609075 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:42:55 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-33e5f422-750a-4ac5-86a4-6db8d4b098e4 tempest-SnapshotsActionsTest-2037609075 None] Deleted volume successfully. Jul 28 10:42:55 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-33e5f422-750a-4ac5-86a4-6db8d4b098e4 tempest-SnapshotsActionsTest-2037609075 None] Lock "cinder-d85ab57f-3144-4fab-a8c2-8a3d241e347b-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:42:55 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0bb78ff7-e5c2-481a-bda5-107f2ba899d6 tempest-VolumesListAdminTestJSON-329818275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-456a7512-5177-4499-92c8-8cbae543d628" returned: 0 in 0.427s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:55 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0bb78ff7-e5c2-481a-bda5-107f2ba899d6 tempest-VolumesListAdminTestJSON-329818275 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:42:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0bb78ff7-e5c2-481a-bda5-107f2ba899d6 tempest-VolumesListAdminTestJSON-329818275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:42:55 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0bb78ff7-e5c2-481a-bda5-107f2ba899d6 tempest-VolumesListAdminTestJSON-329818275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (827360f6-401a-4884-b107-e477218c6150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-456a7512-5177-4499-92c8-8cbae543d628', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:55 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0bb78ff7-e5c2-481a-bda5-107f2ba899d6 tempest-VolumesListAdminTestJSON-329818275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13de0b4b-dcf8-4d97-a79a-57b67f5fe685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:55 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-0bb78ff7-e5c2-481a-bda5-107f2ba899d6 tempest-VolumesListAdminTestJSON-329818275 None] Volume volume-456a7512-5177-4499-92c8-8cbae543d628 (456a7512-5177-4499-92c8-8cbae543d628): created successfully Jul 28 10:42:55 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0bb78ff7-e5c2-481a-bda5-107f2ba899d6 tempest-VolumesListAdminTestJSON-329818275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13de0b4b-dcf8-4d97-a79a-57b67f5fe685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:55 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0bb78ff7-e5c2-481a-bda5-107f2ba899d6 tempest-VolumesListAdminTestJSON-329818275 None] Flow 'volume_create_manager' (8db74cbb-dd4d-4805-a06a-18d797c81c45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:42:55 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-0bb78ff7-e5c2-481a-bda5-107f2ba899d6 tempest-VolumesListAdminTestJSON-329818275 None] Created volume successfully. Jul 28 10:42:57 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a87342a-b189-461b-81af-86a51cd0a5ea tempest-VolumesListAdminTestJSON-1929028097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:42:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6a87342a-b189-461b-81af-86a51cd0a5ea tempest-VolumesListAdminTestJSON-1929028097 None] Flow 'volume_create_manager' (20f6bd3f-175c-4ab2-8fda-310f9f805d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:42:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6a87342a-b189-461b-81af-86a51cd0a5ea tempest-VolumesListAdminTestJSON-1929028097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6083b5d-1238-422d-81d2-d5962b8d8cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6a87342a-b189-461b-81af-86a51cd0a5ea tempest-VolumesListAdminTestJSON-1929028097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6083b5d-1238-422d-81d2-d5962b8d8cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e395f9-1d4f-49e5-8435-cc68875d375b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b45b493276694260885632c6a63bbd39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:42:57Z,use_quota=True,user_id='1483c5da7faa438f9b99392cfcb5b92c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6a87342a-b189-461b-81af-86a51cd0a5ea tempest-VolumesListAdminTestJSON-1929028097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec01f983-262d-471c-8dfd-0ff77d252726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6a87342a-b189-461b-81af-86a51cd0a5ea tempest-VolumesListAdminTestJSON-1929028097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec01f983-262d-471c-8dfd-0ff77d252726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6a87342a-b189-461b-81af-86a51cd0a5ea tempest-VolumesListAdminTestJSON-1929028097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d262660a-25de-49f8-af9f-7f08ea807e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6a87342a-b189-461b-81af-86a51cd0a5ea tempest-VolumesListAdminTestJSON-1929028097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d262660a-25de-49f8-af9f-7f08ea807e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1e395f9-1d4f-49e5-8435-cc68875d375b', 'volume_name': 'volume-e1e395f9-1d4f-49e5-8435-cc68875d375b', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6a87342a-b189-461b-81af-86a51cd0a5ea tempest-VolumesListAdminTestJSON-1929028097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf2927db-04c3-4c87-9784-bd9d8119d269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6a87342a-b189-461b-81af-86a51cd0a5ea tempest-VolumesListAdminTestJSON-1929028097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf2927db-04c3-4c87-9784-bd9d8119d269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6a87342a-b189-461b-81af-86a51cd0a5ea tempest-VolumesListAdminTestJSON-1929028097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (253b0af9-b35d-493f-9f4e-115f11768e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:57 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-6a87342a-b189-461b-81af-86a51cd0a5ea tempest-VolumesListAdminTestJSON-1929028097 None] Volume e1e395f9-1d4f-49e5-8435-cc68875d375b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1e395f9-1d4f-49e5-8435-cc68875d375b', 'volume_size': 1} Jul 28 10:42:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-6a87342a-b189-461b-81af-86a51cd0a5ea tempest-VolumesListAdminTestJSON-1929028097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:42:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-6a87342a-b189-461b-81af-86a51cd0a5ea tempest-VolumesListAdminTestJSON-1929028097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:42:57 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-6a87342a-b189-461b-81af-86a51cd0a5ea tempest-VolumesListAdminTestJSON-1929028097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e395f9-1d4f-49e5-8435-cc68875d375b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b45b493276694260885632c6a63bbd39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:42:57Z,use_quota=True,user_id='1483c5da7faa438f9b99392cfcb5b92c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:42:57 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-6a87342a-b189-461b-81af-86a51cd0a5ea tempest-VolumesListAdminTestJSON-1929028097 None] Creating volume e1e395f9-1d4f-49e5-8435-cc68875d375b {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:42:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-6a87342a-b189-461b-81af-86a51cd0a5ea tempest-VolumesListAdminTestJSON-1929028097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:42:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-6a87342a-b189-461b-81af-86a51cd0a5ea tempest-VolumesListAdminTestJSON-1929028097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:42:57 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-6a87342a-b189-461b-81af-86a51cd0a5ea tempest-VolumesListAdminTestJSON-1929028097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:42:57 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-6a87342a-b189-461b-81af-86a51cd0a5ea tempest-VolumesListAdminTestJSON-1929028097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:42:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-6a87342a-b189-461b-81af-86a51cd0a5ea tempest-VolumesListAdminTestJSON-1929028097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:42:57 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-6a87342a-b189-461b-81af-86a51cd0a5ea tempest-VolumesListAdminTestJSON-1929028097 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:42:57 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-6a87342a-b189-461b-81af-86a51cd0a5ea tempest-VolumesListAdminTestJSON-1929028097 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:42:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6a87342a-b189-461b-81af-86a51cd0a5ea tempest-VolumesListAdminTestJSON-1929028097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e1e395f9-1d4f-49e5-8435-cc68875d375b 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:57 devstack sudo[96803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e1e395f9-1d4f-49e5-8435-cc68875d375b 1073741824 Jul 28 10:42:57 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:58 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6a87342a-b189-461b-81af-86a51cd0a5ea tempest-VolumesListAdminTestJSON-1929028097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e1e395f9-1d4f-49e5-8435-cc68875d375b 1073741824" returned: 0 in 0.679s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6a87342a-b189-461b-81af-86a51cd0a5ea tempest-VolumesListAdminTestJSON-1929028097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e1e395f9-1d4f-49e5-8435-cc68875d375b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:42:58 devstack sudo[96811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e1e395f9-1d4f-49e5-8435-cc68875d375b Jul 28 10:42:58 devstack sudo[96811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:42:58 devstack sudo[96811]: pam_unix(sudo:session): session closed for user root Jul 28 10:42:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6a87342a-b189-461b-81af-86a51cd0a5ea tempest-VolumesListAdminTestJSON-1929028097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e1e395f9-1d4f-49e5-8435-cc68875d375b" returned: 0 in 0.431s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:42:58 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-6a87342a-b189-461b-81af-86a51cd0a5ea tempest-VolumesListAdminTestJSON-1929028097 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:42:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-6a87342a-b189-461b-81af-86a51cd0a5ea tempest-VolumesListAdminTestJSON-1929028097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:42:58 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6a87342a-b189-461b-81af-86a51cd0a5ea tempest-VolumesListAdminTestJSON-1929028097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (253b0af9-b35d-493f-9f4e-115f11768e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1e395f9-1d4f-49e5-8435-cc68875d375b', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:58 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6a87342a-b189-461b-81af-86a51cd0a5ea tempest-VolumesListAdminTestJSON-1929028097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3688a1c0-257b-4126-bb87-9fdc7fbdc07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:42:58 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-6a87342a-b189-461b-81af-86a51cd0a5ea tempest-VolumesListAdminTestJSON-1929028097 None] Volume volume-e1e395f9-1d4f-49e5-8435-cc68875d375b (e1e395f9-1d4f-49e5-8435-cc68875d375b): created successfully Jul 28 10:42:58 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6a87342a-b189-461b-81af-86a51cd0a5ea tempest-VolumesListAdminTestJSON-1929028097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3688a1c0-257b-4126-bb87-9fdc7fbdc07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:42:58 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6a87342a-b189-461b-81af-86a51cd0a5ea tempest-VolumesListAdminTestJSON-1929028097 None] Flow 'volume_create_manager' (20f6bd3f-175c-4ab2-8fda-310f9f805d1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:42:58 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-6a87342a-b189-461b-81af-86a51cd0a5ea tempest-VolumesListAdminTestJSON-1929028097 None] Created volume successfully. Jul 28 10:42:59 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8860357c-5195-4745-9feb-49619a865d7b tempest-VolumesListAdminTestJSON-1929028097 None] Acquiring lock "cinder-e1e395f9-1d4f-49e5-8435-cc68875d375b-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:42:59 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8860357c-5195-4745-9feb-49619a865d7b tempest-VolumesListAdminTestJSON-1929028097 None] Lock "cinder-e1e395f9-1d4f-49e5-8435-cc68875d375b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:43:00 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8860357c-5195-4745-9feb-49619a865d7b tempest-VolumesListAdminTestJSON-1929028097 None] Acquiring lock "cinder-quobyte-e1e395f9-1d4f-49e5-8435-cc68875d375b" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:43:00 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8860357c-5195-4745-9feb-49619a865d7b tempest-VolumesListAdminTestJSON-1929028097 None] Lock "cinder-quobyte-e1e395f9-1d4f-49e5-8435-cc68875d375b" acquired by "delete_volume" :: waited 0.041s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:43:00 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e6c593-edeb-4ed6-a86b-7c941663b9d6]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:43:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8860357c-5195-4745-9feb-49619a865d7b tempest-VolumesListAdminTestJSON-1929028097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e1e395f9-1d4f-49e5-8435-cc68875d375b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:00 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7894bd8f-2f80-4cc3-932e-875ba211d511 tempest-VolumesListAdminTestJSON-329818275 None] Acquiring lock "cinder-456a7512-5177-4499-92c8-8cbae543d628-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:43:00 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7894bd8f-2f80-4cc3-932e-875ba211d511 tempest-VolumesListAdminTestJSON-329818275 None] Lock "cinder-456a7512-5177-4499-92c8-8cbae543d628-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:43:00 devstack sudo[96829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e1e395f9-1d4f-49e5-8435-cc68875d375b Jul 28 10:43:00 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:00 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7894bd8f-2f80-4cc3-932e-875ba211d511 tempest-VolumesListAdminTestJSON-329818275 None] Acquiring lock "cinder-quobyte-456a7512-5177-4499-92c8-8cbae543d628" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:43:00 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7894bd8f-2f80-4cc3-932e-875ba211d511 tempest-VolumesListAdminTestJSON-329818275 None] Lock "cinder-quobyte-456a7512-5177-4499-92c8-8cbae543d628" acquired by "delete_volume" :: waited 0.031s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:43:00 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6e747c-2624-4443-85f7-30412815ee34]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:43:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7894bd8f-2f80-4cc3-932e-875ba211d511 tempest-VolumesListAdminTestJSON-329818275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-456a7512-5177-4499-92c8-8cbae543d628 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:00 devstack sudo[96836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-456a7512-5177-4499-92c8-8cbae543d628 Jul 28 10:43:00 devstack sudo[96836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:00 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8860357c-5195-4745-9feb-49619a865d7b tempest-VolumesListAdminTestJSON-1929028097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e1e395f9-1d4f-49e5-8435-cc68875d375b" returned: 0 in 0.665s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8860357c-5195-4745-9feb-49619a865d7b tempest-VolumesListAdminTestJSON-1929028097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e1e395f9-1d4f-49e5-8435-cc68875d375b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:00 devstack sudo[96844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e1e395f9-1d4f-49e5-8435-cc68875d375b Jul 28 10:43:00 devstack sudo[96844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:01 devstack sudo[96836]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7894bd8f-2f80-4cc3-932e-875ba211d511 tempest-VolumesListAdminTestJSON-329818275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-456a7512-5177-4499-92c8-8cbae543d628" returned: 0 in 0.495s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7894bd8f-2f80-4cc3-932e-875ba211d511 tempest-VolumesListAdminTestJSON-329818275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-456a7512-5177-4499-92c8-8cbae543d628 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:01 devstack sudo[96851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-456a7512-5177-4499-92c8-8cbae543d628 Jul 28 10:43:01 devstack sudo[96851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:01 devstack sudo[96844]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8860357c-5195-4745-9feb-49619a865d7b tempest-VolumesListAdminTestJSON-1929028097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e1e395f9-1d4f-49e5-8435-cc68875d375b" returned: 0 in 0.385s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:01 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8860357c-5195-4745-9feb-49619a865d7b tempest-VolumesListAdminTestJSON-1929028097 None] Lock "cinder-quobyte-e1e395f9-1d4f-49e5-8435-cc68875d375b" released by "delete_volume" :: held 1.126s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:43:01 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-73eebe1f-177f-4cf0-9526-45c838d2f3eb req-1c294ad4-5dea-41bd-b3dd-d254597d4654 tempest-AttachVolumeNegativeTest-1916507259 None] Terminate volume connection completed successfully. Jul 28 10:43:01 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-73eebe1f-177f-4cf0-9526-45c838d2f3eb req-1c294ad4-5dea-41bd-b3dd-d254597d4654 tempest-AttachVolumeNegativeTest-1916507259 None] Deleting attachment f0f8873b-fd99-4f22-acaa-1cd5f17f6ff2. {{(pid=88413) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 10:43:01 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-8860357c-5195-4745-9feb-49619a865d7b tempest-VolumesListAdminTestJSON-1929028097 None] Created reservations ['b730cc5e-d843-4959-8f3b-b5891e704411', 'e0604f7c-8bf1-4b40-9711-378b4b4ffab8', '7d508931-1229-4567-b4e4-17a142f1570d', '391bf639-6325-4c53-a0c1-2b55046b437a'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:43:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8860357c-5195-4745-9feb-49619a865d7b tempest-VolumesListAdminTestJSON-1929028097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:43:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8860357c-5195-4745-9feb-49619a865d7b tempest-VolumesListAdminTestJSON-1929028097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:43:01 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8860357c-5195-4745-9feb-49619a865d7b tempest-VolumesListAdminTestJSON-1929028097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:43:01 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8860357c-5195-4745-9feb-49619a865d7b tempest-VolumesListAdminTestJSON-1929028097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:43:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8860357c-5195-4745-9feb-49619a865d7b tempest-VolumesListAdminTestJSON-1929028097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:43:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8860357c-5195-4745-9feb-49619a865d7b tempest-VolumesListAdminTestJSON-1929028097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:01 devstack sudo[96857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:43:01 devstack sudo[96857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:01 devstack sudo[96851]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7894bd8f-2f80-4cc3-932e-875ba211d511 tempest-VolumesListAdminTestJSON-329818275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-456a7512-5177-4499-92c8-8cbae543d628" returned: 0 in 0.462s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:01 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7894bd8f-2f80-4cc3-932e-875ba211d511 tempest-VolumesListAdminTestJSON-329818275 None] Lock "cinder-quobyte-456a7512-5177-4499-92c8-8cbae543d628" released by "delete_volume" :: held 1.070s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:43:01 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-7894bd8f-2f80-4cc3-932e-875ba211d511 tempest-VolumesListAdminTestJSON-329818275 None] Created reservations ['cfd4b9a8-caba-4dd1-8107-a5af7976ae2e', 'bdb0cf44-ef39-4723-8663-6662a60f6fcb', 'fba4120b-1a34-44a2-920e-268b9818bbd2', '943b3f3e-a7c1-4de8-9e98-35ea63e173ec'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:43:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7894bd8f-2f80-4cc3-932e-875ba211d511 tempest-VolumesListAdminTestJSON-329818275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:43:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7894bd8f-2f80-4cc3-932e-875ba211d511 tempest-VolumesListAdminTestJSON-329818275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:43:01 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7894bd8f-2f80-4cc3-932e-875ba211d511 tempest-VolumesListAdminTestJSON-329818275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:43:01 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7894bd8f-2f80-4cc3-932e-875ba211d511 tempest-VolumesListAdminTestJSON-329818275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:43:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7894bd8f-2f80-4cc3-932e-875ba211d511 tempest-VolumesListAdminTestJSON-329818275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:43:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7894bd8f-2f80-4cc3-932e-875ba211d511 tempest-VolumesListAdminTestJSON-329818275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:01 devstack sudo[96860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:43:01 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:01 devstack sudo[96857]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8860357c-5195-4745-9feb-49619a865d7b tempest-VolumesListAdminTestJSON-1929028097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.399s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:01 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-8860357c-5195-4745-9feb-49619a865d7b tempest-VolumesListAdminTestJSON-1929028097 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:43:01 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-8860357c-5195-4745-9feb-49619a865d7b tempest-VolumesListAdminTestJSON-1929028097 None] Deleted volume successfully. Jul 28 10:43:01 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8860357c-5195-4745-9feb-49619a865d7b tempest-VolumesListAdminTestJSON-1929028097 None] Lock "cinder-e1e395f9-1d4f-49e5-8435-cc68875d375b-delete_volume" released by "delete_volume" :: held 1.974s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:43:02 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7894bd8f-2f80-4cc3-932e-875ba211d511 tempest-VolumesListAdminTestJSON-329818275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.470s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:02 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-7894bd8f-2f80-4cc3-932e-875ba211d511 tempest-VolumesListAdminTestJSON-329818275 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:43:02 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-7894bd8f-2f80-4cc3-932e-875ba211d511 tempest-VolumesListAdminTestJSON-329818275 None] Deleted volume successfully. Jul 28 10:43:02 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7894bd8f-2f80-4cc3-932e-875ba211d511 tempest-VolumesListAdminTestJSON-329818275 None] Lock "cinder-456a7512-5177-4499-92c8-8cbae543d628-delete_volume" released by "delete_volume" :: held 1.937s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:43:02 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9d50d46c-d643-4b88-b52b-44e01381afa2 tempest-VolumesListAdminTestJSON-329818275 None] Acquiring lock "cinder-6a13e602-d4a0-44d7-9a8d-76ca418097d5-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:43:02 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9d50d46c-d643-4b88-b52b-44e01381afa2 tempest-VolumesListAdminTestJSON-329818275 None] Lock "cinder-6a13e602-d4a0-44d7-9a8d-76ca418097d5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:43:02 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9d50d46c-d643-4b88-b52b-44e01381afa2 tempest-VolumesListAdminTestJSON-329818275 None] Acquiring lock "cinder-quobyte-6a13e602-d4a0-44d7-9a8d-76ca418097d5" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:43:02 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9d50d46c-d643-4b88-b52b-44e01381afa2 tempest-VolumesListAdminTestJSON-329818275 None] Lock "cinder-quobyte-6a13e602-d4a0-44d7-9a8d-76ca418097d5" acquired by "delete_volume" :: waited 0.014s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:43:03 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f9f974-88d4-4c8b-b69f-9e8b2ad3e4a0]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:43:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9d50d46c-d643-4b88-b52b-44e01381afa2 tempest-VolumesListAdminTestJSON-329818275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6a13e602-d4a0-44d7-9a8d-76ca418097d5 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:03 devstack sudo[96888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6a13e602-d4a0-44d7-9a8d-76ca418097d5 Jul 28 10:43:03 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:03 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bf421b9-4b8a-47e6-bb22-6f375eda90ae tempest-VolumeQuotasNegativeTestJSON-975233469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:43:03 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8bf421b9-4b8a-47e6-bb22-6f375eda90ae tempest-VolumeQuotasNegativeTestJSON-975233469 None] Flow 'volume_create_manager' (30b294f7-07d8-4bbd-add6-a0becfdf0345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:43:03 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:03 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8bf421b9-4b8a-47e6-bb22-6f375eda90ae tempest-VolumeQuotasNegativeTestJSON-975233469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14e29638-7f29-4b31-8650-0e966124e485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:43:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9d50d46c-d643-4b88-b52b-44e01381afa2 tempest-VolumesListAdminTestJSON-329818275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6a13e602-d4a0-44d7-9a8d-76ca418097d5" returned: 0 in 0.791s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9d50d46c-d643-4b88-b52b-44e01381afa2 tempest-VolumesListAdminTestJSON-329818275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6a13e602-d4a0-44d7-9a8d-76ca418097d5 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:03 devstack sudo[96922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6a13e602-d4a0-44d7-9a8d-76ca418097d5 Jul 28 10:43:03 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8bf421b9-4b8a-47e6-bb22-6f375eda90ae tempest-VolumeQuotasNegativeTestJSON-975233469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14e29638-7f29-4b31-8650-0e966124e485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-726547404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=340f7526-98ab-4b81-835d-df27444c8adb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='270109ba1c8f42b9ae1815beb03b1466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:43:04Z,use_quota=True,user_id='017eb81e9460481498e0aa88cf9a380c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:43:03 devstack sudo[96922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:03 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8bf421b9-4b8a-47e6-bb22-6f375eda90ae tempest-VolumeQuotasNegativeTestJSON-975233469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e33eb8c-abb5-4f2c-9e09-10466f37f2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:43:03 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8bf421b9-4b8a-47e6-bb22-6f375eda90ae tempest-VolumeQuotasNegativeTestJSON-975233469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e33eb8c-abb5-4f2c-9e09-10466f37f2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:43:03 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8bf421b9-4b8a-47e6-bb22-6f375eda90ae tempest-VolumeQuotasNegativeTestJSON-975233469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88e02849-25b4-4b2f-adb3-e69e2debf3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:43:03 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8bf421b9-4b8a-47e6-bb22-6f375eda90ae tempest-VolumeQuotasNegativeTestJSON-975233469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88e02849-25b4-4b2f-adb3-e69e2debf3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '340f7526-98ab-4b81-835d-df27444c8adb', 'volume_name': 'volume-340f7526-98ab-4b81-835d-df27444c8adb', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:43:03 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8bf421b9-4b8a-47e6-bb22-6f375eda90ae tempest-VolumeQuotasNegativeTestJSON-975233469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ea7645-f352-4e78-aa73-2f5a8e857be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:43:03 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8bf421b9-4b8a-47e6-bb22-6f375eda90ae tempest-VolumeQuotasNegativeTestJSON-975233469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ea7645-f352-4e78-aa73-2f5a8e857be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:43:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8bf421b9-4b8a-47e6-bb22-6f375eda90ae tempest-VolumeQuotasNegativeTestJSON-975233469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb2d5b70-13f5-4a84-8a24-d8c5b3dd3965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:43:04 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-8bf421b9-4b8a-47e6-bb22-6f375eda90ae tempest-VolumeQuotasNegativeTestJSON-975233469 None] Volume 340f7526-98ab-4b81-835d-df27444c8adb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-340f7526-98ab-4b81-835d-df27444c8adb', 'volume_size': 1} Jul 28 10:43:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8bf421b9-4b8a-47e6-bb22-6f375eda90ae tempest-VolumeQuotasNegativeTestJSON-975233469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:43:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8bf421b9-4b8a-47e6-bb22-6f375eda90ae tempest-VolumeQuotasNegativeTestJSON-975233469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:43:04 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8bf421b9-4b8a-47e6-bb22-6f375eda90ae tempest-VolumeQuotasNegativeTestJSON-975233469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-726547404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=340f7526-98ab-4b81-835d-df27444c8adb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='270109ba1c8f42b9ae1815beb03b1466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:43:04Z,use_quota=True,user_id='017eb81e9460481498e0aa88cf9a380c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:43:04 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-8bf421b9-4b8a-47e6-bb22-6f375eda90ae tempest-VolumeQuotasNegativeTestJSON-975233469 None] Creating volume 340f7526-98ab-4b81-835d-df27444c8adb {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:43:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8bf421b9-4b8a-47e6-bb22-6f375eda90ae tempest-VolumeQuotasNegativeTestJSON-975233469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:43:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8bf421b9-4b8a-47e6-bb22-6f375eda90ae tempest-VolumeQuotasNegativeTestJSON-975233469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:43:04 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8bf421b9-4b8a-47e6-bb22-6f375eda90ae tempest-VolumeQuotasNegativeTestJSON-975233469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:43:04 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8bf421b9-4b8a-47e6-bb22-6f375eda90ae tempest-VolumeQuotasNegativeTestJSON-975233469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:43:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8bf421b9-4b8a-47e6-bb22-6f375eda90ae tempest-VolumeQuotasNegativeTestJSON-975233469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:43:04 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8bf421b9-4b8a-47e6-bb22-6f375eda90ae tempest-VolumeQuotasNegativeTestJSON-975233469 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:43:04 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-8bf421b9-4b8a-47e6-bb22-6f375eda90ae tempest-VolumeQuotasNegativeTestJSON-975233469 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:43:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8bf421b9-4b8a-47e6-bb22-6f375eda90ae tempest-VolumeQuotasNegativeTestJSON-975233469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-340f7526-98ab-4b81-835d-df27444c8adb 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:04 devstack sudo[96931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-340f7526-98ab-4b81-835d-df27444c8adb 1073741824 Jul 28 10:43:04 devstack sudo[96931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:04 devstack sudo[96922]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9d50d46c-d643-4b88-b52b-44e01381afa2 tempest-VolumesListAdminTestJSON-329818275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6a13e602-d4a0-44d7-9a8d-76ca418097d5" returned: 0 in 0.605s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:04 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9d50d46c-d643-4b88-b52b-44e01381afa2 tempest-VolumesListAdminTestJSON-329818275 None] Lock "cinder-quobyte-6a13e602-d4a0-44d7-9a8d-76ca418097d5" released by "delete_volume" :: held 1.484s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:43:04 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-9d50d46c-d643-4b88-b52b-44e01381afa2 tempest-VolumesListAdminTestJSON-329818275 None] Created reservations ['af37933c-ffad-4306-bb59-d6148d66b2e3', '7a005a28-ce0e-42ea-af09-479bf29b112d', '78a6ee22-0050-4107-8803-90f7f785a48c', '0e704a6f-673c-49f8-8892-a0c70b135bec'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:43:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9d50d46c-d643-4b88-b52b-44e01381afa2 tempest-VolumesListAdminTestJSON-329818275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:43:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9d50d46c-d643-4b88-b52b-44e01381afa2 tempest-VolumesListAdminTestJSON-329818275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:43:04 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9d50d46c-d643-4b88-b52b-44e01381afa2 tempest-VolumesListAdminTestJSON-329818275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:43:04 devstack sudo[96931]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:04 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9d50d46c-d643-4b88-b52b-44e01381afa2 tempest-VolumesListAdminTestJSON-329818275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:43:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9d50d46c-d643-4b88-b52b-44e01381afa2 tempest-VolumesListAdminTestJSON-329818275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:43:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9d50d46c-d643-4b88-b52b-44e01381afa2 tempest-VolumesListAdminTestJSON-329818275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8bf421b9-4b8a-47e6-bb22-6f375eda90ae tempest-VolumeQuotasNegativeTestJSON-975233469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-340f7526-98ab-4b81-835d-df27444c8adb 1073741824" returned: 0 in 0.778s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:04 devstack sudo[96965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:43:04 devstack sudo[96965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8bf421b9-4b8a-47e6-bb22-6f375eda90ae tempest-VolumeQuotasNegativeTestJSON-975233469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-340f7526-98ab-4b81-835d-df27444c8adb {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:04 devstack sudo[96968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-340f7526-98ab-4b81-835d-df27444c8adb Jul 28 10:43:04 devstack sudo[96968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:05 devstack sudo[96968]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8bf421b9-4b8a-47e6-bb22-6f375eda90ae tempest-VolumeQuotasNegativeTestJSON-975233469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-340f7526-98ab-4b81-835d-df27444c8adb" returned: 0 in 0.545s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:05 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8bf421b9-4b8a-47e6-bb22-6f375eda90ae tempest-VolumeQuotasNegativeTestJSON-975233469 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:43:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8bf421b9-4b8a-47e6-bb22-6f375eda90ae tempest-VolumeQuotasNegativeTestJSON-975233469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:43:05 devstack sudo[96965]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9d50d46c-d643-4b88-b52b-44e01381afa2 tempest-VolumesListAdminTestJSON-329818275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.714s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:05 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-9d50d46c-d643-4b88-b52b-44e01381afa2 tempest-VolumesListAdminTestJSON-329818275 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:43:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8bf421b9-4b8a-47e6-bb22-6f375eda90ae tempest-VolumeQuotasNegativeTestJSON-975233469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb2d5b70-13f5-4a84-8a24-d8c5b3dd3965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-340f7526-98ab-4b81-835d-df27444c8adb', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:43:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8bf421b9-4b8a-47e6-bb22-6f375eda90ae tempest-VolumeQuotasNegativeTestJSON-975233469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da6b37fd-e11e-4d0f-9cab-afeaf7369468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:43:05 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-53bd0de4-71a1-4548-8bba-3330ecfde4dd tempest-VolumesListAdminTestJSON-329818275 None] Acquiring lock "cinder-b3905edf-dbea-467d-a783-b5f67d25c2e9-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:43:05 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-9d50d46c-d643-4b88-b52b-44e01381afa2 tempest-VolumesListAdminTestJSON-329818275 None] Deleted volume successfully. Jul 28 10:43:05 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-8bf421b9-4b8a-47e6-bb22-6f375eda90ae tempest-VolumeQuotasNegativeTestJSON-975233469 None] Volume volume-340f7526-98ab-4b81-835d-df27444c8adb (340f7526-98ab-4b81-835d-df27444c8adb): created successfully Jul 28 10:43:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8bf421b9-4b8a-47e6-bb22-6f375eda90ae tempest-VolumeQuotasNegativeTestJSON-975233469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da6b37fd-e11e-4d0f-9cab-afeaf7369468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:43:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8bf421b9-4b8a-47e6-bb22-6f375eda90ae tempest-VolumeQuotasNegativeTestJSON-975233469 None] Flow 'volume_create_manager' (30b294f7-07d8-4bbd-add6-a0becfdf0345) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:43:05 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-53bd0de4-71a1-4548-8bba-3330ecfde4dd tempest-VolumesListAdminTestJSON-329818275 None] Lock "cinder-b3905edf-dbea-467d-a783-b5f67d25c2e9-delete_volume" acquired by "delete_volume" :: waited 0.161s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:43:05 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9d50d46c-d643-4b88-b52b-44e01381afa2 tempest-VolumesListAdminTestJSON-329818275 None] Lock "cinder-6a13e602-d4a0-44d7-9a8d-76ca418097d5-delete_volume" released by "delete_volume" :: held 2.822s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:43:05 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-8bf421b9-4b8a-47e6-bb22-6f375eda90ae tempest-VolumeQuotasNegativeTestJSON-975233469 None] Created volume successfully. Jul 28 10:43:05 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-53bd0de4-71a1-4548-8bba-3330ecfde4dd tempest-VolumesListAdminTestJSON-329818275 None] Acquiring lock "cinder-quobyte-b3905edf-dbea-467d-a783-b5f67d25c2e9" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:43:05 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-53bd0de4-71a1-4548-8bba-3330ecfde4dd tempest-VolumesListAdminTestJSON-329818275 None] Lock "cinder-quobyte-b3905edf-dbea-467d-a783-b5f67d25c2e9" acquired by "delete_volume" :: waited 0.020s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:43:05 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdfa3f5-b628-4b8d-99da-1761a1cb0c1e]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:43:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-53bd0de4-71a1-4548-8bba-3330ecfde4dd tempest-VolumesListAdminTestJSON-329818275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b3905edf-dbea-467d-a783-b5f67d25c2e9 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:06 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b3905edf-dbea-467d-a783-b5f67d25c2e9 Jul 28 10:43:06 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:06 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-53bd0de4-71a1-4548-8bba-3330ecfde4dd tempest-VolumesListAdminTestJSON-329818275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b3905edf-dbea-467d-a783-b5f67d25c2e9" returned: 0 in 0.570s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-53bd0de4-71a1-4548-8bba-3330ecfde4dd tempest-VolumesListAdminTestJSON-329818275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b3905edf-dbea-467d-a783-b5f67d25c2e9 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:06 devstack sudo[96996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b3905edf-dbea-467d-a783-b5f67d25c2e9 Jul 28 10:43:06 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:07 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-53bd0de4-71a1-4548-8bba-3330ecfde4dd tempest-VolumesListAdminTestJSON-329818275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b3905edf-dbea-467d-a783-b5f67d25c2e9" returned: 0 in 0.628s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:07 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-53bd0de4-71a1-4548-8bba-3330ecfde4dd tempest-VolumesListAdminTestJSON-329818275 None] Lock "cinder-quobyte-b3905edf-dbea-467d-a783-b5f67d25c2e9" released by "delete_volume" :: held 1.267s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:43:07 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=129,cinder:UPDATE=162,cinder:INSERT=45,cinder:DELETE=11 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:43:07 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-53bd0de4-71a1-4548-8bba-3330ecfde4dd tempest-VolumesListAdminTestJSON-329818275 None] Created reservations ['dbc80626-a742-4399-818d-59a9adef655b', '42e16593-c490-4849-b5eb-5c3adca5bccc', 'e30c4305-c9ff-4ab8-9927-8b798903717d', '126a1703-6ab0-4548-aff4-b2b2d05637ad'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:43:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-53bd0de4-71a1-4548-8bba-3330ecfde4dd tempest-VolumesListAdminTestJSON-329818275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:43:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-53bd0de4-71a1-4548-8bba-3330ecfde4dd tempest-VolumesListAdminTestJSON-329818275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:43:07 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-53bd0de4-71a1-4548-8bba-3330ecfde4dd tempest-VolumesListAdminTestJSON-329818275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:43:07 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-53bd0de4-71a1-4548-8bba-3330ecfde4dd tempest-VolumesListAdminTestJSON-329818275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:43:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-53bd0de4-71a1-4548-8bba-3330ecfde4dd tempest-VolumesListAdminTestJSON-329818275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:43:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-53bd0de4-71a1-4548-8bba-3330ecfde4dd tempest-VolumesListAdminTestJSON-329818275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:07 devstack sudo[97001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:43:07 devstack sudo[97001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:07 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4e5c41b0-dea2-4e88-84b8-ce204460257b tempest-VolumeQuotasNegativeTestJSON-975233469 None] Acquiring lock "cinder-340f7526-98ab-4b81-835d-df27444c8adb-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:43:07 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4e5c41b0-dea2-4e88-84b8-ce204460257b tempest-VolumeQuotasNegativeTestJSON-975233469 None] Lock "cinder-340f7526-98ab-4b81-835d-df27444c8adb-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:43:07 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4e5c41b0-dea2-4e88-84b8-ce204460257b tempest-VolumeQuotasNegativeTestJSON-975233469 None] Acquiring lock "cinder-quobyte-340f7526-98ab-4b81-835d-df27444c8adb" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:43:07 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4e5c41b0-dea2-4e88-84b8-ce204460257b tempest-VolumeQuotasNegativeTestJSON-975233469 None] Lock "cinder-quobyte-340f7526-98ab-4b81-835d-df27444c8adb" acquired by "delete_volume" :: waited 0.027s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:43:07 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ce72f9-791b-466d-92ee-5dc18ba2ad02]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:43:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4e5c41b0-dea2-4e88-84b8-ce204460257b tempest-VolumeQuotasNegativeTestJSON-975233469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-340f7526-98ab-4b81-835d-df27444c8adb {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:07 devstack sudo[97001]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-53bd0de4-71a1-4548-8bba-3330ecfde4dd tempest-VolumesListAdminTestJSON-329818275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.401s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:07 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-53bd0de4-71a1-4548-8bba-3330ecfde4dd tempest-VolumesListAdminTestJSON-329818275 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:43:07 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-53bd0de4-71a1-4548-8bba-3330ecfde4dd tempest-VolumesListAdminTestJSON-329818275 None] Deleted volume successfully. Jul 28 10:43:07 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-53bd0de4-71a1-4548-8bba-3330ecfde4dd tempest-VolumesListAdminTestJSON-329818275 None] Lock "cinder-b3905edf-dbea-467d-a783-b5f67d25c2e9-delete_volume" released by "delete_volume" :: held 2.054s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:43:07 devstack sudo[97003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-340f7526-98ab-4b81-835d-df27444c8adb Jul 28 10:43:07 devstack sudo[97003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:08 devstack sudo[97003]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4e5c41b0-dea2-4e88-84b8-ce204460257b tempest-VolumeQuotasNegativeTestJSON-975233469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-340f7526-98ab-4b81-835d-df27444c8adb" returned: 0 in 0.575s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4e5c41b0-dea2-4e88-84b8-ce204460257b tempest-VolumeQuotasNegativeTestJSON-975233469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-340f7526-98ab-4b81-835d-df27444c8adb {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:08 devstack sudo[97009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-340f7526-98ab-4b81-835d-df27444c8adb Jul 28 10:43:08 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:08 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-50fba22b-254b-4cb2-9931-bea7d1d8b913 tempest-VolumesActionsTest-1170390702 None] Acquiring lock "cinder-3fb0f975-0837-4556-b6b8-a887b89fe198" by "attach_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:43:08 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-50fba22b-254b-4cb2-9931-bea7d1d8b913 tempest-VolumesActionsTest-1170390702 None] Lock "cinder-3fb0f975-0837-4556-b6b8-a887b89fe198" acquired by "attach_volume" :: waited 0.049s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:43:08 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-50fba22b-254b-4cb2-9931-bea7d1d8b913 tempest-VolumesActionsTest-1170390702 None] Attaching volume 3fb0f975-0837-4556-b6b8-a887b89fe198 to instance 19a4a7bf-3960-42ff-9e53-27b7ad15c567 at mountpoint /dev/vdb on host None. Jul 28 10:43:08 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4e5c41b0-dea2-4e88-84b8-ce204460257b tempest-VolumeQuotasNegativeTestJSON-975233469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-340f7526-98ab-4b81-835d-df27444c8adb" returned: 0 in 0.638s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:08 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4e5c41b0-dea2-4e88-84b8-ce204460257b tempest-VolumeQuotasNegativeTestJSON-975233469 None] Lock "cinder-quobyte-340f7526-98ab-4b81-835d-df27444c8adb" released by "delete_volume" :: held 1.288s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:43:08 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-50fba22b-254b-4cb2-9931-bea7d1d8b913 tempest-VolumesActionsTest-1170390702 None] Attach volume completed successfully. Jul 28 10:43:08 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-50fba22b-254b-4cb2-9931-bea7d1d8b913 tempest-VolumesActionsTest-1170390702 None] Lock "cinder-3fb0f975-0837-4556-b6b8-a887b89fe198" released by "attach_volume" :: held 0.263s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:43:09 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-4e5c41b0-dea2-4e88-84b8-ce204460257b tempest-VolumeQuotasNegativeTestJSON-975233469 None] Created reservations ['31f8a6d2-ca14-421d-9020-bdd6d87ed6e7', 'e95fff07-241d-411e-b78d-b144f8d5cf1f', '91eb89ad-4b83-450d-a566-cdf36effd80a', '2fff1ea9-e937-4392-a789-05f1454a300e'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:43:09 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-a163bff4-b134-4757-a933-fd69483d800e tempest-VolumesActionsTest-1170390702 None] Acquiring lock "cinder-3fb0f975-0837-4556-b6b8-a887b89fe198-detach_volume" by "detach_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:43:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-4e5c41b0-dea2-4e88-84b8-ce204460257b tempest-VolumeQuotasNegativeTestJSON-975233469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:43:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-4e5c41b0-dea2-4e88-84b8-ce204460257b tempest-VolumeQuotasNegativeTestJSON-975233469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:43:09 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-4e5c41b0-dea2-4e88-84b8-ce204460257b tempest-VolumeQuotasNegativeTestJSON-975233469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:43:09 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-4e5c41b0-dea2-4e88-84b8-ce204460257b tempest-VolumeQuotasNegativeTestJSON-975233469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:43:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-4e5c41b0-dea2-4e88-84b8-ce204460257b tempest-VolumeQuotasNegativeTestJSON-975233469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:43:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4e5c41b0-dea2-4e88-84b8-ce204460257b tempest-VolumeQuotasNegativeTestJSON-975233469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:09 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-a163bff4-b134-4757-a933-fd69483d800e tempest-VolumesActionsTest-1170390702 None] Lock "cinder-3fb0f975-0837-4556-b6b8-a887b89fe198-detach_volume" acquired by "detach_volume" :: waited 0.059s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:43:09 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-a163bff4-b134-4757-a933-fd69483d800e tempest-VolumesActionsTest-1170390702 None] Detaching volume 3fb0f975-0837-4556-b6b8-a887b89fe198 from instance 19a4a7bf-3960-42ff-9e53-27b7ad15c567. Jul 28 10:43:09 devstack sudo[97012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:43:09 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:09 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-a163bff4-b134-4757-a933-fd69483d800e tempest-VolumesActionsTest-1170390702 None] Detach volume completed successfully. Jul 28 10:43:09 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-a163bff4-b134-4757-a933-fd69483d800e tempest-VolumesActionsTest-1170390702 None] Lock "cinder-3fb0f975-0837-4556-b6b8-a887b89fe198-detach_volume" released by "detach_volume" :: held 0.132s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:43:09 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4e5c41b0-dea2-4e88-84b8-ce204460257b tempest-VolumeQuotasNegativeTestJSON-975233469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.348s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:09 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-4e5c41b0-dea2-4e88-84b8-ce204460257b tempest-VolumeQuotasNegativeTestJSON-975233469 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:43:09 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-4e5c41b0-dea2-4e88-84b8-ce204460257b tempest-VolumeQuotasNegativeTestJSON-975233469 None] Deleted volume successfully. Jul 28 10:43:09 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4e5c41b0-dea2-4e88-84b8-ce204460257b tempest-VolumeQuotasNegativeTestJSON-975233469 None] Lock "cinder-340f7526-98ab-4b81-835d-df27444c8adb-delete_volume" released by "delete_volume" :: held 2.120s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:43:19 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:UPDATE=123,cinder:SELECT=119,cinder:INSERT=29,cinder:DELETE=12 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:43:20 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-c167befd-56fc-4945-b027-6a16de05006b tempest-VolumesDeleteCascade-1527848463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:43:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c167befd-56fc-4945-b027-6a16de05006b tempest-VolumesDeleteCascade-1527848463 None] Flow 'volume_create_manager' (7fe8e27c-5374-4427-8ebe-a42c62c894ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:43:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c167befd-56fc-4945-b027-6a16de05006b tempest-VolumesDeleteCascade-1527848463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ecb8c65-79d5-4e54-90b3-98c9727cfbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:43:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c167befd-56fc-4945-b027-6a16de05006b tempest-VolumesDeleteCascade-1527848463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ecb8c65-79d5-4e54-90b3-98c9727cfbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1778474332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0480985c6b24e4eb8d6a49b9b2dfbaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:43:20Z,use_quota=True,user_id='051931c6b1aa4f4e9b124111a9a36f5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:43:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c167befd-56fc-4945-b027-6a16de05006b tempest-VolumesDeleteCascade-1527848463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (094d374f-957e-4638-ac1e-9c93245f1cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:43:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c167befd-56fc-4945-b027-6a16de05006b tempest-VolumesDeleteCascade-1527848463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (094d374f-957e-4638-ac1e-9c93245f1cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:43:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c167befd-56fc-4945-b027-6a16de05006b tempest-VolumesDeleteCascade-1527848463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c9781cb-ebc7-4b1e-898c-8fc5612e0d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:43:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c167befd-56fc-4945-b027-6a16de05006b tempest-VolumesDeleteCascade-1527848463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c9781cb-ebc7-4b1e-898c-8fc5612e0d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187', 'volume_name': 'volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:43:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c167befd-56fc-4945-b027-6a16de05006b tempest-VolumesDeleteCascade-1527848463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2fedeb5-71dd-404d-9f8c-f70a157f5f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:43:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c167befd-56fc-4945-b027-6a16de05006b tempest-VolumesDeleteCascade-1527848463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2fedeb5-71dd-404d-9f8c-f70a157f5f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:43:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c167befd-56fc-4945-b027-6a16de05006b tempest-VolumesDeleteCascade-1527848463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (060854d0-889c-4130-9504-ce22e784edf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:43:20 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-c167befd-56fc-4945-b027-6a16de05006b tempest-VolumesDeleteCascade-1527848463 None] Volume b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187', 'volume_size': 1} Jul 28 10:43:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c167befd-56fc-4945-b027-6a16de05006b tempest-VolumesDeleteCascade-1527848463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:43:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c167befd-56fc-4945-b027-6a16de05006b tempest-VolumesDeleteCascade-1527848463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:43:20 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c167befd-56fc-4945-b027-6a16de05006b tempest-VolumesDeleteCascade-1527848463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1778474332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0480985c6b24e4eb8d6a49b9b2dfbaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:43:20Z,use_quota=True,user_id='051931c6b1aa4f4e9b124111a9a36f5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:43:20 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-c167befd-56fc-4945-b027-6a16de05006b tempest-VolumesDeleteCascade-1527848463 None] Creating volume b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:43:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c167befd-56fc-4945-b027-6a16de05006b tempest-VolumesDeleteCascade-1527848463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:43:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c167befd-56fc-4945-b027-6a16de05006b tempest-VolumesDeleteCascade-1527848463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:43:20 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c167befd-56fc-4945-b027-6a16de05006b tempest-VolumesDeleteCascade-1527848463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:43:20 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c167befd-56fc-4945-b027-6a16de05006b tempest-VolumesDeleteCascade-1527848463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:43:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c167befd-56fc-4945-b027-6a16de05006b tempest-VolumesDeleteCascade-1527848463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:43:20 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c167befd-56fc-4945-b027-6a16de05006b tempest-VolumesDeleteCascade-1527848463 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:43:20 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-c167befd-56fc-4945-b027-6a16de05006b tempest-VolumesDeleteCascade-1527848463 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:43:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c167befd-56fc-4945-b027-6a16de05006b tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:20 devstack sudo[97134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187 1073741824 Jul 28 10:43:20 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:20 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c167befd-56fc-4945-b027-6a16de05006b tempest-VolumesDeleteCascade-1527848463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187 1073741824" returned: 0 in 0.666s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c167befd-56fc-4945-b027-6a16de05006b tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:21 devstack sudo[97178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187 Jul 28 10:43:21 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:21 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c167befd-56fc-4945-b027-6a16de05006b tempest-VolumesDeleteCascade-1527848463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187" returned: 0 in 0.509s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:21 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c167befd-56fc-4945-b027-6a16de05006b tempest-VolumesDeleteCascade-1527848463 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:43:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c167befd-56fc-4945-b027-6a16de05006b tempest-VolumesDeleteCascade-1527848463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:43:21 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c167befd-56fc-4945-b027-6a16de05006b tempest-VolumesDeleteCascade-1527848463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (060854d0-889c-4130-9504-ce22e784edf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:43:21 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c167befd-56fc-4945-b027-6a16de05006b tempest-VolumesDeleteCascade-1527848463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2cdb978-b152-475f-abb0-30cf4fa542aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:43:21 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-c167befd-56fc-4945-b027-6a16de05006b tempest-VolumesDeleteCascade-1527848463 None] Volume volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187 (b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187): created successfully Jul 28 10:43:21 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c167befd-56fc-4945-b027-6a16de05006b tempest-VolumesDeleteCascade-1527848463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2cdb978-b152-475f-abb0-30cf4fa542aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:43:21 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c167befd-56fc-4945-b027-6a16de05006b tempest-VolumesDeleteCascade-1527848463 None] Flow 'volume_create_manager' (7fe8e27c-5374-4427-8ebe-a42c62c894ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:43:21 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-c167befd-56fc-4945-b027-6a16de05006b tempest-VolumesDeleteCascade-1527848463 None] Created volume successfully. Jul 28 10:43:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5082fc48-9eda-4ae9-83c0-75f6565c1a1e tempest-VolumesDeleteCascade-1527848463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:43:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5082fc48-9eda-4ae9-83c0-75f6565c1a1e tempest-VolumesDeleteCascade-1527848463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:43:22 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-5082fc48-9eda-4ae9-83c0-75f6565c1a1e tempest-VolumesDeleteCascade-1527848463 None] Creating offline snapshot 704d9d88-0474-4416-b015-16531a5fd0c8 of volume b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187 {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:43:22 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[e544314c-8b7c-4daa-b169-a55e67f01df3]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:43:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5082fc48-9eda-4ae9-83c0-75f6565c1a1e tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:23 devstack sudo[97245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187 Jul 28 10:43:23 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:23 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5082fc48-9eda-4ae9-83c0-75f6565c1a1e tempest-VolumesDeleteCascade-1527848463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187" returned: 0 in 0.830s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5082fc48-9eda-4ae9-83c0-75f6565c1a1e tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.704d9d88-0474-4416-b015-16531a5fd0c8 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:23 devstack sudo[97273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.704d9d88-0474-4416-b015-16531a5fd0c8 1G Jul 28 10:43:23 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:24 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5082fc48-9eda-4ae9-83c0-75f6565c1a1e tempest-VolumesDeleteCascade-1527848463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.704d9d88-0474-4416-b015-16531a5fd0c8 1G" returned: 0 in 1.187s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5082fc48-9eda-4ae9-83c0-75f6565c1a1e tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.704d9d88-0474-4416-b015-16531a5fd0c8 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:24 devstack sudo[97300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.704d9d88-0474-4416-b015-16531a5fd0c8 Jul 28 10:43:24 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:25 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5082fc48-9eda-4ae9-83c0-75f6565c1a1e tempest-VolumesDeleteCascade-1527848463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.704d9d88-0474-4416-b015-16531a5fd0c8" returned: 0 in 0.538s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:25 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-5082fc48-9eda-4ae9-83c0-75f6565c1a1e tempest-VolumesDeleteCascade-1527848463 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.704d9d88-0474-4416-b015-16531a5fd0c8 is being set with open permissions: ugo+rw Jul 28 10:43:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5082fc48-9eda-4ae9-83c0-75f6565c1a1e tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.704d9d88-0474-4416-b015-16531a5fd0c8 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:25 devstack sudo[97306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.704d9d88-0474-4416-b015-16531a5fd0c8 Jul 28 10:43:25 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:25 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5082fc48-9eda-4ae9-83c0-75f6565c1a1e tempest-VolumesDeleteCascade-1527848463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.704d9d88-0474-4416-b015-16531a5fd0c8" returned: 0 in 0.453s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5082fc48-9eda-4ae9-83c0-75f6565c1a1e tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:26 devstack sudo[97309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.info Jul 28 10:43:26 devstack sudo[97309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:26 devstack sudo[97309]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5082fc48-9eda-4ae9-83c0-75f6565c1a1e tempest-VolumesDeleteCascade-1527848463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.info" returned: 0 in 0.812s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:26 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-5082fc48-9eda-4ae9-83c0-75f6565c1a1e tempest-VolumesDeleteCascade-1527848463 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.info is being set with open permissions: ugo+rw Jul 28 10:43:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5082fc48-9eda-4ae9-83c0-75f6565c1a1e tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:26 devstack sudo[97315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.info Jul 28 10:43:26 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:27 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-66d8eda2-5e3e-4c19-8d84-28683d0e287a tempest-SnapshotMetadataTestJSON-1584190256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:43:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-66d8eda2-5e3e-4c19-8d84-28683d0e287a tempest-SnapshotMetadataTestJSON-1584190256 None] Flow 'volume_create_manager' (b3244b13-b893-4997-8a82-cef9de23425b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:43:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-66d8eda2-5e3e-4c19-8d84-28683d0e287a tempest-SnapshotMetadataTestJSON-1584190256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (607338ce-1a64-4503-beef-23f4810e709f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:43:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-66d8eda2-5e3e-4c19-8d84-28683d0e287a tempest-SnapshotMetadataTestJSON-1584190256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (607338ce-1a64-4503-beef-23f4810e709f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-861616082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d313547-b560-49f6-9870-e190dae8fe77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5907facf21f3406894bbf3bbec7e31c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:43:27Z,use_quota=True,user_id='34173e2718a64c79b28400f3649bb463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:43:27 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-66d8eda2-5e3e-4c19-8d84-28683d0e287a tempest-SnapshotMetadataTestJSON-1584190256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdc0de9c-95fb-46be-bb73-395089ebe01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:43:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-66d8eda2-5e3e-4c19-8d84-28683d0e287a tempest-SnapshotMetadataTestJSON-1584190256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdc0de9c-95fb-46be-bb73-395089ebe01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:43:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-66d8eda2-5e3e-4c19-8d84-28683d0e287a tempest-SnapshotMetadataTestJSON-1584190256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bff7a7ac-22c6-406f-881e-7fef44c4ff5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:43:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-66d8eda2-5e3e-4c19-8d84-28683d0e287a tempest-SnapshotMetadataTestJSON-1584190256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bff7a7ac-22c6-406f-881e-7fef44c4ff5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d313547-b560-49f6-9870-e190dae8fe77', 'volume_name': 'volume-0d313547-b560-49f6-9870-e190dae8fe77', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:43:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-66d8eda2-5e3e-4c19-8d84-28683d0e287a tempest-SnapshotMetadataTestJSON-1584190256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daae23d6-6a51-4847-8221-f0aa172543f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:43:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-66d8eda2-5e3e-4c19-8d84-28683d0e287a tempest-SnapshotMetadataTestJSON-1584190256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daae23d6-6a51-4847-8221-f0aa172543f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:43:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-66d8eda2-5e3e-4c19-8d84-28683d0e287a tempest-SnapshotMetadataTestJSON-1584190256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b165657e-cfbb-440c-b4c5-3a4eaf964876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:43:27 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-66d8eda2-5e3e-4c19-8d84-28683d0e287a tempest-SnapshotMetadataTestJSON-1584190256 None] Volume 0d313547-b560-49f6-9870-e190dae8fe77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d313547-b560-49f6-9870-e190dae8fe77', 'volume_size': 1} Jul 28 10:43:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-66d8eda2-5e3e-4c19-8d84-28683d0e287a tempest-SnapshotMetadataTestJSON-1584190256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:43:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5082fc48-9eda-4ae9-83c0-75f6565c1a1e tempest-VolumesDeleteCascade-1527848463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.info" returned: 0 in 0.535s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5082fc48-9eda-4ae9-83c0-75f6565c1a1e tempest-VolumesDeleteCascade-1527848463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.551s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:43:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-66d8eda2-5e3e-4c19-8d84-28683d0e287a tempest-SnapshotMetadataTestJSON-1584190256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.032s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:43:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-66d8eda2-5e3e-4c19-8d84-28683d0e287a tempest-SnapshotMetadataTestJSON-1584190256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-861616082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d313547-b560-49f6-9870-e190dae8fe77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5907facf21f3406894bbf3bbec7e31c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:43:27Z,use_quota=True,user_id='34173e2718a64c79b28400f3649bb463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:43:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-66d8eda2-5e3e-4c19-8d84-28683d0e287a tempest-SnapshotMetadataTestJSON-1584190256 None] Creating volume 0d313547-b560-49f6-9870-e190dae8fe77 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:43:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-66d8eda2-5e3e-4c19-8d84-28683d0e287a tempest-SnapshotMetadataTestJSON-1584190256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:43:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-66d8eda2-5e3e-4c19-8d84-28683d0e287a tempest-SnapshotMetadataTestJSON-1584190256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:43:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-66d8eda2-5e3e-4c19-8d84-28683d0e287a tempest-SnapshotMetadataTestJSON-1584190256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:43:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-66d8eda2-5e3e-4c19-8d84-28683d0e287a tempest-SnapshotMetadataTestJSON-1584190256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:43:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-66d8eda2-5e3e-4c19-8d84-28683d0e287a tempest-SnapshotMetadataTestJSON-1584190256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:43:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-66d8eda2-5e3e-4c19-8d84-28683d0e287a tempest-SnapshotMetadataTestJSON-1584190256 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:43:27 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-66d8eda2-5e3e-4c19-8d84-28683d0e287a tempest-SnapshotMetadataTestJSON-1584190256 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:43:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-66d8eda2-5e3e-4c19-8d84-28683d0e287a tempest-SnapshotMetadataTestJSON-1584190256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:27 devstack sudo[97319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77 1073741824 Jul 28 10:43:27 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:27 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-5082fc48-9eda-4ae9-83c0-75f6565c1a1e tempest-VolumesDeleteCascade-1527848463 None] Create snapshot completed successfully Jul 28 10:43:28 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-66d8eda2-5e3e-4c19-8d84-28683d0e287a tempest-SnapshotMetadataTestJSON-1584190256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77 1073741824" returned: 0 in 0.732s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:28 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-2171123d-d303-40c9-8fd1-bc046c9eb2b3 tempest-VolumesActionsTest-1170390702 None] Acquiring lock "cinder-3fb0f975-0837-4556-b6b8-a887b89fe198" by "attach_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:43:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-66d8eda2-5e3e-4c19-8d84-28683d0e287a tempest-SnapshotMetadataTestJSON-1584190256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:28 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-2171123d-d303-40c9-8fd1-bc046c9eb2b3 tempest-VolumesActionsTest-1170390702 None] Lock "cinder-3fb0f975-0837-4556-b6b8-a887b89fe198" acquired by "attach_volume" :: waited 0.040s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:43:28 devstack sudo[97325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77 Jul 28 10:43:28 devstack sudo[97325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:28 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-2171123d-d303-40c9-8fd1-bc046c9eb2b3 tempest-VolumesActionsTest-1170390702 None] Attaching volume 3fb0f975-0837-4556-b6b8-a887b89fe198 to instance 02be9efd-a72a-4773-a438-6e67cf30c24a at mountpoint /dev/vdb on host None. Jul 28 10:43:28 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-2171123d-d303-40c9-8fd1-bc046c9eb2b3 tempest-VolumesActionsTest-1170390702 None] Attach volume completed successfully. Jul 28 10:43:28 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-2171123d-d303-40c9-8fd1-bc046c9eb2b3 tempest-VolumesActionsTest-1170390702 None] Lock "cinder-3fb0f975-0837-4556-b6b8-a887b89fe198" released by "attach_volume" :: held 0.195s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:43:28 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:43:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:43:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:43:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:43:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:43:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:43:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:28 devstack sudo[97328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:43:28 devstack sudo[97328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:28 devstack sudo[97325]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-66d8eda2-5e3e-4c19-8d84-28683d0e287a tempest-SnapshotMetadataTestJSON-1584190256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77" returned: 0 in 0.373s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-66d8eda2-5e3e-4c19-8d84-28683d0e287a tempest-SnapshotMetadataTestJSON-1584190256 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:43:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-66d8eda2-5e3e-4c19-8d84-28683d0e287a tempest-SnapshotMetadataTestJSON-1584190256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:43:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-66d8eda2-5e3e-4c19-8d84-28683d0e287a tempest-SnapshotMetadataTestJSON-1584190256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b165657e-cfbb-440c-b4c5-3a4eaf964876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d313547-b560-49f6-9870-e190dae8fe77', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:43:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-66d8eda2-5e3e-4c19-8d84-28683d0e287a tempest-SnapshotMetadataTestJSON-1584190256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77fb9451-428c-4027-84b7-855d8b87fc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:43:28 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-66d8eda2-5e3e-4c19-8d84-28683d0e287a tempest-SnapshotMetadataTestJSON-1584190256 None] Volume volume-0d313547-b560-49f6-9870-e190dae8fe77 (0d313547-b560-49f6-9870-e190dae8fe77): created successfully Jul 28 10:43:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-66d8eda2-5e3e-4c19-8d84-28683d0e287a tempest-SnapshotMetadataTestJSON-1584190256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77fb9451-428c-4027-84b7-855d8b87fc19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:43:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-66d8eda2-5e3e-4c19-8d84-28683d0e287a tempest-SnapshotMetadataTestJSON-1584190256 None] Flow 'volume_create_manager' (b3244b13-b893-4997-8a82-cef9de23425b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:43:28 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-66d8eda2-5e3e-4c19-8d84-28683d0e287a tempest-SnapshotMetadataTestJSON-1584190256 None] Created volume successfully. Jul 28 10:43:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-45e204b1-782c-4b27-b664-e55471104cd6 tempest-VolumesDeleteCascade-1527848463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:43:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-45e204b1-782c-4b27-b664-e55471104cd6 tempest-VolumesDeleteCascade-1527848463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:43:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-45e204b1-782c-4b27-b664-e55471104cd6 tempest-VolumesDeleteCascade-1527848463 None] Creating offline snapshot 0e2c5e7b-b4a9-4509-90b7-74e1ab5c8aaf of volume b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187 {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:43:28 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b3ca7b35-e856-4eca-8204-aae541eaa096 tempest-VolumesActionsTest-1170390702 None] Acquiring lock "cinder-3fb0f975-0837-4556-b6b8-a887b89fe198-detach_volume" by "detach_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:43:28 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[036ee244-f42f-49ff-8bcb-44b89b34f3fb]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:43:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-45e204b1-782c-4b27-b664-e55471104cd6 tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.704d9d88-0474-4416-b015-16531a5fd0c8 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:28 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b3ca7b35-e856-4eca-8204-aae541eaa096 tempest-VolumesActionsTest-1170390702 None] Lock "cinder-3fb0f975-0837-4556-b6b8-a887b89fe198-detach_volume" acquired by "detach_volume" :: waited 0.057s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:43:28 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-b3ca7b35-e856-4eca-8204-aae541eaa096 tempest-VolumesActionsTest-1170390702 None] Detaching volume 3fb0f975-0837-4556-b6b8-a887b89fe198 from instance 02be9efd-a72a-4773-a438-6e67cf30c24a. Jul 28 10:43:29 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-b3ca7b35-e856-4eca-8204-aae541eaa096 tempest-VolumesActionsTest-1170390702 None] Detach volume completed successfully. Jul 28 10:43:29 devstack sudo[97328]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.656s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:29 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:43:29 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b3ca7b35-e856-4eca-8204-aae541eaa096 tempest-VolumesActionsTest-1170390702 None] Lock "cinder-3fb0f975-0837-4556-b6b8-a887b89fe198-detach_volume" released by "detach_volume" :: held 0.181s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:43:29 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager._thread_info {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:43:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread count: 8 {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 10:43:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread info: [<_MainThread(MainThread, started 137939890385024)>, , , , , , , ] {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 10:43:29 devstack sudo[97330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.704d9d88-0474-4416-b015-16531a5fd0c8 Jul 28 10:43:29 devstack sudo[97330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:29 devstack sudo[97330]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-45e204b1-782c-4b27-b664-e55471104cd6 tempest-VolumesDeleteCascade-1527848463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.704d9d88-0474-4416-b015-16531a5fd0c8" returned: 0 in 0.757s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:29 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-45e204b1-782c-4b27-b664-e55471104cd6 tempest-VolumesDeleteCascade-1527848463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:43:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-45e204b1-782c-4b27-b664-e55471104cd6 tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.704d9d88-0474-4416-b015-16531a5fd0c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.0e2c5e7b-b4a9-4509-90b7-74e1ab5c8aaf 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:29 devstack sudo[97337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.704d9d88-0474-4416-b015-16531a5fd0c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.0e2c5e7b-b4a9-4509-90b7-74e1ab5c8aaf 1G Jul 28 10:43:29 devstack sudo[97337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3652cf10-5fc6-4108-8462-b798963f7c0b tempest-SnapshotMetadataTestJSON-1584190256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:43:30 devstack sudo[97337]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-45e204b1-782c-4b27-b664-e55471104cd6 tempest-VolumesDeleteCascade-1527848463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.704d9d88-0474-4416-b015-16531a5fd0c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.0e2c5e7b-b4a9-4509-90b7-74e1ab5c8aaf 1G" returned: 0 in 0.555s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-45e204b1-782c-4b27-b664-e55471104cd6 tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.704d9d88-0474-4416-b015-16531a5fd0c8 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.0e2c5e7b-b4a9-4509-90b7-74e1ab5c8aaf {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:30 devstack sudo[97355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.704d9d88-0474-4416-b015-16531a5fd0c8 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.0e2c5e7b-b4a9-4509-90b7-74e1ab5c8aaf Jul 28 10:43:30 devstack sudo[97355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:30 devstack sudo[97355]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-45e204b1-782c-4b27-b664-e55471104cd6 tempest-VolumesDeleteCascade-1527848463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.704d9d88-0474-4416-b015-16531a5fd0c8 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.0e2c5e7b-b4a9-4509-90b7-74e1ab5c8aaf" returned: 0 in 0.473s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:30 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-45e204b1-782c-4b27-b664-e55471104cd6 tempest-VolumesDeleteCascade-1527848463 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.0e2c5e7b-b4a9-4509-90b7-74e1ab5c8aaf is being set with open permissions: ugo+rw Jul 28 10:43:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-45e204b1-782c-4b27-b664-e55471104cd6 tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.0e2c5e7b-b4a9-4509-90b7-74e1ab5c8aaf {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:30 devstack sudo[97373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.0e2c5e7b-b4a9-4509-90b7-74e1ab5c8aaf Jul 28 10:43:30 devstack sudo[97373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:30 devstack sudo[97373]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-45e204b1-782c-4b27-b664-e55471104cd6 tempest-VolumesDeleteCascade-1527848463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.0e2c5e7b-b4a9-4509-90b7-74e1ab5c8aaf" returned: 0 in 0.321s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-45e204b1-782c-4b27-b664-e55471104cd6 tempest-VolumesDeleteCascade-1527848463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.287s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:43:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3652cf10-5fc6-4108-8462-b798963f7c0b tempest-SnapshotMetadataTestJSON-1584190256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.333s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:43:31 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-3652cf10-5fc6-4108-8462-b798963f7c0b tempest-SnapshotMetadataTestJSON-1584190256 None] Creating offline snapshot 6f7a611c-eeb5-4872-acd0-673248b5ff03 of volume 0d313547-b560-49f6-9870-e190dae8fe77 {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:43:31 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-45e204b1-782c-4b27-b664-e55471104cd6 tempest-VolumesDeleteCascade-1527848463 None] Create snapshot completed successfully Jul 28 10:43:31 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16a14e5-cc0e-44cc-842a-a930673a5798]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:43:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3652cf10-5fc6-4108-8462-b798963f7c0b tempest-SnapshotMetadataTestJSON-1584190256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:31 devstack sudo[97377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77 Jul 28 10:43:31 devstack sudo[97377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:31 devstack sudo[97377]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3652cf10-5fc6-4108-8462-b798963f7c0b tempest-SnapshotMetadataTestJSON-1584190256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77" returned: 0 in 0.497s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3652cf10-5fc6-4108-8462-b798963f7c0b tempest-SnapshotMetadataTestJSON-1584190256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77.6f7a611c-eeb5-4872-acd0-673248b5ff03 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:31 devstack sudo[97383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77.6f7a611c-eeb5-4872-acd0-673248b5ff03 1G Jul 28 10:43:31 devstack sudo[97383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:32 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Acquiring lock "cinder-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:43:32 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Lock "cinder-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:43:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Performing cascade delete. {{(pid=88413) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 28 10:43:32 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Acquiring lock "cinder-0e2c5e7b-b4a9-4509-90b7-74e1ab5c8aaf-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:43:32 devstack sudo[97383]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3652cf10-5fc6-4108-8462-b798963f7c0b tempest-SnapshotMetadataTestJSON-1584190256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77.6f7a611c-eeb5-4872-acd0-673248b5ff03 1G" returned: 0 in 0.492s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3652cf10-5fc6-4108-8462-b798963f7c0b tempest-SnapshotMetadataTestJSON-1584190256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d313547-b560-49f6-9870-e190dae8fe77 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77.6f7a611c-eeb5-4872-acd0-673248b5ff03 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:32 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Lock "cinder-0e2c5e7b-b4a9-4509-90b7-74e1ab5c8aaf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:43:32 devstack sudo[97389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d313547-b560-49f6-9870-e190dae8fe77 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77.6f7a611c-eeb5-4872-acd0-673248b5ff03 Jul 28 10:43:32 devstack sudo[97389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:32 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Acquiring lock "cinder-quobyte-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:43:32 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Lock "cinder-quobyte-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:43:32 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Acquiring lock "cinder-quobyte-0e2c5e7b-b4a9-4509-90b7-74e1ab5c8aaf" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:43:32 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Lock "cinder-quobyte-0e2c5e7b-b4a9-4509-90b7-74e1ab5c8aaf" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:43:32 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Deleting offline snapshot 0e2c5e7b-b4a9-4509-90b7-74e1ab5c8aaf of volume b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:43:32 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] snapshot_file for this snap is: volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.0e2c5e7b-b4a9-4509-90b7-74e1ab5c8aaf {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:43:32 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a30e7b7-71eb-43bf-8a2b-f33076a9d337]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:43:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.0e2c5e7b-b4a9-4509-90b7-74e1ab5c8aaf {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:32 devstack sudo[97391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.0e2c5e7b-b4a9-4509-90b7-74e1ab5c8aaf Jul 28 10:43:32 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:32 devstack sudo[97389]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3652cf10-5fc6-4108-8462-b798963f7c0b tempest-SnapshotMetadataTestJSON-1584190256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d313547-b560-49f6-9870-e190dae8fe77 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77.6f7a611c-eeb5-4872-acd0-673248b5ff03" returned: 0 in 0.411s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:32 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-3652cf10-5fc6-4108-8462-b798963f7c0b tempest-SnapshotMetadataTestJSON-1584190256 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77.6f7a611c-eeb5-4872-acd0-673248b5ff03 is being set with open permissions: ugo+rw Jul 28 10:43:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3652cf10-5fc6-4108-8462-b798963f7c0b tempest-SnapshotMetadataTestJSON-1584190256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77.6f7a611c-eeb5-4872-acd0-673248b5ff03 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:32 devstack sudo[97397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77.6f7a611c-eeb5-4872-acd0-673248b5ff03 Jul 28 10:43:32 devstack sudo[97397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:32 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.0e2c5e7b-b4a9-4509-90b7-74e1ab5c8aaf" returned: 0 in 0.539s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:32 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:43:32 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac92d0e-01fb-4372-9557-f0577be35c11]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:43:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.704d9d88-0474-4416-b015-16531a5fd0c8 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:32 devstack sudo[97397]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3652cf10-5fc6-4108-8462-b798963f7c0b tempest-SnapshotMetadataTestJSON-1584190256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77.6f7a611c-eeb5-4872-acd0-673248b5ff03" returned: 0 in 0.393s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3652cf10-5fc6-4108-8462-b798963f7c0b tempest-SnapshotMetadataTestJSON-1584190256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:32 devstack sudo[97408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.704d9d88-0474-4416-b015-16531a5fd0c8 Jul 28 10:43:32 devstack sudo[97408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:33 devstack sudo[97410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77.info Jul 28 10:43:33 devstack sudo[97410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:33 devstack sudo[97410]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:33 devstack sudo[97408]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.704d9d88-0474-4416-b015-16531a5fd0c8" returned: 0 in 0.478s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3652cf10-5fc6-4108-8462-b798963f7c0b tempest-SnapshotMetadataTestJSON-1584190256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77.info" returned: 0 in 0.345s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:33 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:43:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.0e2c5e7b-b4a9-4509-90b7-74e1ab5c8aaf {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:33 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-3652cf10-5fc6-4108-8462-b798963f7c0b tempest-SnapshotMetadataTestJSON-1584190256 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77.info is being set with open permissions: ugo+rw Jul 28 10:43:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3652cf10-5fc6-4108-8462-b798963f7c0b tempest-SnapshotMetadataTestJSON-1584190256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:33 devstack sudo[97418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.0e2c5e7b-b4a9-4509-90b7-74e1ab5c8aaf Jul 28 10:43:33 devstack sudo[97418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:33 devstack sudo[97419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77.info Jul 28 10:43:33 devstack sudo[97419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:33 devstack sudo[97419]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3652cf10-5fc6-4108-8462-b798963f7c0b tempest-SnapshotMetadataTestJSON-1584190256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77.info" returned: 0 in 0.311s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3652cf10-5fc6-4108-8462-b798963f7c0b tempest-SnapshotMetadataTestJSON-1584190256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.624s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:43:33 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-3652cf10-5fc6-4108-8462-b798963f7c0b tempest-SnapshotMetadataTestJSON-1584190256 None] Create snapshot completed successfully Jul 28 10:43:33 devstack sudo[97418]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.0e2c5e7b-b4a9-4509-90b7-74e1ab5c8aaf" returned: 0 in 0.501s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.0e2c5e7b-b4a9-4509-90b7-74e1ab5c8aaf {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:33 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.0e2c5e7b-b4a9-4509-90b7-74e1ab5c8aaf Jul 28 10:43:33 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:34 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.0e2c5e7b-b4a9-4509-90b7-74e1ab5c8aaf" returned: 0 in 0.328s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:34 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Lock "cinder-quobyte-0e2c5e7b-b4a9-4509-90b7-74e1ab5c8aaf" released by "_delete_snapshot" :: held 2.001s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:43:34 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Lock "cinder-quobyte-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187" released by "delete_snapshot" :: held 2.033s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:43:34 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Created reservations ['feedf551-b4e6-4c25-9190-3f8ff3fc6fc8', 'd6fde5a9-5d6f-4f8f-bcca-9fa1bd536681', '772c7342-4862-4602-aeab-26f9aa6e8b1d', '25788f01-c6f2-4f9d-a79a-ec03d0850807'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:43:34 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Delete snapshot completed successfully. Jul 28 10:43:34 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Lock "cinder-0e2c5e7b-b4a9-4509-90b7-74e1ab5c8aaf-delete_snapshot" released by "delete_snapshot" :: held 2.263s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:43:34 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Acquiring lock "cinder-704d9d88-0474-4416-b015-16531a5fd0c8-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:43:34 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Lock "cinder-704d9d88-0474-4416-b015-16531a5fd0c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:43:34 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Acquiring lock "cinder-quobyte-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:43:34 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Lock "cinder-quobyte-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:43:34 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Acquiring lock "cinder-quobyte-704d9d88-0474-4416-b015-16531a5fd0c8" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:43:34 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Lock "cinder-quobyte-704d9d88-0474-4416-b015-16531a5fd0c8" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:43:34 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Deleting offline snapshot 704d9d88-0474-4416-b015-16531a5fd0c8 of volume b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:43:34 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] snapshot_file for this snap is: volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.704d9d88-0474-4416-b015-16531a5fd0c8 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:43:34 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[3693afe8-57a5-4967-9c15-0ce03cee47ff]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:43:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.704d9d88-0474-4416-b015-16531a5fd0c8 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f2aaa3d0-9e5b-4669-ac40-943a649ad94f tempest-VolumesActionsTest-1170390702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:43:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f2aaa3d0-9e5b-4669-ac40-943a649ad94f tempest-VolumesActionsTest-1170390702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:43:34 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[7318a43c-e99b-41be-93ae-c94060cdbce5]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:43:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f2aaa3d0-9e5b-4669-ac40-943a649ad94f tempest-VolumesActionsTest-1170390702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3fb0f975-0837-4556-b6b8-a887b89fe198 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:34 devstack sudo[97430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.704d9d88-0474-4416-b015-16531a5fd0c8 Jul 28 10:43:34 devstack sudo[97430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:34 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-c44c5494-2ae6-425f-b8a9-603ba0d46ca1 tempest-SnapshotMetadataTestJSON-1584190256 None] Acquiring lock "cinder-6f7a611c-eeb5-4872-acd0-673248b5ff03-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:43:34 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-c44c5494-2ae6-425f-b8a9-603ba0d46ca1 tempest-SnapshotMetadataTestJSON-1584190256 None] Lock "cinder-6f7a611c-eeb5-4872-acd0-673248b5ff03-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:43:34 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-c44c5494-2ae6-425f-b8a9-603ba0d46ca1 tempest-SnapshotMetadataTestJSON-1584190256 None] Acquiring lock "cinder-quobyte-0d313547-b560-49f6-9870-e190dae8fe77" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:43:34 devstack sudo[97432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3fb0f975-0837-4556-b6b8-a887b89fe198 Jul 28 10:43:34 devstack sudo[97432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:34 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-c44c5494-2ae6-425f-b8a9-603ba0d46ca1 tempest-SnapshotMetadataTestJSON-1584190256 None] Lock "cinder-quobyte-0d313547-b560-49f6-9870-e190dae8fe77" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:43:34 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-c44c5494-2ae6-425f-b8a9-603ba0d46ca1 tempest-SnapshotMetadataTestJSON-1584190256 None] Acquiring lock "cinder-quobyte-6f7a611c-eeb5-4872-acd0-673248b5ff03" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:43:34 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-c44c5494-2ae6-425f-b8a9-603ba0d46ca1 tempest-SnapshotMetadataTestJSON-1584190256 None] Lock "cinder-quobyte-6f7a611c-eeb5-4872-acd0-673248b5ff03" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:43:34 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-c44c5494-2ae6-425f-b8a9-603ba0d46ca1 tempest-SnapshotMetadataTestJSON-1584190256 None] Deleting offline snapshot 6f7a611c-eeb5-4872-acd0-673248b5ff03 of volume 0d313547-b560-49f6-9870-e190dae8fe77 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:43:35 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-c44c5494-2ae6-425f-b8a9-603ba0d46ca1 tempest-SnapshotMetadataTestJSON-1584190256 None] snapshot_file for this snap is: volume-0d313547-b560-49f6-9870-e190dae8fe77.6f7a611c-eeb5-4872-acd0-673248b5ff03 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:43:35 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[825a1a18-4ab5-46cc-802c-fa3537cf0429]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:43:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c44c5494-2ae6-425f-b8a9-603ba0d46ca1 tempest-SnapshotMetadataTestJSON-1584190256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77.6f7a611c-eeb5-4872-acd0-673248b5ff03 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:35 devstack sudo[97430]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.704d9d88-0474-4416-b015-16531a5fd0c8" returned: 0 in 0.525s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:35 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:43:35 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[58639f3c-028f-4e45-b784-3b30d6f05d49]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:43:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:35 devstack sudo[97437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77.6f7a611c-eeb5-4872-acd0-673248b5ff03 Jul 28 10:43:35 devstack sudo[97437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:35 devstack sudo[97439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187 Jul 28 10:43:35 devstack sudo[97439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:35 devstack sudo[97432]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f2aaa3d0-9e5b-4669-ac40-943a649ad94f tempest-VolumesActionsTest-1170390702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3fb0f975-0837-4556-b6b8-a887b89fe198" returned: 0 in 0.526s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:35 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d645bf-174c-40a0-aa5e-a05c3fc3e0ab]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:43:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f2aaa3d0-9e5b-4669-ac40-943a649ad94f tempest-VolumesActionsTest-1170390702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3fb0f975-0837-4556-b6b8-a887b89fe198 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:35 devstack sudo[97446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3fb0f975-0837-4556-b6b8-a887b89fe198 Jul 28 10:43:35 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:35 devstack sudo[97437]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c44c5494-2ae6-425f-b8a9-603ba0d46ca1 tempest-SnapshotMetadataTestJSON-1584190256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77.6f7a611c-eeb5-4872-acd0-673248b5ff03" returned: 0 in 0.551s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:35 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-c44c5494-2ae6-425f-b8a9-603ba0d46ca1 tempest-SnapshotMetadataTestJSON-1584190256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d313547-b560-49f6-9870-e190dae8fe77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:43:35 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9105cc-3821-452a-8153-7395399749ca]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:43:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c44c5494-2ae6-425f-b8a9-603ba0d46ca1 tempest-SnapshotMetadataTestJSON-1584190256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:35 devstack sudo[97439]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187" returned: 0 in 0.559s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.704d9d88-0474-4416-b015-16531a5fd0c8 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:35 devstack sudo[97457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.704d9d88-0474-4416-b015-16531a5fd0c8 Jul 28 10:43:35 devstack sudo[97457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:35 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f2aaa3d0-9e5b-4669-ac40-943a649ad94f tempest-VolumesActionsTest-1170390702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3fb0f975-0837-4556-b6b8-a887b89fe198" returned: 0 in 0.538s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f2aaa3d0-9e5b-4669-ac40-943a649ad94f tempest-VolumesActionsTest-1170390702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3fb0f975-0837-4556-b6b8-a887b89fe198 /opt/stack/data/cinder/conversion/3fb0f975-0837-4556-b6b8-a887b89fe198.temp_image.a6d73742-8960-44d7-a8ce-c2ec58fc54409d52wzb2.img {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:35 devstack sudo[97462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3fb0f975-0837-4556-b6b8-a887b89fe198 /opt/stack/data/cinder/conversion/3fb0f975-0837-4556-b6b8-a887b89fe198.temp_image.a6d73742-8960-44d7-a8ce-c2ec58fc54409d52wzb2.img Jul 28 10:43:35 devstack sudo[97462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:35 devstack sudo[97456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77 Jul 28 10:43:35 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:36 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c44c5494-2ae6-425f-b8a9-603ba0d46ca1 tempest-SnapshotMetadataTestJSON-1584190256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77" returned: 0 in 0.588s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c44c5494-2ae6-425f-b8a9-603ba0d46ca1 tempest-SnapshotMetadataTestJSON-1584190256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77.6f7a611c-eeb5-4872-acd0-673248b5ff03 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:36 devstack sudo[97475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77.6f7a611c-eeb5-4872-acd0-673248b5ff03 Jul 28 10:43:36 devstack sudo[97475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:36 devstack sudo[97457]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.704d9d88-0474-4416-b015-16531a5fd0c8" returned: 0 in 0.616s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.704d9d88-0474-4416-b015-16531a5fd0c8 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:36 devstack sudo[97481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.704d9d88-0474-4416-b015-16531a5fd0c8 Jul 28 10:43:36 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:37 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187.704d9d88-0474-4416-b015-16531a5fd0c8" returned: 0 in 1.117s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:37 devstack sudo[97475]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:37 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Lock "cinder-quobyte-704d9d88-0474-4416-b015-16531a5fd0c8" released by "_delete_snapshot" :: held 3.008s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:43:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c44c5494-2ae6-425f-b8a9-603ba0d46ca1 tempest-SnapshotMetadataTestJSON-1584190256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77.6f7a611c-eeb5-4872-acd0-673248b5ff03" returned: 0 in 1.322s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c44c5494-2ae6-425f-b8a9-603ba0d46ca1 tempest-SnapshotMetadataTestJSON-1584190256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77.6f7a611c-eeb5-4872-acd0-673248b5ff03 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:37 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Lock "cinder-quobyte-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187" released by "delete_snapshot" :: held 3.101s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:43:37 devstack sudo[97500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77.6f7a611c-eeb5-4872-acd0-673248b5ff03 Jul 28 10:43:37 devstack sudo[97500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:37 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Created reservations ['286b5bc9-19ca-40c8-80e5-98ce7332c3bc', '56c05cb8-a7e3-406e-a7d5-8f88a1dd1dbf', 'a497c2d2-c110-40ae-b014-b0b773fcc2eb', '42ab5534-cafe-4bab-93c9-3a8ed993bc24'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:43:37 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Delete snapshot completed successfully. Jul 28 10:43:38 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Lock "cinder-704d9d88-0474-4416-b015-16531a5fd0c8-delete_snapshot" released by "delete_snapshot" :: held 3.575s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:43:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Snapshots deleted, issuing volume delete {{(pid=88413) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 28 10:43:38 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Acquiring lock "cinder-quobyte-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:43:38 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Lock "cinder-quobyte-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187" acquired by "delete_volume" :: waited 0.034s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:43:38 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd743b95-514b-45ff-b498-7c659a9d08ca]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:43:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:38 devstack sudo[97500]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c44c5494-2ae6-425f-b8a9-603ba0d46ca1 tempest-SnapshotMetadataTestJSON-1584190256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77.6f7a611c-eeb5-4872-acd0-673248b5ff03" returned: 0 in 0.757s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:38 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-c44c5494-2ae6-425f-b8a9-603ba0d46ca1 tempest-SnapshotMetadataTestJSON-1584190256 None] Lock "cinder-quobyte-6f7a611c-eeb5-4872-acd0-673248b5ff03" released by "_delete_snapshot" :: held 3.424s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:43:38 devstack sudo[97503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187 Jul 28 10:43:38 devstack sudo[97503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:38 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-c44c5494-2ae6-425f-b8a9-603ba0d46ca1 tempest-SnapshotMetadataTestJSON-1584190256 None] Lock "cinder-quobyte-0d313547-b560-49f6-9870-e190dae8fe77" released by "delete_snapshot" :: held 3.480s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:43:38 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-c44c5494-2ae6-425f-b8a9-603ba0d46ca1 tempest-SnapshotMetadataTestJSON-1584190256 None] Created reservations ['10d86f59-5482-4b9a-9db9-f9840bf949b4', 'ed47e392-61a3-4275-8161-539563af30ec', 'd576b914-ccd2-463d-b41d-0aa8b84863cf', '2e11fe74-c244-4ad4-bf52-84e0be67b605'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:43:38 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-c44c5494-2ae6-425f-b8a9-603ba0d46ca1 tempest-SnapshotMetadataTestJSON-1584190256 None] Delete snapshot completed successfully. Jul 28 10:43:38 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-c44c5494-2ae6-425f-b8a9-603ba0d46ca1 tempest-SnapshotMetadataTestJSON-1584190256 None] Lock "cinder-6f7a611c-eeb5-4872-acd0-673248b5ff03-delete_snapshot" released by "delete_snapshot" :: held 3.797s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:43:39 devstack sudo[97503]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187" returned: 0 in 0.992s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:39 devstack sudo[97510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187 Jul 28 10:43:39 devstack sudo[97510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:39 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e135b62b-bdcb-4b61-a9cc-aea36c1cf3f0 tempest-SnapshotMetadataTestJSON-1584190256 None] Acquiring lock "cinder-0d313547-b560-49f6-9870-e190dae8fe77-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:43:39 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e135b62b-bdcb-4b61-a9cc-aea36c1cf3f0 tempest-SnapshotMetadataTestJSON-1584190256 None] Lock "cinder-0d313547-b560-49f6-9870-e190dae8fe77-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:43:39 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e135b62b-bdcb-4b61-a9cc-aea36c1cf3f0 tempest-SnapshotMetadataTestJSON-1584190256 None] Acquiring lock "cinder-quobyte-0d313547-b560-49f6-9870-e190dae8fe77" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:43:39 devstack sudo[97510]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187" returned: 0 in 0.708s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:39 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e135b62b-bdcb-4b61-a9cc-aea36c1cf3f0 tempest-SnapshotMetadataTestJSON-1584190256 None] Lock "cinder-quobyte-0d313547-b560-49f6-9870-e190dae8fe77" acquired by "delete_volume" :: waited 0.098s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:43:39 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Lock "cinder-quobyte-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187" released by "delete_volume" :: held 1.951s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:43:40 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[2433e1a2-3ba6-4868-bbae-6ffb21ea6740]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:43:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e135b62b-bdcb-4b61-a9cc-aea36c1cf3f0 tempest-SnapshotMetadataTestJSON-1584190256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:40 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Created reservations ['aa3db77d-e990-47b7-b578-2fb9be2f68cf', '46c3f24b-6efd-470d-b367-0bbcb7ef8eda', 'a47e3a61-c65f-489d-9965-801c68ffab97', 'bfd64cbf-475c-432c-802e-718fd5b79dff'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:43:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:43:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:43:40 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:43:40 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:43:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:43:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:40 devstack sudo[97515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:43:40 devstack sudo[97515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:40 devstack sudo[97514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77 Jul 28 10:43:40 devstack sudo[97514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:40 devstack sudo[97515]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.369s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:40 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:43:40 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Deleted volume successfully. Jul 28 10:43:40 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-65b592d9-e8db-4fd8-aacf-abb83a0cf572 tempest-VolumesDeleteCascade-1527848463 None] Lock "cinder-b9e00b3b-ed0c-4cfe-b7e3-c3081bbd8187-delete_volume" released by "delete_volume" :: held 8.671s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:43:41 devstack sudo[97514]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e135b62b-bdcb-4b61-a9cc-aea36c1cf3f0 tempest-SnapshotMetadataTestJSON-1584190256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77" returned: 0 in 1.259s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e135b62b-bdcb-4b61-a9cc-aea36c1cf3f0 tempest-SnapshotMetadataTestJSON-1584190256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:41 devstack sudo[97462]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:41 devstack sudo[97522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77 Jul 28 10:43:41 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f2aaa3d0-9e5b-4669-ac40-943a649ad94f tempest-VolumesActionsTest-1170390702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3fb0f975-0837-4556-b6b8-a887b89fe198 /opt/stack/data/cinder/conversion/3fb0f975-0837-4556-b6b8-a887b89fe198.temp_image.a6d73742-8960-44d7-a8ce-c2ec58fc54409d52wzb2.img" returned: 0 in 5.509s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:41 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60808df-c68d-48ab-98c1-5c721a12690b]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:43:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f2aaa3d0-9e5b-4669-ac40-943a649ad94f tempest-VolumesActionsTest-1170390702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3fb0f975-0837-4556-b6b8-a887b89fe198 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:41 devstack sudo[97524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3fb0f975-0837-4556-b6b8-a887b89fe198 Jul 28 10:43:41 devstack sudo[97524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:41 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e135b62b-bdcb-4b61-a9cc-aea36c1cf3f0 tempest-SnapshotMetadataTestJSON-1584190256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0d313547-b560-49f6-9870-e190dae8fe77" returned: 0 in 0.279s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:41 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e135b62b-bdcb-4b61-a9cc-aea36c1cf3f0 tempest-SnapshotMetadataTestJSON-1584190256 None] Lock "cinder-quobyte-0d313547-b560-49f6-9870-e190dae8fe77" released by "delete_volume" :: held 1.667s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:43:41 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-e135b62b-bdcb-4b61-a9cc-aea36c1cf3f0 tempest-SnapshotMetadataTestJSON-1584190256 None] Created reservations ['838038a7-d1d8-4a6c-93f3-059ed2d3c118', 'b6f3187a-10b9-471e-863e-b5d3c4f713c6', '0351a0d2-c401-4674-8953-251a6c59e839', '6ed732a3-8388-475b-814f-cb293bdaedb6'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:43:41 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-cce31353-6665-472a-b9d7-b4f0b7fa9ff0 tempest-VolumesDeleteCascade-1527848463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:43:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cce31353-6665-472a-b9d7-b4f0b7fa9ff0 tempest-VolumesDeleteCascade-1527848463 None] Flow 'volume_create_manager' (7db7fe40-6921-49cb-a715-3ed091d46680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:43:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cce31353-6665-472a-b9d7-b4f0b7fa9ff0 tempest-VolumesDeleteCascade-1527848463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05f2c003-99b1-494f-b551-91fb15f1e8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:43:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cce31353-6665-472a-b9d7-b4f0b7fa9ff0 tempest-VolumesDeleteCascade-1527848463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05f2c003-99b1-494f-b551-91fb15f1e8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1288110606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6802819a-abfa-4f20-9054-6dd97d5713dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0480985c6b24e4eb8d6a49b9b2dfbaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:43:42Z,use_quota=True,user_id='051931c6b1aa4f4e9b124111a9a36f5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:43:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cce31353-6665-472a-b9d7-b4f0b7fa9ff0 tempest-VolumesDeleteCascade-1527848463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ed3af49-e8cc-42d7-be45-fda202e9305e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:43:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cce31353-6665-472a-b9d7-b4f0b7fa9ff0 tempest-VolumesDeleteCascade-1527848463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ed3af49-e8cc-42d7-be45-fda202e9305e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:43:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cce31353-6665-472a-b9d7-b4f0b7fa9ff0 tempest-VolumesDeleteCascade-1527848463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ab9d9de-dfa4-4b16-9e94-d110fd9dc8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:43:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cce31353-6665-472a-b9d7-b4f0b7fa9ff0 tempest-VolumesDeleteCascade-1527848463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ab9d9de-dfa4-4b16-9e94-d110fd9dc8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6802819a-abfa-4f20-9054-6dd97d5713dd', 'volume_name': 'volume-6802819a-abfa-4f20-9054-6dd97d5713dd', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:43:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cce31353-6665-472a-b9d7-b4f0b7fa9ff0 tempest-VolumesDeleteCascade-1527848463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0270f5eb-e2ef-4351-9957-1724114ec0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:43:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cce31353-6665-472a-b9d7-b4f0b7fa9ff0 tempest-VolumesDeleteCascade-1527848463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0270f5eb-e2ef-4351-9957-1724114ec0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:43:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cce31353-6665-472a-b9d7-b4f0b7fa9ff0 tempest-VolumesDeleteCascade-1527848463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1abcebfa-48f0-495b-9235-1f7ddf69e26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:43:41 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-cce31353-6665-472a-b9d7-b4f0b7fa9ff0 tempest-VolumesDeleteCascade-1527848463 None] Volume 6802819a-abfa-4f20-9054-6dd97d5713dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6802819a-abfa-4f20-9054-6dd97d5713dd', 'volume_size': 1} Jul 28 10:43:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-cce31353-6665-472a-b9d7-b4f0b7fa9ff0 tempest-VolumesDeleteCascade-1527848463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:43:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e135b62b-bdcb-4b61-a9cc-aea36c1cf3f0 tempest-SnapshotMetadataTestJSON-1584190256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:43:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e135b62b-bdcb-4b61-a9cc-aea36c1cf3f0 tempest-SnapshotMetadataTestJSON-1584190256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:43:41 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e135b62b-bdcb-4b61-a9cc-aea36c1cf3f0 tempest-SnapshotMetadataTestJSON-1584190256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:43:41 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e135b62b-bdcb-4b61-a9cc-aea36c1cf3f0 tempest-SnapshotMetadataTestJSON-1584190256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:43:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e135b62b-bdcb-4b61-a9cc-aea36c1cf3f0 tempest-SnapshotMetadataTestJSON-1584190256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:43:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e135b62b-bdcb-4b61-a9cc-aea36c1cf3f0 tempest-SnapshotMetadataTestJSON-1584190256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:43:41 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:43:41 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:43:41 devstack sudo[97524]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f2aaa3d0-9e5b-4669-ac40-943a649ad94f tempest-VolumesActionsTest-1170390702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3fb0f975-0837-4556-b6b8-a887b89fe198" returned: 0 in 0.569s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:41 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-f2aaa3d0-9e5b-4669-ac40-943a649ad94f tempest-VolumesActionsTest-1170390702 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3fb0f975-0837-4556-b6b8-a887b89fe198, size 1024.00 MB, duration 5.51 sec, destination /opt/stack/data/cinder/conversion/3fb0f975-0837-4556-b6b8-a887b89fe198.temp_image.a6d73742-8960-44d7-a8ce-c2ec58fc54409d52wzb2.img {{(pid=88413) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 10:43:41 devstack cinder-volume[88413]: INFO cinder.image.image_utils [None req-f2aaa3d0-9e5b-4669-ac40-943a649ad94f tempest-VolumesActionsTest-1170390702 None] Converted 1024.00 MB image at 185.83 MB/s Jul 28 10:43:41 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-f2aaa3d0-9e5b-4669-ac40-943a649ad94f tempest-VolumesActionsTest-1170390702 None] a6d73742-8960-44d7-a8ce-c2ec58fc5440 was raw, no need to convert to raw {{(pid=88413) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 28 10:43:42 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Jul 28 10:43:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e135b62b-bdcb-4b61-a9cc-aea36c1cf3f0 tempest-SnapshotMetadataTestJSON-1584190256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.290s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:43:42 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-e135b62b-bdcb-4b61-a9cc-aea36c1cf3f0 tempest-SnapshotMetadataTestJSON-1584190256 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:43:42 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-e135b62b-bdcb-4b61-a9cc-aea36c1cf3f0 tempest-SnapshotMetadataTestJSON-1584190256 None] Deleted volume successfully. Jul 28 10:43:42 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e135b62b-bdcb-4b61-a9cc-aea36c1cf3f0 tempest-SnapshotMetadataTestJSON-1584190256 None] Lock "cinder-0d313547-b560-49f6-9870-e190dae8fe77-delete_volume" released by "delete_volume" :: held 2.418s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:43:47 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-36f73d90-cde7-4c1f-9fc7-f36e1d569b56 tempest-VolumesTransfersV357Test-889231367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:43:47 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-36f73d90-cde7-4c1f-9fc7-f36e1d569b56 tempest-VolumesTransfersV357Test-889231367 None] Flow 'volume_create_manager' (fa143a5e-7ee1-4324-9da1-da1d59db0396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:43:47 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-36f73d90-cde7-4c1f-9fc7-f36e1d569b56 tempest-VolumesTransfersV357Test-889231367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5e9eca4-e0e2-44a3-996f-e858b7441e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:43:47 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ec020c5-ec38-4327-a632-f9cdd18a0631 tempest-AttachVolumeNegativeTest-1916507259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:43:47 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5ec020c5-ec38-4327-a632-f9cdd18a0631 tempest-AttachVolumeNegativeTest-1916507259 None] Flow 'volume_create_manager' (49f9ae0a-80c6-40ac-96b2-bc0d632cc782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:43:47 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5ec020c5-ec38-4327-a632-f9cdd18a0631 tempest-AttachVolumeNegativeTest-1916507259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (accf3a39-1ed7-4ffd-9166-f55dff8be5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:43:47 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-36f73d90-cde7-4c1f-9fc7-f36e1d569b56 tempest-VolumesTransfersV357Test-889231367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5e9eca4-e0e2-44a3-996f-e858b7441e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2124625347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a272b65b-534e-4456-b77e-986884276819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67ceb901a3e64ae99767b8d9569cafd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:43:47Z,use_quota=True,user_id='46a641e567be42899458097b3911b670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:43:47 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-36f73d90-cde7-4c1f-9fc7-f36e1d569b56 tempest-VolumesTransfersV357Test-889231367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a07b0fa-af57-4910-91e9-ead1dae6ac1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:43:47 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-36f73d90-cde7-4c1f-9fc7-f36e1d569b56 tempest-VolumesTransfersV357Test-889231367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a07b0fa-af57-4910-91e9-ead1dae6ac1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:43:47 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-36f73d90-cde7-4c1f-9fc7-f36e1d569b56 tempest-VolumesTransfersV357Test-889231367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b552b81f-3b99-4d19-9084-c2c8f22f9294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:43:47 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-36f73d90-cde7-4c1f-9fc7-f36e1d569b56 tempest-VolumesTransfersV357Test-889231367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b552b81f-3b99-4d19-9084-c2c8f22f9294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a272b65b-534e-4456-b77e-986884276819', 'volume_name': 'volume-a272b65b-534e-4456-b77e-986884276819', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:43:47 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-36f73d90-cde7-4c1f-9fc7-f36e1d569b56 tempest-VolumesTransfersV357Test-889231367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98d5d6f1-80d9-4d76-8e94-e1e74e8472d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:43:47 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-36f73d90-cde7-4c1f-9fc7-f36e1d569b56 tempest-VolumesTransfersV357Test-889231367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98d5d6f1-80d9-4d76-8e94-e1e74e8472d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:43:47 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-36f73d90-cde7-4c1f-9fc7-f36e1d569b56 tempest-VolumesTransfersV357Test-889231367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a21d926-24fb-4d0f-8d02-a837438569d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:43:47 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-36f73d90-cde7-4c1f-9fc7-f36e1d569b56 tempest-VolumesTransfersV357Test-889231367 None] Volume a272b65b-534e-4456-b77e-986884276819: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a272b65b-534e-4456-b77e-986884276819', 'volume_size': 1} Jul 28 10:43:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-36f73d90-cde7-4c1f-9fc7-f36e1d569b56 tempest-VolumesTransfersV357Test-889231367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:43:47 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5ec020c5-ec38-4327-a632-f9cdd18a0631 tempest-AttachVolumeNegativeTest-1916507259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (accf3a39-1ed7-4ffd-9166-f55dff8be5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-938210632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=777db935-85f6-4cbc-a9b3-b28d188934ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8306ee0961b64f729ddf2ae1f6f7c568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:43:47Z,use_quota=True,user_id='212a545c1dd1403bba8809b9058c167a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:43:47 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5ec020c5-ec38-4327-a632-f9cdd18a0631 tempest-AttachVolumeNegativeTest-1916507259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c439006-43ba-4bb2-a0da-90988eb936d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:43:47 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5ec020c5-ec38-4327-a632-f9cdd18a0631 tempest-AttachVolumeNegativeTest-1916507259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c439006-43ba-4bb2-a0da-90988eb936d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:43:47 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5ec020c5-ec38-4327-a632-f9cdd18a0631 tempest-AttachVolumeNegativeTest-1916507259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33f1a240-c397-4f43-b23a-b885f5442f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:43:47 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5ec020c5-ec38-4327-a632-f9cdd18a0631 tempest-AttachVolumeNegativeTest-1916507259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33f1a240-c397-4f43-b23a-b885f5442f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '777db935-85f6-4cbc-a9b3-b28d188934ac', 'volume_name': 'volume-777db935-85f6-4cbc-a9b3-b28d188934ac', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:43:47 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5ec020c5-ec38-4327-a632-f9cdd18a0631 tempest-AttachVolumeNegativeTest-1916507259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37c99540-2bb5-44d3-8101-13a6346336fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:43:47 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5ec020c5-ec38-4327-a632-f9cdd18a0631 tempest-AttachVolumeNegativeTest-1916507259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37c99540-2bb5-44d3-8101-13a6346336fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:43:47 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5ec020c5-ec38-4327-a632-f9cdd18a0631 tempest-AttachVolumeNegativeTest-1916507259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c10cc92f-308f-4e34-83bb-09be1a695cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:43:47 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-5ec020c5-ec38-4327-a632-f9cdd18a0631 tempest-AttachVolumeNegativeTest-1916507259 None] Volume 777db935-85f6-4cbc-a9b3-b28d188934ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-777db935-85f6-4cbc-a9b3-b28d188934ac', 'volume_size': 1} Jul 28 10:43:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5ec020c5-ec38-4327-a632-f9cdd18a0631 tempest-AttachVolumeNegativeTest-1916507259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:43:57 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=42,cinder:UPDATE=55,cinder:INSERT=14,cinder:DELETE=1 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:43:57 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:INSERT=15,cinder:UPDATE=57,cinder:SELECT=70,cinder:DELETE=7 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:44:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f2aaa3d0-9e5b-4669-ac40-943a649ad94f tempest-VolumesActionsTest-1170390702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.376s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:02 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f2aaa3d0-9e5b-4669-ac40-943a649ad94f tempest-VolumesActionsTest-1170390702 None] Uploaded volume to glance image-id: a6d73742-8960-44d7-a8ce-c2ec58fc5440. {{(pid=88413) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 28 10:44:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-cce31353-6665-472a-b9d7-b4f0b7fa9ff0 tempest-VolumesDeleteCascade-1527848463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.290s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:02 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-cce31353-6665-472a-b9d7-b4f0b7fa9ff0 tempest-VolumesDeleteCascade-1527848463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1288110606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6802819a-abfa-4f20-9054-6dd97d5713dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0480985c6b24e4eb8d6a49b9b2dfbaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:43:42Z,use_quota=True,user_id='051931c6b1aa4f4e9b124111a9a36f5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:44:02 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-cce31353-6665-472a-b9d7-b4f0b7fa9ff0 tempest-VolumesDeleteCascade-1527848463 None] Creating volume 6802819a-abfa-4f20-9054-6dd97d5713dd {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:44:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-cce31353-6665-472a-b9d7-b4f0b7fa9ff0 tempest-VolumesDeleteCascade-1527848463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:44:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-cce31353-6665-472a-b9d7-b4f0b7fa9ff0 tempest-VolumesDeleteCascade-1527848463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:02 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-cce31353-6665-472a-b9d7-b4f0b7fa9ff0 tempest-VolumesDeleteCascade-1527848463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:44:02 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-cce31353-6665-472a-b9d7-b4f0b7fa9ff0 tempest-VolumesDeleteCascade-1527848463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:44:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-cce31353-6665-472a-b9d7-b4f0b7fa9ff0 tempest-VolumesDeleteCascade-1527848463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:02 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-cce31353-6665-472a-b9d7-b4f0b7fa9ff0 tempest-VolumesDeleteCascade-1527848463 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:44:02 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-cce31353-6665-472a-b9d7-b4f0b7fa9ff0 tempest-VolumesDeleteCascade-1527848463 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:44:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cce31353-6665-472a-b9d7-b4f0b7fa9ff0 tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:02 devstack sudo[97562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd 1073741824 Jul 28 10:44:02 devstack sudo[97562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:02 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-f2aaa3d0-9e5b-4669-ac40-943a649ad94f tempest-VolumesActionsTest-1170390702 None] Copy volume to image completed successfully. Jul 28 10:44:02 devstack sudo[97562]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cce31353-6665-472a-b9d7-b4f0b7fa9ff0 tempest-VolumesDeleteCascade-1527848463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd 1073741824" returned: 0 in 0.433s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cce31353-6665-472a-b9d7-b4f0b7fa9ff0 tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:02 devstack sudo[97568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd Jul 28 10:44:02 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:02 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cce31353-6665-472a-b9d7-b4f0b7fa9ff0 tempest-VolumesDeleteCascade-1527848463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd" returned: 0 in 0.242s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:02 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-cce31353-6665-472a-b9d7-b4f0b7fa9ff0 tempest-VolumesDeleteCascade-1527848463 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:44:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-cce31353-6665-472a-b9d7-b4f0b7fa9ff0 tempest-VolumesDeleteCascade-1527848463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-36f73d90-cde7-4c1f-9fc7-f36e1d569b56 tempest-VolumesTransfersV357Test-889231367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.165s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:02 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-36f73d90-cde7-4c1f-9fc7-f36e1d569b56 tempest-VolumesTransfersV357Test-889231367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2124625347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a272b65b-534e-4456-b77e-986884276819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67ceb901a3e64ae99767b8d9569cafd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:43:47Z,use_quota=True,user_id='46a641e567be42899458097b3911b670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:44:02 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-36f73d90-cde7-4c1f-9fc7-f36e1d569b56 tempest-VolumesTransfersV357Test-889231367 None] Creating volume a272b65b-534e-4456-b77e-986884276819 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:44:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-36f73d90-cde7-4c1f-9fc7-f36e1d569b56 tempest-VolumesTransfersV357Test-889231367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:44:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-36f73d90-cde7-4c1f-9fc7-f36e1d569b56 tempest-VolumesTransfersV357Test-889231367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:02 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-36f73d90-cde7-4c1f-9fc7-f36e1d569b56 tempest-VolumesTransfersV357Test-889231367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:44:02 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-36f73d90-cde7-4c1f-9fc7-f36e1d569b56 tempest-VolumesTransfersV357Test-889231367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:44:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-36f73d90-cde7-4c1f-9fc7-f36e1d569b56 tempest-VolumesTransfersV357Test-889231367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:02 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-36f73d90-cde7-4c1f-9fc7-f36e1d569b56 tempest-VolumesTransfersV357Test-889231367 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:44:02 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-36f73d90-cde7-4c1f-9fc7-f36e1d569b56 tempest-VolumesTransfersV357Test-889231367 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:44:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-36f73d90-cde7-4c1f-9fc7-f36e1d569b56 tempest-VolumesTransfersV357Test-889231367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a272b65b-534e-4456-b77e-986884276819 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:02 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cce31353-6665-472a-b9d7-b4f0b7fa9ff0 tempest-VolumesDeleteCascade-1527848463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1abcebfa-48f0-495b-9235-1f7ddf69e26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6802819a-abfa-4f20-9054-6dd97d5713dd', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:02 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a272b65b-534e-4456-b77e-986884276819 1073741824 Jul 28 10:44:02 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:02 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cce31353-6665-472a-b9d7-b4f0b7fa9ff0 tempest-VolumesDeleteCascade-1527848463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fad4e37e-5d29-4073-97e7-03814b7c7555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:02 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-cce31353-6665-472a-b9d7-b4f0b7fa9ff0 tempest-VolumesDeleteCascade-1527848463 None] Volume volume-6802819a-abfa-4f20-9054-6dd97d5713dd (6802819a-abfa-4f20-9054-6dd97d5713dd): created successfully Jul 28 10:44:02 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cce31353-6665-472a-b9d7-b4f0b7fa9ff0 tempest-VolumesDeleteCascade-1527848463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fad4e37e-5d29-4073-97e7-03814b7c7555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:02 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cce31353-6665-472a-b9d7-b4f0b7fa9ff0 tempest-VolumesDeleteCascade-1527848463 None] Flow 'volume_create_manager' (7db7fe40-6921-49cb-a715-3ed091d46680) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:44:02 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-cce31353-6665-472a-b9d7-b4f0b7fa9ff0 tempest-VolumesDeleteCascade-1527848463 None] Created volume successfully. Jul 28 10:44:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b42286b3-ad4d-4418-8387-0b7bf800146c tempest-VolumesDeleteCascade-1527848463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:44:03 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-36f73d90-cde7-4c1f-9fc7-f36e1d569b56 tempest-VolumesTransfersV357Test-889231367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a272b65b-534e-4456-b77e-986884276819 1073741824" returned: 0 in 0.586s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-36f73d90-cde7-4c1f-9fc7-f36e1d569b56 tempest-VolumesTransfersV357Test-889231367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a272b65b-534e-4456-b77e-986884276819 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:03 devstack sudo[97577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a272b65b-534e-4456-b77e-986884276819 Jul 28 10:44:03 devstack sudo[97577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:03 devstack sudo[97577]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-36f73d90-cde7-4c1f-9fc7-f36e1d569b56 tempest-VolumesTransfersV357Test-889231367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a272b65b-534e-4456-b77e-986884276819" returned: 0 in 0.267s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:03 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-36f73d90-cde7-4c1f-9fc7-f36e1d569b56 tempest-VolumesTransfersV357Test-889231367 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:44:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-36f73d90-cde7-4c1f-9fc7-f36e1d569b56 tempest-VolumesTransfersV357Test-889231367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5ec020c5-ec38-4327-a632-f9cdd18a0631 tempest-AttachVolumeNegativeTest-1916507259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:03 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5ec020c5-ec38-4327-a632-f9cdd18a0631 tempest-AttachVolumeNegativeTest-1916507259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-938210632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=777db935-85f6-4cbc-a9b3-b28d188934ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8306ee0961b64f729ddf2ae1f6f7c568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:43:47Z,use_quota=True,user_id='212a545c1dd1403bba8809b9058c167a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:44:03 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-5ec020c5-ec38-4327-a632-f9cdd18a0631 tempest-AttachVolumeNegativeTest-1916507259 None] Creating volume 777db935-85f6-4cbc-a9b3-b28d188934ac {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:44:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5ec020c5-ec38-4327-a632-f9cdd18a0631 tempest-AttachVolumeNegativeTest-1916507259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:44:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5ec020c5-ec38-4327-a632-f9cdd18a0631 tempest-AttachVolumeNegativeTest-1916507259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:03 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5ec020c5-ec38-4327-a632-f9cdd18a0631 tempest-AttachVolumeNegativeTest-1916507259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:44:03 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5ec020c5-ec38-4327-a632-f9cdd18a0631 tempest-AttachVolumeNegativeTest-1916507259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:44:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5ec020c5-ec38-4327-a632-f9cdd18a0631 tempest-AttachVolumeNegativeTest-1916507259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:03 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5ec020c5-ec38-4327-a632-f9cdd18a0631 tempest-AttachVolumeNegativeTest-1916507259 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:44:03 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-5ec020c5-ec38-4327-a632-f9cdd18a0631 tempest-AttachVolumeNegativeTest-1916507259 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:44:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5ec020c5-ec38-4327-a632-f9cdd18a0631 tempest-AttachVolumeNegativeTest-1916507259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-777db935-85f6-4cbc-a9b3-b28d188934ac 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:03 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-777db935-85f6-4cbc-a9b3-b28d188934ac 1073741824 Jul 28 10:44:03 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:03 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-36f73d90-cde7-4c1f-9fc7-f36e1d569b56 tempest-VolumesTransfersV357Test-889231367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a21d926-24fb-4d0f-8d02-a837438569d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a272b65b-534e-4456-b77e-986884276819', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:03 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-36f73d90-cde7-4c1f-9fc7-f36e1d569b56 tempest-VolumesTransfersV357Test-889231367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1853783f-2939-40da-b056-c49d48834a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:03 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-36f73d90-cde7-4c1f-9fc7-f36e1d569b56 tempest-VolumesTransfersV357Test-889231367 None] Volume volume-a272b65b-534e-4456-b77e-986884276819 (a272b65b-534e-4456-b77e-986884276819): created successfully Jul 28 10:44:03 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-36f73d90-cde7-4c1f-9fc7-f36e1d569b56 tempest-VolumesTransfersV357Test-889231367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1853783f-2939-40da-b056-c49d48834a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:03 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-36f73d90-cde7-4c1f-9fc7-f36e1d569b56 tempest-VolumesTransfersV357Test-889231367 None] Flow 'volume_create_manager' (fa143a5e-7ee1-4324-9da1-da1d59db0396) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:44:03 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-36f73d90-cde7-4c1f-9fc7-f36e1d569b56 tempest-VolumesTransfersV357Test-889231367 None] Created volume successfully. Jul 28 10:44:04 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5ec020c5-ec38-4327-a632-f9cdd18a0631 tempest-AttachVolumeNegativeTest-1916507259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-777db935-85f6-4cbc-a9b3-b28d188934ac 1073741824" returned: 0 in 0.488s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5ec020c5-ec38-4327-a632-f9cdd18a0631 tempest-AttachVolumeNegativeTest-1916507259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-777db935-85f6-4cbc-a9b3-b28d188934ac {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:04 devstack sudo[97586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-777db935-85f6-4cbc-a9b3-b28d188934ac Jul 28 10:44:04 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-dac820e8-5e2f-499d-8e48-6351cf760c3f tempest-VolumesActionsTest-1170390702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:44:04 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5ec020c5-ec38-4327-a632-f9cdd18a0631 tempest-AttachVolumeNegativeTest-1916507259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-777db935-85f6-4cbc-a9b3-b28d188934ac" returned: 0 in 0.265s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:04 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5ec020c5-ec38-4327-a632-f9cdd18a0631 tempest-AttachVolumeNegativeTest-1916507259 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:44:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5ec020c5-ec38-4327-a632-f9cdd18a0631 tempest-AttachVolumeNegativeTest-1916507259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b42286b3-ad4d-4418-8387-0b7bf800146c tempest-VolumesDeleteCascade-1527848463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.164s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5ec020c5-ec38-4327-a632-f9cdd18a0631 tempest-AttachVolumeNegativeTest-1916507259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c10cc92f-308f-4e34-83bb-09be1a695cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-777db935-85f6-4cbc-a9b3-b28d188934ac', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5ec020c5-ec38-4327-a632-f9cdd18a0631 tempest-AttachVolumeNegativeTest-1916507259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (856e6a7d-cf5d-465e-b1f5-c8599570a02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:04 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-b42286b3-ad4d-4418-8387-0b7bf800146c tempest-VolumesDeleteCascade-1527848463 None] Creating offline snapshot 59430c72-a3ee-4ed8-85a5-7464ccd8e409 of volume 6802819a-abfa-4f20-9054-6dd97d5713dd {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:44:04 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-5ec020c5-ec38-4327-a632-f9cdd18a0631 tempest-AttachVolumeNegativeTest-1916507259 None] Volume volume-777db935-85f6-4cbc-a9b3-b28d188934ac (777db935-85f6-4cbc-a9b3-b28d188934ac): created successfully Jul 28 10:44:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5ec020c5-ec38-4327-a632-f9cdd18a0631 tempest-AttachVolumeNegativeTest-1916507259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (856e6a7d-cf5d-465e-b1f5-c8599570a02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5ec020c5-ec38-4327-a632-f9cdd18a0631 tempest-AttachVolumeNegativeTest-1916507259 None] Flow 'volume_create_manager' (49f9ae0a-80c6-40ac-96b2-bc0d632cc782) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:44:04 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88aa156-21e1-4d3f-9246-f33fbc87ee49]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:44:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b42286b3-ad4d-4418-8387-0b7bf800146c tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:04 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-5ec020c5-ec38-4327-a632-f9cdd18a0631 tempest-AttachVolumeNegativeTest-1916507259 None] Created volume successfully. Jul 28 10:44:04 devstack sudo[97589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd Jul 28 10:44:04 devstack sudo[97589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:04 devstack sudo[97589]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b42286b3-ad4d-4418-8387-0b7bf800146c tempest-VolumesDeleteCascade-1527848463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd" returned: 0 in 0.363s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b42286b3-ad4d-4418-8387-0b7bf800146c tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd.59430c72-a3ee-4ed8-85a5-7464ccd8e409 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:04 devstack sudo[97594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd.59430c72-a3ee-4ed8-85a5-7464ccd8e409 1G Jul 28 10:44:04 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:05 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-d0dee323-742e-449e-88cf-a10cc180c91a tempest-VolumesTransfersV357Test-1636713365 None] Transfer volume completed successfully. Jul 28 10:44:05 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b42286b3-ad4d-4418-8387-0b7bf800146c tempest-VolumesDeleteCascade-1527848463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd.59430c72-a3ee-4ed8-85a5-7464ccd8e409 1G" returned: 0 in 0.476s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b42286b3-ad4d-4418-8387-0b7bf800146c tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6802819a-abfa-4f20-9054-6dd97d5713dd -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd.59430c72-a3ee-4ed8-85a5-7464ccd8e409 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:05 devstack sudo[97600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6802819a-abfa-4f20-9054-6dd97d5713dd -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd.59430c72-a3ee-4ed8-85a5-7464ccd8e409 Jul 28 10:44:05 devstack sudo[97600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:05 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-119f3270-7595-4bfc-8562-30018ddcca4c tempest-VolumesTransfersV357Test-2103462250 None] Acquiring lock "cinder-a272b65b-534e-4456-b77e-986884276819-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:44:05 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-119f3270-7595-4bfc-8562-30018ddcca4c tempest-VolumesTransfersV357Test-2103462250 None] Lock "cinder-a272b65b-534e-4456-b77e-986884276819-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:44:05 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-119f3270-7595-4bfc-8562-30018ddcca4c tempest-VolumesTransfersV357Test-2103462250 None] Acquiring lock "cinder-quobyte-a272b65b-534e-4456-b77e-986884276819" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:44:05 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-119f3270-7595-4bfc-8562-30018ddcca4c tempest-VolumesTransfersV357Test-2103462250 None] Lock "cinder-quobyte-a272b65b-534e-4456-b77e-986884276819" acquired by "delete_volume" :: waited 0.017s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:44:05 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc752918-b974-4330-88e8-f6d1cc974ab4]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:44:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-119f3270-7595-4bfc-8562-30018ddcca4c tempest-VolumesTransfersV357Test-2103462250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a272b65b-534e-4456-b77e-986884276819 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:05 devstack sudo[97603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a272b65b-534e-4456-b77e-986884276819 Jul 28 10:44:05 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:05 devstack sudo[97600]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b42286b3-ad4d-4418-8387-0b7bf800146c tempest-VolumesDeleteCascade-1527848463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6802819a-abfa-4f20-9054-6dd97d5713dd -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd.59430c72-a3ee-4ed8-85a5-7464ccd8e409" returned: 0 in 0.384s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:05 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-b42286b3-ad4d-4418-8387-0b7bf800146c tempest-VolumesDeleteCascade-1527848463 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd.59430c72-a3ee-4ed8-85a5-7464ccd8e409 is being set with open permissions: ugo+rw Jul 28 10:44:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b42286b3-ad4d-4418-8387-0b7bf800146c tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd.59430c72-a3ee-4ed8-85a5-7464ccd8e409 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:05 devstack sudo[97611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd.59430c72-a3ee-4ed8-85a5-7464ccd8e409 Jul 28 10:44:05 devstack sudo[97611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:06 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-119f3270-7595-4bfc-8562-30018ddcca4c tempest-VolumesTransfersV357Test-2103462250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a272b65b-534e-4456-b77e-986884276819" returned: 0 in 0.382s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-119f3270-7595-4bfc-8562-30018ddcca4c tempest-VolumesTransfersV357Test-2103462250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a272b65b-534e-4456-b77e-986884276819 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:06 devstack sudo[97617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a272b65b-534e-4456-b77e-986884276819 Jul 28 10:44:06 devstack sudo[97617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:06 devstack sudo[97611]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b42286b3-ad4d-4418-8387-0b7bf800146c tempest-VolumesDeleteCascade-1527848463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd.59430c72-a3ee-4ed8-85a5-7464ccd8e409" returned: 0 in 0.289s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b42286b3-ad4d-4418-8387-0b7bf800146c tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:06 devstack sudo[97619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd.info Jul 28 10:44:06 devstack sudo[97619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:06 devstack sudo[97617]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-119f3270-7595-4bfc-8562-30018ddcca4c tempest-VolumesTransfersV357Test-2103462250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a272b65b-534e-4456-b77e-986884276819" returned: 0 in 0.299s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:06 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-119f3270-7595-4bfc-8562-30018ddcca4c tempest-VolumesTransfersV357Test-2103462250 None] Lock "cinder-quobyte-a272b65b-534e-4456-b77e-986884276819" released by "delete_volume" :: held 0.731s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:44:06 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-119f3270-7595-4bfc-8562-30018ddcca4c tempest-VolumesTransfersV357Test-2103462250 None] Created reservations ['44df2f6f-1e8d-4012-a976-efc3e465338d', '6997822a-edda-4c31-bfa3-251eb2a267e3', '9853fceb-eae6-4201-a921-953058f9282f', '69a42c8a-fa04-4656-ac3c-624c89f4dca5'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:44:06 devstack sudo[97619]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b42286b3-ad4d-4418-8387-0b7bf800146c tempest-VolumesDeleteCascade-1527848463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd.info" returned: 0 in 0.310s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:06 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-b42286b3-ad4d-4418-8387-0b7bf800146c tempest-VolumesDeleteCascade-1527848463 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd.info is being set with open permissions: ugo+rw Jul 28 10:44:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b42286b3-ad4d-4418-8387-0b7bf800146c tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:06 devstack sudo[97631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd.info Jul 28 10:44:06 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-3ba66c2d-ed21-4f5a-80c4-ace870115500 req-c9f8fde1-cf36-411f-aa27-787f7693b1c9 tempest-AttachVolumeNegativeTest-1916507259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:44:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-119f3270-7595-4bfc-8562-30018ddcca4c tempest-VolumesTransfersV357Test-2103462250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:44:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-119f3270-7595-4bfc-8562-30018ddcca4c tempest-VolumesTransfersV357Test-2103462250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:06 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-119f3270-7595-4bfc-8562-30018ddcca4c tempest-VolumesTransfersV357Test-2103462250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:44:06 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-119f3270-7595-4bfc-8562-30018ddcca4c tempest-VolumesTransfersV357Test-2103462250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:44:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-119f3270-7595-4bfc-8562-30018ddcca4c tempest-VolumesTransfersV357Test-2103462250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-119f3270-7595-4bfc-8562-30018ddcca4c tempest-VolumesTransfersV357Test-2103462250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:06 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:44:06 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:06 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b42286b3-ad4d-4418-8387-0b7bf800146c tempest-VolumesDeleteCascade-1527848463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd.info" returned: 0 in 0.263s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b42286b3-ad4d-4418-8387-0b7bf800146c tempest-VolumesDeleteCascade-1527848463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.219s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-dac820e8-5e2f-499d-8e48-6351cf760c3f tempest-VolumesActionsTest-1170390702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.391s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:06 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[c679c52a-9767-4905-b715-bbc35e5997e8]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:44:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dac820e8-5e2f-499d-8e48-6351cf760c3f tempest-VolumesActionsTest-1170390702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3fb0f975-0837-4556-b6b8-a887b89fe198 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:06 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:06 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-b42286b3-ad4d-4418-8387-0b7bf800146c tempest-VolumesDeleteCascade-1527848463 None] Create snapshot completed successfully Jul 28 10:44:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-119f3270-7595-4bfc-8562-30018ddcca4c tempest-VolumesTransfersV357Test-2103462250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.269s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:06 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-119f3270-7595-4bfc-8562-30018ddcca4c tempest-VolumesTransfersV357Test-2103462250 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:44:06 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-119f3270-7595-4bfc-8562-30018ddcca4c tempest-VolumesTransfersV357Test-2103462250 None] Deleted volume successfully. Jul 28 10:44:06 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-119f3270-7595-4bfc-8562-30018ddcca4c tempest-VolumesTransfersV357Test-2103462250 None] Lock "cinder-a272b65b-534e-4456-b77e-986884276819-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:44:06 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3fb0f975-0837-4556-b6b8-a887b89fe198 Jul 28 10:44:06 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:07 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dac820e8-5e2f-499d-8e48-6351cf760c3f tempest-VolumesActionsTest-1170390702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3fb0f975-0837-4556-b6b8-a887b89fe198" returned: 0 in 0.384s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:07 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfdf07d-a379-4e68-bc15-dd8e374815b7]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:44:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dac820e8-5e2f-499d-8e48-6351cf760c3f tempest-VolumesActionsTest-1170390702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3fb0f975-0837-4556-b6b8-a887b89fe198 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:07 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d8ffc92-43ec-4979-a668-24b7e3349641 tempest-VolumesTransfersV357Test-889231367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:44:07 devstack sudo[97642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3fb0f975-0837-4556-b6b8-a887b89fe198 Jul 28 10:44:07 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d8ffc92-43ec-4979-a668-24b7e3349641 tempest-VolumesTransfersV357Test-889231367 None] Flow 'volume_create_manager' (6295aa5f-8226-4bd8-8923-5bc3397ddd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:44:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d8ffc92-43ec-4979-a668-24b7e3349641 tempest-VolumesTransfersV357Test-889231367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b46da4a-fd59-4423-a5fc-1bb26a944645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d8ffc92-43ec-4979-a668-24b7e3349641 tempest-VolumesTransfersV357Test-889231367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b46da4a-fd59-4423-a5fc-1bb26a944645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-639112540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=331599f8-6b7a-4a59-96b0-2d6594b6c8c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67ceb901a3e64ae99767b8d9569cafd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:44:07Z,use_quota=True,user_id='46a641e567be42899458097b3911b670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d8ffc92-43ec-4979-a668-24b7e3349641 tempest-VolumesTransfersV357Test-889231367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe48622f-fce2-454c-8186-71f6bf0c62b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d8ffc92-43ec-4979-a668-24b7e3349641 tempest-VolumesTransfersV357Test-889231367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe48622f-fce2-454c-8186-71f6bf0c62b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d8ffc92-43ec-4979-a668-24b7e3349641 tempest-VolumesTransfersV357Test-889231367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15766b80-a66d-41be-b817-bf886b44a840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d8ffc92-43ec-4979-a668-24b7e3349641 tempest-VolumesTransfersV357Test-889231367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15766b80-a66d-41be-b817-bf886b44a840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '331599f8-6b7a-4a59-96b0-2d6594b6c8c8', 'volume_name': 'volume-331599f8-6b7a-4a59-96b0-2d6594b6c8c8', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d8ffc92-43ec-4979-a668-24b7e3349641 tempest-VolumesTransfersV357Test-889231367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab61761-4b71-44da-844a-fd34e366e18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d8ffc92-43ec-4979-a668-24b7e3349641 tempest-VolumesTransfersV357Test-889231367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab61761-4b71-44da-844a-fd34e366e18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d8ffc92-43ec-4979-a668-24b7e3349641 tempest-VolumesTransfersV357Test-889231367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7458061b-e23f-4902-8e0b-aa1a798965a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:07 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-9d8ffc92-43ec-4979-a668-24b7e3349641 tempest-VolumesTransfersV357Test-889231367 None] Volume 331599f8-6b7a-4a59-96b0-2d6594b6c8c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-331599f8-6b7a-4a59-96b0-2d6594b6c8c8', 'volume_size': 1} Jul 28 10:44:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9d8ffc92-43ec-4979-a668-24b7e3349641 tempest-VolumesTransfersV357Test-889231367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:44:07 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dac820e8-5e2f-499d-8e48-6351cf760c3f tempest-VolumesActionsTest-1170390702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3fb0f975-0837-4556-b6b8-a887b89fe198" returned: 0 in 0.363s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dac820e8-5e2f-499d-8e48-6351cf760c3f tempest-VolumesActionsTest-1170390702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3fb0f975-0837-4556-b6b8-a887b89fe198 /opt/stack/data/cinder/conversion/3fb0f975-0837-4556-b6b8-a887b89fe198.temp_image.cf8cb2e8-7b6e-4f97-b3c0-3d79bcc20cf6dguca28b.img {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:07 devstack sudo[97647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3fb0f975-0837-4556-b6b8-a887b89fe198 /opt/stack/data/cinder/conversion/3fb0f975-0837-4556-b6b8-a887b89fe198.temp_image.cf8cb2e8-7b6e-4f97-b3c0-3d79bcc20cf6dguca28b.img Jul 28 10:44:07 devstack sudo[97647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:08 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:44:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Flow 'volume_create_manager' (15e0826d-8920-4202-8044-564a01a3feb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:44:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4b60ae9-f4cb-4aa9-87b7-d406036e8ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4b60ae9-f4cb-4aa9-87b7-d406036e8ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1726490803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b516f54-f1bf-4103-900c-56803b53e55b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0480985c6b24e4eb8d6a49b9b2dfbaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=59430c72-a3ee-4ed8-85a5-7464ccd8e409,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:44:08Z,use_quota=True,user_id='051931c6b1aa4f4e9b124111a9a36f5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33c18375-eebf-40af-822f-8311223fe469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33c18375-eebf-40af-822f-8311223fe469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (479dc4fc-78f4-4666-ac9d-cdb2eecd5287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (479dc4fc-78f4-4666-ac9d-cdb2eecd5287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4b516f54-f1bf-4103-900c-56803b53e55b', 'volume_name': 'volume-4b516f54-f1bf-4103-900c-56803b53e55b', 'volume_size': 1, 'snapshot_id': '59430c72-a3ee-4ed8-85a5-7464ccd8e409'}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c5ce3cb-7e46-489f-afb3-699faf9f6367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c5ce3cb-7e46-489f-afb3-699faf9f6367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aa3157b-cf4a-4246-89fd-786e99a32b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:08 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Volume 4b516f54-f1bf-4103-900c-56803b53e55b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4b516f54-f1bf-4103-900c-56803b53e55b', 'volume_size': 1, 'snapshot_id': '59430c72-a3ee-4ed8-85a5-7464ccd8e409'} Jul 28 10:44:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:44:11 devstack sudo[97647]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dac820e8-5e2f-499d-8e48-6351cf760c3f tempest-VolumesActionsTest-1170390702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3fb0f975-0837-4556-b6b8-a887b89fe198 /opt/stack/data/cinder/conversion/3fb0f975-0837-4556-b6b8-a887b89fe198.temp_image.cf8cb2e8-7b6e-4f97-b3c0-3d79bcc20cf6dguca28b.img" returned: 0 in 4.261s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:11 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[532d50c5-a67a-4ecc-ae72-de654d12afc2]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:44:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dac820e8-5e2f-499d-8e48-6351cf760c3f tempest-VolumesActionsTest-1170390702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3fb0f975-0837-4556-b6b8-a887b89fe198 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:11 devstack sudo[97661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3fb0f975-0837-4556-b6b8-a887b89fe198 Jul 28 10:44:11 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:12 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dac820e8-5e2f-499d-8e48-6351cf760c3f tempest-VolumesActionsTest-1170390702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3fb0f975-0837-4556-b6b8-a887b89fe198" returned: 0 in 0.535s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:12 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-dac820e8-5e2f-499d-8e48-6351cf760c3f tempest-VolumesActionsTest-1170390702 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3fb0f975-0837-4556-b6b8-a887b89fe198, size 1024.00 MB, duration 4.26 sec, destination /opt/stack/data/cinder/conversion/3fb0f975-0837-4556-b6b8-a887b89fe198.temp_image.cf8cb2e8-7b6e-4f97-b3c0-3d79bcc20cf6dguca28b.img {{(pid=88413) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 10:44:12 devstack cinder-volume[88413]: INFO cinder.image.image_utils [None req-dac820e8-5e2f-499d-8e48-6351cf760c3f tempest-VolumesActionsTest-1170390702 None] Converted 1024.00 MB image at 240.25 MB/s Jul 28 10:44:12 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-dac820e8-5e2f-499d-8e48-6351cf760c3f tempest-VolumesActionsTest-1170390702 None] cf8cb2e8-7b6e-4f97-b3c0-3d79bcc20cf6 was raw, converting to qcow2 {{(pid=88413) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 28 10:44:12 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[906b3600-4c61-43c1-88ac-569831561777]: (4, 'raw') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:44:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dac820e8-5e2f-499d-8e48-6351cf760c3f tempest-VolumesActionsTest-1170390702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3fb0f975-0837-4556-b6b8-a887b89fe198.temp_image.cf8cb2e8-7b6e-4f97-b3c0-3d79bcc20cf6dguca28b.img {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:12 devstack sudo[97674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3fb0f975-0837-4556-b6b8-a887b89fe198.temp_image.cf8cb2e8-7b6e-4f97-b3c0-3d79bcc20cf6dguca28b.img Jul 28 10:44:12 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:12 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dac820e8-5e2f-499d-8e48-6351cf760c3f tempest-VolumesActionsTest-1170390702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3fb0f975-0837-4556-b6b8-a887b89fe198.temp_image.cf8cb2e8-7b6e-4f97-b3c0-3d79bcc20cf6dguca28b.img" returned: 0 in 0.350s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dac820e8-5e2f-499d-8e48-6351cf760c3f tempest-VolumesActionsTest-1170390702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3fb0f975-0837-4556-b6b8-a887b89fe198.temp_image.cf8cb2e8-7b6e-4f97-b3c0-3d79bcc20cf6dguca28b.img {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:12 devstack sudo[97678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3fb0f975-0837-4556-b6b8-a887b89fe198.temp_image.cf8cb2e8-7b6e-4f97-b3c0-3d79bcc20cf6dguca28b.img Jul 28 10:44:12 devstack sudo[97678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:13 devstack sudo[97678]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dac820e8-5e2f-499d-8e48-6351cf760c3f tempest-VolumesActionsTest-1170390702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3fb0f975-0837-4556-b6b8-a887b89fe198.temp_image.cf8cb2e8-7b6e-4f97-b3c0-3d79bcc20cf6dguca28b.img" returned: 1 in 0.330s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dac820e8-5e2f-499d-8e48-6351cf760c3f tempest-VolumesActionsTest-1170390702 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3fb0f975-0837-4556-b6b8-a887b89fe198.temp_image.cf8cb2e8-7b6e-4f97-b3c0-3d79bcc20cf6dguca28b.img' failed. Not Retrying. {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 10:44:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dac820e8-5e2f-499d-8e48-6351cf760c3f tempest-VolumesActionsTest-1170390702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3fb0f975-0837-4556-b6b8-a887b89fe198.temp_image.cf8cb2e8-7b6e-4f97-b3c0-3d79bcc20cf6dguca28b.img /opt/stack/data/cinder/conversion/vol_upload_jaonxv1j {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:13 devstack sudo[97683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3fb0f975-0837-4556-b6b8-a887b89fe198.temp_image.cf8cb2e8-7b6e-4f97-b3c0-3d79bcc20cf6dguca28b.img /opt/stack/data/cinder/conversion/vol_upload_jaonxv1j Jul 28 10:44:13 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:13 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dac820e8-5e2f-499d-8e48-6351cf760c3f tempest-VolumesActionsTest-1170390702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3fb0f975-0837-4556-b6b8-a887b89fe198.temp_image.cf8cb2e8-7b6e-4f97-b3c0-3d79bcc20cf6dguca28b.img /opt/stack/data/cinder/conversion/vol_upload_jaonxv1j" returned: 0 in 0.254s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:13 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-dac820e8-5e2f-499d-8e48-6351cf760c3f tempest-VolumesActionsTest-1170390702 None] Image conversion details: src /opt/stack/data/cinder/conversion/3fb0f975-0837-4556-b6b8-a887b89fe198.temp_image.cf8cb2e8-7b6e-4f97-b3c0-3d79bcc20cf6dguca28b.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_jaonxv1j {{(pid=88413) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 10:44:13 devstack cinder-volume[88413]: INFO cinder.image.image_utils [None req-dac820e8-5e2f-499d-8e48-6351cf760c3f tempest-VolumesActionsTest-1170390702 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 28 10:44:13 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc23e33-ddb3-4ac2-9ce2-c90b370e4cd7]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:44:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dac820e8-5e2f-499d-8e48-6351cf760c3f tempest-VolumesActionsTest-1170390702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jaonxv1j {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:13 devstack sudo[97688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jaonxv1j Jul 28 10:44:13 devstack sudo[97688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:13 devstack sudo[97688]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dac820e8-5e2f-499d-8e48-6351cf760c3f tempest-VolumesActionsTest-1170390702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jaonxv1j" returned: 0 in 0.330s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-dac820e8-5e2f-499d-8e48-6351cf760c3f tempest-VolumesActionsTest-1170390702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.138s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:14 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-dac820e8-5e2f-499d-8e48-6351cf760c3f tempest-VolumesActionsTest-1170390702 None] Uploaded volume to glance image-id: cf8cb2e8-7b6e-4f97-b3c0-3d79bcc20cf6. {{(pid=88413) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 28 10:44:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-3ba66c2d-ed21-4f5a-80c4-ace870115500 req-c9f8fde1-cf36-411f-aa27-787f7693b1c9 tempest-AttachVolumeNegativeTest-1916507259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.379s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-3ba66c2d-ed21-4f5a-80c4-ace870115500 req-c9f8fde1-cf36-411f-aa27-787f7693b1c9 tempest-AttachVolumeNegativeTest-1916507259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9d8ffc92-43ec-4979-a668-24b7e3349641 tempest-VolumesTransfersV357Test-889231367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.557s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:14 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9d8ffc92-43ec-4979-a668-24b7e3349641 tempest-VolumesTransfersV357Test-889231367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-639112540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=331599f8-6b7a-4a59-96b0-2d6594b6c8c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67ceb901a3e64ae99767b8d9569cafd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:44:07Z,use_quota=True,user_id='46a641e567be42899458097b3911b670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:44:14 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-9d8ffc92-43ec-4979-a668-24b7e3349641 tempest-VolumesTransfersV357Test-889231367 None] Creating volume 331599f8-6b7a-4a59-96b0-2d6594b6c8c8 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:44:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9d8ffc92-43ec-4979-a668-24b7e3349641 tempest-VolumesTransfersV357Test-889231367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:44:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9d8ffc92-43ec-4979-a668-24b7e3349641 tempest-VolumesTransfersV357Test-889231367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:14 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9d8ffc92-43ec-4979-a668-24b7e3349641 tempest-VolumesTransfersV357Test-889231367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:44:14 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9d8ffc92-43ec-4979-a668-24b7e3349641 tempest-VolumesTransfersV357Test-889231367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:44:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9d8ffc92-43ec-4979-a668-24b7e3349641 tempest-VolumesTransfersV357Test-889231367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:14 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9d8ffc92-43ec-4979-a668-24b7e3349641 tempest-VolumesTransfersV357Test-889231367 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:44:14 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-9d8ffc92-43ec-4979-a668-24b7e3349641 tempest-VolumesTransfersV357Test-889231367 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:44:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9d8ffc92-43ec-4979-a668-24b7e3349641 tempest-VolumesTransfersV357Test-889231367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-331599f8-6b7a-4a59-96b0-2d6594b6c8c8 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:14 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-dac820e8-5e2f-499d-8e48-6351cf760c3f tempest-VolumesActionsTest-1170390702 None] Copy volume to image completed successfully. Jul 28 10:44:14 devstack sudo[97693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-331599f8-6b7a-4a59-96b0-2d6594b6c8c8 1073741824 Jul 28 10:44:14 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:14 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-3ba66c2d-ed21-4f5a-80c4-ace870115500 req-c9f8fde1-cf36-411f-aa27-787f7693b1c9 tempest-AttachVolumeNegativeTest-1916507259 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7', 'name': 'volume-777db935-85f6-4cbc-a9b3-b28d188934ac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '92701205-0599-4e4a-a48d-e77719c42e81', 'enforce_multipath': True} {{(pid=88413) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 10:44:14 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-3ba66c2d-ed21-4f5a-80c4-ace870115500 req-c9f8fde1-cf36-411f-aa27-787f7693b1c9 tempest-AttachVolumeNegativeTest-1916507259 None] attachment_update completed successfully. Jul 28 10:44:15 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9d8ffc92-43ec-4979-a668-24b7e3349641 tempest-VolumesTransfersV357Test-889231367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-331599f8-6b7a-4a59-96b0-2d6594b6c8c8 1073741824" returned: 0 in 0.464s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9d8ffc92-43ec-4979-a668-24b7e3349641 tempest-VolumesTransfersV357Test-889231367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-331599f8-6b7a-4a59-96b0-2d6594b6c8c8 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:15 devstack sudo[98083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-331599f8-6b7a-4a59-96b0-2d6594b6c8c8 Jul 28 10:44:15 devstack sudo[98083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:15 devstack sudo[98083]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9d8ffc92-43ec-4979-a668-24b7e3349641 tempest-VolumesTransfersV357Test-889231367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-331599f8-6b7a-4a59-96b0-2d6594b6c8c8" returned: 0 in 0.252s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:15 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9d8ffc92-43ec-4979-a668-24b7e3349641 tempest-VolumesTransfersV357Test-889231367 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:44:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9d8ffc92-43ec-4979-a668-24b7e3349641 tempest-VolumesTransfersV357Test-889231367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.041s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:15 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Acquiring lock "cinder-quobyte-59430c72-a3ee-4ed8-85a5-7464ccd8e409-4b516f54-f1bf-4103-900c-56803b53e55b" by "_create_volume_from_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:44:15 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Lock "cinder-quobyte-59430c72-a3ee-4ed8-85a5-7464ccd8e409-4b516f54-f1bf-4103-900c-56803b53e55b" acquired by "_create_volume_from_snapshot" :: waited 0.045s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:44:15 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Creating volume 4b516f54-f1bf-4103-900c-56803b53e55b from snapshot 59430c72-a3ee-4ed8-85a5-7464ccd8e409 {{(pid=88413) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 28 10:44:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:44:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:15 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:44:15 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:44:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:15 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:44:15 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Acquiring lock "cinder-quobyte-4b516f54-f1bf-4103-900c-56803b53e55b" by "_copy_volume_from_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:44:15 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Lock "cinder-quobyte-4b516f54-f1bf-4103-900c-56803b53e55b" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:44:15 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] snapshot: 59430c72-a3ee-4ed8-85a5-7464ccd8e409, volume: 4b516f54-f1bf-4103-900c-56803b53e55b, {{(pid=88413) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 28 10:44:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:44:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:15 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:44:15 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:44:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:15 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d8ffc92-43ec-4979-a668-24b7e3349641 tempest-VolumesTransfersV357Test-889231367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7458061b-e23f-4902-8e0b-aa1a798965a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-331599f8-6b7a-4a59-96b0-2d6594b6c8c8', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:15 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d8ffc92-43ec-4979-a668-24b7e3349641 tempest-VolumesTransfersV357Test-889231367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1a36f01-1df5-48c4-baa6-153f8903912c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:15 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86a7d0e-5254-49f9-bc0b-631818dbd035]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:44:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd.59430c72-a3ee-4ed8-85a5-7464ccd8e409 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:15 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd.59430c72-a3ee-4ed8-85a5-7464ccd8e409 Jul 28 10:44:15 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:16 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-9d8ffc92-43ec-4979-a668-24b7e3349641 tempest-VolumesTransfersV357Test-889231367 None] Volume volume-331599f8-6b7a-4a59-96b0-2d6594b6c8c8 (331599f8-6b7a-4a59-96b0-2d6594b6c8c8): created successfully Jul 28 10:44:16 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d8ffc92-43ec-4979-a668-24b7e3349641 tempest-VolumesTransfersV357Test-889231367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1a36f01-1df5-48c4-baa6-153f8903912c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:16 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d8ffc92-43ec-4979-a668-24b7e3349641 tempest-VolumesTransfersV357Test-889231367 None] Flow 'volume_create_manager' (6295aa5f-8226-4bd8-8923-5bc3397ddd57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:44:16 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-9d8ffc92-43ec-4979-a668-24b7e3349641 tempest-VolumesTransfersV357Test-889231367 None] Created volume successfully. Jul 28 10:44:16 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd.59430c72-a3ee-4ed8-85a5-7464ccd8e409" returned: 0 in 0.434s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:16 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6802819a-abfa-4f20-9054-6dd97d5713dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:44:16 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd {{(pid=88413) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 28 10:44:16 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Creating direct copy from snapshot {{(pid=88413) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 28 10:44:16 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b912c4a-a336-4bd6-be23-1615d61b4bd7]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:44:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:16 devstack sudo[98092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd Jul 28 10:44:16 devstack sudo[98092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:16 devstack sudo[98092]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd" returned: 0 in 0.406s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:16 devstack cinder-volume[88413]: DEBUG cinder.utils [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Path /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b516f54-f1bf-4103-900c-56803b53e55b not found in is_blk_device check {{(pid=88413) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 28 10:44:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b516f54-f1bf-4103-900c-56803b53e55b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:16 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-6dd46530-7a21-4c48-9fa4-918a28f52007 tempest-VolumesActionsTest-1170390702 None] Acquiring lock "cinder-3fb0f975-0837-4556-b6b8-a887b89fe198-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:44:16 devstack sudo[98097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b516f54-f1bf-4103-900c-56803b53e55b Jul 28 10:44:16 devstack sudo[98097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:16 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-6dd46530-7a21-4c48-9fa4-918a28f52007 tempest-VolumesActionsTest-1170390702 None] Lock "cinder-3fb0f975-0837-4556-b6b8-a887b89fe198-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:44:16 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-6dd46530-7a21-4c48-9fa4-918a28f52007 tempest-VolumesActionsTest-1170390702 None] Acquiring lock "cinder-quobyte-3fb0f975-0837-4556-b6b8-a887b89fe198" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:44:16 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-6dd46530-7a21-4c48-9fa4-918a28f52007 tempest-VolumesActionsTest-1170390702 None] Lock "cinder-quobyte-3fb0f975-0837-4556-b6b8-a887b89fe198" acquired by "delete_volume" :: waited 0.016s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:44:16 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[e958e5b8-519d-4502-b672-e99cab594a27]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:44:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6dd46530-7a21-4c48-9fa4-918a28f52007 tempest-VolumesActionsTest-1170390702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3fb0f975-0837-4556-b6b8-a887b89fe198 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:16 devstack sudo[98099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3fb0f975-0837-4556-b6b8-a887b89fe198 Jul 28 10:44:16 devstack sudo[98099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:17 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8d2626b9-c717-4472-8d54-4387a8d697ff tempest-VolumesTransfersV357Test-2103462250 None] Acquiring lock "cinder-331599f8-6b7a-4a59-96b0-2d6594b6c8c8-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:44:17 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8d2626b9-c717-4472-8d54-4387a8d697ff tempest-VolumesTransfersV357Test-2103462250 None] Lock "cinder-331599f8-6b7a-4a59-96b0-2d6594b6c8c8-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:44:17 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8d2626b9-c717-4472-8d54-4387a8d697ff tempest-VolumesTransfersV357Test-2103462250 None] Acquiring lock "cinder-quobyte-331599f8-6b7a-4a59-96b0-2d6594b6c8c8" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:44:17 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8d2626b9-c717-4472-8d54-4387a8d697ff tempest-VolumesTransfersV357Test-2103462250 None] Lock "cinder-quobyte-331599f8-6b7a-4a59-96b0-2d6594b6c8c8" acquired by "delete_volume" :: waited 0.056s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:44:17 devstack sudo[98099]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6dd46530-7a21-4c48-9fa4-918a28f52007 tempest-VolumesActionsTest-1170390702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3fb0f975-0837-4556-b6b8-a887b89fe198" returned: 0 in 0.668s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6dd46530-7a21-4c48-9fa4-918a28f52007 tempest-VolumesActionsTest-1170390702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3fb0f975-0837-4556-b6b8-a887b89fe198 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:17 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2e6cb7-637c-4b83-8ff0-94dfa9b516a9]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:44:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8d2626b9-c717-4472-8d54-4387a8d697ff tempest-VolumesTransfersV357Test-2103462250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-331599f8-6b7a-4a59-96b0-2d6594b6c8c8 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:17 devstack sudo[98114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3fb0f975-0837-4556-b6b8-a887b89fe198 Jul 28 10:44:17 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:18 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6dd46530-7a21-4c48-9fa4-918a28f52007 tempest-VolumesActionsTest-1170390702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3fb0f975-0837-4556-b6b8-a887b89fe198" returned: 0 in 0.527s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:18 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-6dd46530-7a21-4c48-9fa4-918a28f52007 tempest-VolumesActionsTest-1170390702 None] Lock "cinder-quobyte-3fb0f975-0837-4556-b6b8-a887b89fe198" released by "delete_volume" :: held 1.270s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:44:18 devstack sudo[98115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-331599f8-6b7a-4a59-96b0-2d6594b6c8c8 Jul 28 10:44:18 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:18 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-6dd46530-7a21-4c48-9fa4-918a28f52007 tempest-VolumesActionsTest-1170390702 None] Created reservations ['a25269e9-497d-44be-a59d-1a616ae9b92f', '93df6ee5-c7c5-4b7f-b3c7-3af6b25d6dd5', '9a9faaaf-d797-4a10-8dd4-80240ea1aebc', 'bd8fafc4-afc5-4742-b45f-0048fa294a55'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:44:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-6dd46530-7a21-4c48-9fa4-918a28f52007 tempest-VolumesActionsTest-1170390702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:44:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-6dd46530-7a21-4c48-9fa4-918a28f52007 tempest-VolumesActionsTest-1170390702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:18 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-6dd46530-7a21-4c48-9fa4-918a28f52007 tempest-VolumesActionsTest-1170390702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:44:18 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-6dd46530-7a21-4c48-9fa4-918a28f52007 tempest-VolumesActionsTest-1170390702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:44:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-6dd46530-7a21-4c48-9fa4-918a28f52007 tempest-VolumesActionsTest-1170390702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6dd46530-7a21-4c48-9fa4-918a28f52007 tempest-VolumesActionsTest-1170390702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:18 devstack sudo[98133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:44:18 devstack sudo[98133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:18 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8d2626b9-c717-4472-8d54-4387a8d697ff tempest-VolumesTransfersV357Test-2103462250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-331599f8-6b7a-4a59-96b0-2d6594b6c8c8" returned: 0 in 1.343s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8d2626b9-c717-4472-8d54-4387a8d697ff tempest-VolumesTransfersV357Test-2103462250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-331599f8-6b7a-4a59-96b0-2d6594b6c8c8 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:19 devstack sudo[98158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-331599f8-6b7a-4a59-96b0-2d6594b6c8c8 Jul 28 10:44:19 devstack sudo[98158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:19 devstack sudo[98158]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8d2626b9-c717-4472-8d54-4387a8d697ff tempest-VolumesTransfersV357Test-2103462250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-331599f8-6b7a-4a59-96b0-2d6594b6c8c8" returned: 0 in 0.652s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:19 devstack sudo[98133]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6dd46530-7a21-4c48-9fa4-918a28f52007 tempest-VolumesActionsTest-1170390702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 1.248s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:19 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-6dd46530-7a21-4c48-9fa4-918a28f52007 tempest-VolumesActionsTest-1170390702 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:44:19 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-6dd46530-7a21-4c48-9fa4-918a28f52007 tempest-VolumesActionsTest-1170390702 None] Deleted volume successfully. Jul 28 10:44:19 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8d2626b9-c717-4472-8d54-4387a8d697ff tempest-VolumesTransfersV357Test-2103462250 None] Lock "cinder-quobyte-331599f8-6b7a-4a59-96b0-2d6594b6c8c8" released by "delete_volume" :: held 2.171s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:44:19 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-6dd46530-7a21-4c48-9fa4-918a28f52007 tempest-VolumesActionsTest-1170390702 None] Lock "cinder-3fb0f975-0837-4556-b6b8-a887b89fe198-delete_volume" released by "delete_volume" :: held 2.972s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:44:19 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-8d2626b9-c717-4472-8d54-4387a8d697ff tempest-VolumesTransfersV357Test-2103462250 None] Created reservations ['e8506f2f-b0f2-4f7c-82d4-75e513185cca', '93a0e259-ed67-4db1-bf3c-f2b5d0b72dbf', 'd66e65b7-eb3a-4637-836b-da77a7c47b72', 'caf42681-62be-4d69-814f-607722970e24'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:44:19 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-561fac02-bb04-4d7a-90fb-79ce5a612619 req-42abf027-a36e-4c40-82d3-8cf0772ef847 tempest-AttachVolumeNegativeTest-1916507259 None] Terminate volume connection completed successfully. Jul 28 10:44:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-561fac02-bb04-4d7a-90fb-79ce5a612619 req-42abf027-a36e-4c40-82d3-8cf0772ef847 tempest-AttachVolumeNegativeTest-1916507259 None] Deleting attachment 92701205-0599-4e4a-a48d-e77719c42e81. {{(pid=88413) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 10:44:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8d2626b9-c717-4472-8d54-4387a8d697ff tempest-VolumesTransfersV357Test-2103462250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:44:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8d2626b9-c717-4472-8d54-4387a8d697ff tempest-VolumesTransfersV357Test-2103462250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:20 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8d2626b9-c717-4472-8d54-4387a8d697ff tempest-VolumesTransfersV357Test-2103462250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:44:20 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8d2626b9-c717-4472-8d54-4387a8d697ff tempest-VolumesTransfersV357Test-2103462250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:44:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8d2626b9-c717-4472-8d54-4387a8d697ff tempest-VolumesTransfersV357Test-2103462250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8d2626b9-c717-4472-8d54-4387a8d697ff tempest-VolumesTransfersV357Test-2103462250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:20 devstack sudo[98196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:44:20 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:20 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8d2626b9-c717-4472-8d54-4387a8d697ff tempest-VolumesTransfersV357Test-2103462250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.436s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:20 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-8d2626b9-c717-4472-8d54-4387a8d697ff tempest-VolumesTransfersV357Test-2103462250 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:44:20 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-8d2626b9-c717-4472-8d54-4387a8d697ff tempest-VolumesTransfersV357Test-2103462250 None] Deleted volume successfully. Jul 28 10:44:20 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8d2626b9-c717-4472-8d54-4387a8d697ff tempest-VolumesTransfersV357Test-2103462250 None] Lock "cinder-331599f8-6b7a-4a59-96b0-2d6594b6c8c8-delete_volume" released by "delete_volume" :: held 3.383s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:44:23 devstack sudo[98097]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b516f54-f1bf-4103-900c-56803b53e55b" returned: 0 in 6.850s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:23 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[0208eb42-e3e0-4d70-81dc-04ab6b36514f]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:44:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:23 devstack sudo[98223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd Jul 28 10:44:23 devstack sudo[98223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:24 devstack sudo[98223]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd" returned: 0 in 0.671s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:24 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd, size 1024.00 MB, duration 6.85 sec, destination /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b516f54-f1bf-4103-900c-56803b53e55b {{(pid=88413) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 10:44:24 devstack cinder-volume[88413]: INFO cinder.image.image_utils [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Converted 1024.00 MB image at 149.48 MB/s Jul 28 10:44:24 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b516f54-f1bf-4103-900c-56803b53e55b is being set with open permissions: ugo+rw Jul 28 10:44:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b516f54-f1bf-4103-900c-56803b53e55b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:24 devstack sudo[98230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b516f54-f1bf-4103-900c-56803b53e55b Jul 28 10:44:24 devstack sudo[98230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:24 devstack sudo[98230]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b516f54-f1bf-4103-900c-56803b53e55b" returned: 0 in 0.323s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:24 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Lock "cinder-quobyte-4b516f54-f1bf-4103-900c-56803b53e55b" released by "_copy_volume_from_snapshot" :: held 8.856s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:44:24 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Lock "cinder-quobyte-59430c72-a3ee-4ed8-85a5-7464ccd8e409-4b516f54-f1bf-4103-900c-56803b53e55b" released by "_create_volume_from_snapshot" :: held 8.911s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:44:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.957s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:24 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aa3157b-cf4a-4246-89fd-786e99a32b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b516f54-f1bf-4103-900c-56803b53e55b', 'volume_size': 1, 'snapshot_id': '59430c72-a3ee-4ed8-85a5-7464ccd8e409'}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:24 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a94677a9-2f02-4aa8-b3da-b71e1734f1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:24 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Volume volume-4b516f54-f1bf-4103-900c-56803b53e55b (4b516f54-f1bf-4103-900c-56803b53e55b): created successfully Jul 28 10:44:24 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a94677a9-2f02-4aa8-b3da-b71e1734f1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:24 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Flow 'volume_create_manager' (15e0826d-8920-4202-8044-564a01a3feb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:44:24 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-64545159-5d17-44aa-a3d6-e1fe245f8aaf tempest-VolumesDeleteCascade-1527848463 None] Created volume successfully. Jul 28 10:44:25 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] Acquiring lock "cinder-6802819a-abfa-4f20-9054-6dd97d5713dd-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:44:25 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] Lock "cinder-6802819a-abfa-4f20-9054-6dd97d5713dd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:44:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] Performing cascade delete. {{(pid=88413) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 28 10:44:25 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] Acquiring lock "cinder-59430c72-a3ee-4ed8-85a5-7464ccd8e409-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:44:25 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] Lock "cinder-59430c72-a3ee-4ed8-85a5-7464ccd8e409-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:44:25 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] Acquiring lock "cinder-quobyte-6802819a-abfa-4f20-9054-6dd97d5713dd" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:44:25 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] Lock "cinder-quobyte-6802819a-abfa-4f20-9054-6dd97d5713dd" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:44:25 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] Acquiring lock "cinder-quobyte-59430c72-a3ee-4ed8-85a5-7464ccd8e409" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:44:25 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] Lock "cinder-quobyte-59430c72-a3ee-4ed8-85a5-7464ccd8e409" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:44:25 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] Deleting offline snapshot 59430c72-a3ee-4ed8-85a5-7464ccd8e409 of volume 6802819a-abfa-4f20-9054-6dd97d5713dd {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:44:25 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] snapshot_file for this snap is: volume-6802819a-abfa-4f20-9054-6dd97d5713dd.59430c72-a3ee-4ed8-85a5-7464ccd8e409 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:44:25 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dde9744-a412-431c-8626-cdb4283cf057]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:44:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd.59430c72-a3ee-4ed8-85a5-7464ccd8e409 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:25 devstack sudo[98236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd.59430c72-a3ee-4ed8-85a5-7464ccd8e409 Jul 28 10:44:25 devstack sudo[98236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:25 devstack sudo[98236]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd.59430c72-a3ee-4ed8-85a5-7464ccd8e409" returned: 0 in 0.441s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:25 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6802819a-abfa-4f20-9054-6dd97d5713dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:44:26 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[6deb68aa-d616-42c4-9f2f-0784c7c089da]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:44:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:26 devstack sudo[98241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd Jul 28 10:44:26 devstack sudo[98241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:26 devstack sudo[98241]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd" returned: 0 in 0.505s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd.59430c72-a3ee-4ed8-85a5-7464ccd8e409 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:26 devstack sudo[98247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd.59430c72-a3ee-4ed8-85a5-7464ccd8e409 Jul 28 10:44:26 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:27 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd.59430c72-a3ee-4ed8-85a5-7464ccd8e409" returned: 0 in 0.505s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd.59430c72-a3ee-4ed8-85a5-7464ccd8e409 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:27 devstack sudo[98253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd.59430c72-a3ee-4ed8-85a5-7464ccd8e409 Jul 28 10:44:27 devstack sudo[98253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:27 devstack sudo[98253]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd.59430c72-a3ee-4ed8-85a5-7464ccd8e409" returned: 0 in 0.282s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:27 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] Lock "cinder-quobyte-59430c72-a3ee-4ed8-85a5-7464ccd8e409" released by "_delete_snapshot" :: held 1.894s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:44:27 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] Lock "cinder-quobyte-6802819a-abfa-4f20-9054-6dd97d5713dd" released by "delete_snapshot" :: held 1.926s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:44:27 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] Created reservations ['29813824-e7b3-4155-879c-a65e9869d20a', '8ef76678-3d9b-4346-acbd-f6faffe71a3f', '0c8e7c2e-2787-4569-b4ae-c0151e9eb167', '64fd0de8-31ae-4d3e-ae3f-24f553762fb8'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:44:27 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] Delete snapshot completed successfully. Jul 28 10:44:27 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] Lock "cinder-59430c72-a3ee-4ed8-85a5-7464ccd8e409-delete_snapshot" released by "delete_snapshot" :: held 2.151s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:44:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] Snapshots deleted, issuing volume delete {{(pid=88413) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 28 10:44:27 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] Acquiring lock "cinder-quobyte-6802819a-abfa-4f20-9054-6dd97d5713dd" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:44:27 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] Lock "cinder-quobyte-6802819a-abfa-4f20-9054-6dd97d5713dd" acquired by "delete_volume" :: waited 0.018s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:44:27 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b76e7d4-43c3-4bec-8e42-7c8a970d8bea]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:44:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:27 devstack sudo[98256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd Jul 28 10:44:27 devstack sudo[98256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:28 devstack sudo[98256]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd" returned: 0 in 0.584s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:28 devstack sudo[98261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd Jul 28 10:44:28 devstack sudo[98261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:28 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:44:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:44:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:44:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:44:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:28 devstack sudo[98263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:44:28 devstack sudo[98263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:28 devstack sudo[98261]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6802819a-abfa-4f20-9054-6dd97d5713dd" returned: 0 in 0.314s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:28 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] Lock "cinder-quobyte-6802819a-abfa-4f20-9054-6dd97d5713dd" released by "delete_volume" :: held 0.983s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:44:28 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] Created reservations ['468cd78b-3c34-4c08-ad38-14c97f6edae3', 'e95d3f07-4f47-473c-9e3c-2ed92bf296d1', '66215b80-68b4-4ccc-a23a-f36628d6f0e4', '9cd3aec4-6eab-4e7b-8067-0292c4c784a5'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:44:28 devstack sudo[98263]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.361s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:28 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:44:28 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager._thread_info {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:44:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread count: 29 {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 10:44:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread info: [<_MainThread(MainThread, started 137939890385024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 10:44:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:44:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:44:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:44:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:28 devstack sudo[98267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:44:28 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:29 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.381s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:29 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:44:29 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] Deleted volume successfully. Jul 28 10:44:29 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1033b51d-70fe-472b-aa4e-33484fdfa5a7 tempest-VolumesDeleteCascade-1527848463 None] Lock "cinder-6802819a-abfa-4f20-9054-6dd97d5713dd-delete_volume" released by "delete_volume" :: held 3.880s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:44:29 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-7534eb14-76db-454f-bd28-bb14dd30e246 tempest-VolumesCloneTest-851449875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:44:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7534eb14-76db-454f-bd28-bb14dd30e246 tempest-VolumesCloneTest-851449875 None] Flow 'volume_create_manager' (1266e7ba-9e96-477e-9153-61690fc0172d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:44:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7534eb14-76db-454f-bd28-bb14dd30e246 tempest-VolumesCloneTest-851449875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b243f19-3c4a-44a4-ad66-fc29e198d98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7534eb14-76db-454f-bd28-bb14dd30e246 tempest-VolumesCloneTest-851449875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b243f19-3c4a-44a4-ad66-fc29e198d98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1778775602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b904e0a-496f-4a2a-8524-5bfce99b539d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89a883a2fe0c45b79e40ba5b0e13bede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:44:30Z,use_quota=True,user_id='b3377b7765fd4ab19ce91f45c5cdb3ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7534eb14-76db-454f-bd28-bb14dd30e246 tempest-VolumesCloneTest-851449875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eb409ec-dab1-43b9-9792-94df292303ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7534eb14-76db-454f-bd28-bb14dd30e246 tempest-VolumesCloneTest-851449875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eb409ec-dab1-43b9-9792-94df292303ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7534eb14-76db-454f-bd28-bb14dd30e246 tempest-VolumesCloneTest-851449875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b86fd66b-dfd6-449f-989c-e6bd09c3ad1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7534eb14-76db-454f-bd28-bb14dd30e246 tempest-VolumesCloneTest-851449875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b86fd66b-dfd6-449f-989c-e6bd09c3ad1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b904e0a-496f-4a2a-8524-5bfce99b539d', 'volume_name': 'volume-6b904e0a-496f-4a2a-8524-5bfce99b539d', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7534eb14-76db-454f-bd28-bb14dd30e246 tempest-VolumesCloneTest-851449875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c663c9ae-d634-407a-b671-fb2172979252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7534eb14-76db-454f-bd28-bb14dd30e246 tempest-VolumesCloneTest-851449875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c663c9ae-d634-407a-b671-fb2172979252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7534eb14-76db-454f-bd28-bb14dd30e246 tempest-VolumesCloneTest-851449875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46588b3f-f5bd-4a72-af55-893c393c4cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:29 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-7534eb14-76db-454f-bd28-bb14dd30e246 tempest-VolumesCloneTest-851449875 None] Volume 6b904e0a-496f-4a2a-8524-5bfce99b539d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b904e0a-496f-4a2a-8524-5bfce99b539d', 'volume_size': 1} Jul 28 10:44:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7534eb14-76db-454f-bd28-bb14dd30e246 tempest-VolumesCloneTest-851449875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:44:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7534eb14-76db-454f-bd28-bb14dd30e246 tempest-VolumesCloneTest-851449875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:29 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7534eb14-76db-454f-bd28-bb14dd30e246 tempest-VolumesCloneTest-851449875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1778775602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b904e0a-496f-4a2a-8524-5bfce99b539d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89a883a2fe0c45b79e40ba5b0e13bede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:44:30Z,use_quota=True,user_id='b3377b7765fd4ab19ce91f45c5cdb3ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:44:29 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-7534eb14-76db-454f-bd28-bb14dd30e246 tempest-VolumesCloneTest-851449875 None] Creating volume 6b904e0a-496f-4a2a-8524-5bfce99b539d {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:44:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7534eb14-76db-454f-bd28-bb14dd30e246 tempest-VolumesCloneTest-851449875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:44:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7534eb14-76db-454f-bd28-bb14dd30e246 tempest-VolumesCloneTest-851449875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:29 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7534eb14-76db-454f-bd28-bb14dd30e246 tempest-VolumesCloneTest-851449875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:44:29 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7534eb14-76db-454f-bd28-bb14dd30e246 tempest-VolumesCloneTest-851449875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:44:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7534eb14-76db-454f-bd28-bb14dd30e246 tempest-VolumesCloneTest-851449875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:29 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7534eb14-76db-454f-bd28-bb14dd30e246 tempest-VolumesCloneTest-851449875 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:44:29 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-7534eb14-76db-454f-bd28-bb14dd30e246 tempest-VolumesCloneTest-851449875 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:44:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7534eb14-76db-454f-bd28-bb14dd30e246 tempest-VolumesCloneTest-851449875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:29 devstack sudo[98271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d 1073741824 Jul 28 10:44:29 devstack sudo[98271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:29 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-6d4e2a70-2b5b-4e8d-b87b-9eace88b6a11 tempest-VolumesDeleteCascade-1527848463 None] Acquiring lock "cinder-4b516f54-f1bf-4103-900c-56803b53e55b-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:44:29 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-6d4e2a70-2b5b-4e8d-b87b-9eace88b6a11 tempest-VolumesDeleteCascade-1527848463 None] Lock "cinder-4b516f54-f1bf-4103-900c-56803b53e55b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:44:30 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-6d4e2a70-2b5b-4e8d-b87b-9eace88b6a11 tempest-VolumesDeleteCascade-1527848463 None] Acquiring lock "cinder-quobyte-4b516f54-f1bf-4103-900c-56803b53e55b" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:44:30 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-6d4e2a70-2b5b-4e8d-b87b-9eace88b6a11 tempest-VolumesDeleteCascade-1527848463 None] Lock "cinder-quobyte-4b516f54-f1bf-4103-900c-56803b53e55b" acquired by "delete_volume" :: waited 0.017s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:44:30 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc09de0-983c-4bef-9dde-09d83a4f9a51]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:44:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6d4e2a70-2b5b-4e8d-b87b-9eace88b6a11 tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b516f54-f1bf-4103-900c-56803b53e55b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:30 devstack sudo[98275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b516f54-f1bf-4103-900c-56803b53e55b Jul 28 10:44:30 devstack sudo[98275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:30 devstack sudo[98271]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7534eb14-76db-454f-bd28-bb14dd30e246 tempest-VolumesCloneTest-851449875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d 1073741824" returned: 0 in 0.618s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7534eb14-76db-454f-bd28-bb14dd30e246 tempest-VolumesCloneTest-851449875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:30 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d Jul 28 10:44:30 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:30 devstack sudo[98275]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6d4e2a70-2b5b-4e8d-b87b-9eace88b6a11 tempest-VolumesDeleteCascade-1527848463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b516f54-f1bf-4103-900c-56803b53e55b" returned: 0 in 0.446s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6d4e2a70-2b5b-4e8d-b87b-9eace88b6a11 tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b516f54-f1bf-4103-900c-56803b53e55b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:30 devstack sudo[98285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b516f54-f1bf-4103-900c-56803b53e55b Jul 28 10:44:30 devstack sudo[98285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:30 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7534eb14-76db-454f-bd28-bb14dd30e246 tempest-VolumesCloneTest-851449875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d" returned: 0 in 0.335s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:30 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7534eb14-76db-454f-bd28-bb14dd30e246 tempest-VolumesCloneTest-851449875 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:44:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7534eb14-76db-454f-bd28-bb14dd30e246 tempest-VolumesCloneTest-851449875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7534eb14-76db-454f-bd28-bb14dd30e246 tempest-VolumesCloneTest-851449875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46588b3f-f5bd-4a72-af55-893c393c4cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b904e0a-496f-4a2a-8524-5bfce99b539d', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7534eb14-76db-454f-bd28-bb14dd30e246 tempest-VolumesCloneTest-851449875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ce16051-f0ce-4b3b-9241-c465e09d55fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:30 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-7534eb14-76db-454f-bd28-bb14dd30e246 tempest-VolumesCloneTest-851449875 None] Volume volume-6b904e0a-496f-4a2a-8524-5bfce99b539d (6b904e0a-496f-4a2a-8524-5bfce99b539d): created successfully Jul 28 10:44:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7534eb14-76db-454f-bd28-bb14dd30e246 tempest-VolumesCloneTest-851449875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ce16051-f0ce-4b3b-9241-c465e09d55fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7534eb14-76db-454f-bd28-bb14dd30e246 tempest-VolumesCloneTest-851449875 None] Flow 'volume_create_manager' (1266e7ba-9e96-477e-9153-61690fc0172d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:44:30 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-7534eb14-76db-454f-bd28-bb14dd30e246 tempest-VolumesCloneTest-851449875 None] Created volume successfully. Jul 28 10:44:30 devstack sudo[98285]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6d4e2a70-2b5b-4e8d-b87b-9eace88b6a11 tempest-VolumesDeleteCascade-1527848463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b516f54-f1bf-4103-900c-56803b53e55b" returned: 0 in 0.354s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:30 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-6d4e2a70-2b5b-4e8d-b87b-9eace88b6a11 tempest-VolumesDeleteCascade-1527848463 None] Lock "cinder-quobyte-4b516f54-f1bf-4103-900c-56803b53e55b" released by "delete_volume" :: held 0.866s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:44:30 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-6d4e2a70-2b5b-4e8d-b87b-9eace88b6a11 tempest-VolumesDeleteCascade-1527848463 None] Created reservations ['a77ce642-fca7-45ff-ae59-30d2753e42e3', '0ed0fc04-e1f7-4869-95b8-0a8b8cb3d9ea', 'bdefd9db-78b2-4417-b784-25b02ae58597', '0f1edfe1-4b15-43e2-b07f-3dc5ebca8cbd'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:44:31 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf3a1b42-dbe1-4948-b8aa-05b95d19589d tempest-VolumesGetTest-1832246363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:44:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cf3a1b42-dbe1-4948-b8aa-05b95d19589d tempest-VolumesGetTest-1832246363 None] Flow 'volume_create_manager' (251bdaa2-191a-4bba-a771-4e0174c9d9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:44:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cf3a1b42-dbe1-4948-b8aa-05b95d19589d tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e68ff197-0375-4ac5-8816-cfaadacb2978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cf3a1b42-dbe1-4948-b8aa-05b95d19589d tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e68ff197-0375-4ac5-8816-cfaadacb2978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2096192541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=719d4520-af2e-47e6-a6e2-519b97ce8799,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5f444b5d8eb145c1a0d3a16c1a519eee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:44:31Z,use_quota=True,user_id='251d566d420f41bfb4f44a0ce4b38506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cf3a1b42-dbe1-4948-b8aa-05b95d19589d tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a79d9c9-c118-4bf5-b11a-709773f82c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cf3a1b42-dbe1-4948-b8aa-05b95d19589d tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a79d9c9-c118-4bf5-b11a-709773f82c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cf3a1b42-dbe1-4948-b8aa-05b95d19589d tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82aafb7e-bf97-4fdf-a325-05293f68d861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cf3a1b42-dbe1-4948-b8aa-05b95d19589d tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82aafb7e-bf97-4fdf-a325-05293f68d861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '719d4520-af2e-47e6-a6e2-519b97ce8799', 'volume_name': 'volume-719d4520-af2e-47e6-a6e2-519b97ce8799', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cf3a1b42-dbe1-4948-b8aa-05b95d19589d tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa07fa61-6add-4f81-bb50-7b1ed531062f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cf3a1b42-dbe1-4948-b8aa-05b95d19589d tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa07fa61-6add-4f81-bb50-7b1ed531062f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cf3a1b42-dbe1-4948-b8aa-05b95d19589d tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (219fd1af-d717-4aa9-b77c-cfa73edf6afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:31 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-cf3a1b42-dbe1-4948-b8aa-05b95d19589d tempest-VolumesGetTest-1832246363 None] Volume 719d4520-af2e-47e6-a6e2-519b97ce8799: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-719d4520-af2e-47e6-a6e2-519b97ce8799', 'volume_size': 1} Jul 28 10:44:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-cf3a1b42-dbe1-4948-b8aa-05b95d19589d tempest-VolumesGetTest-1832246363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:44:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-cf3a1b42-dbe1-4948-b8aa-05b95d19589d tempest-VolumesGetTest-1832246363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:31 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-cf3a1b42-dbe1-4948-b8aa-05b95d19589d tempest-VolumesGetTest-1832246363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2096192541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=719d4520-af2e-47e6-a6e2-519b97ce8799,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5f444b5d8eb145c1a0d3a16c1a519eee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:44:31Z,use_quota=True,user_id='251d566d420f41bfb4f44a0ce4b38506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:44:31 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-cf3a1b42-dbe1-4948-b8aa-05b95d19589d tempest-VolumesGetTest-1832246363 None] Creating volume 719d4520-af2e-47e6-a6e2-519b97ce8799 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:44:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-cf3a1b42-dbe1-4948-b8aa-05b95d19589d tempest-VolumesGetTest-1832246363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:44:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-cf3a1b42-dbe1-4948-b8aa-05b95d19589d tempest-VolumesGetTest-1832246363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:31 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-cf3a1b42-dbe1-4948-b8aa-05b95d19589d tempest-VolumesGetTest-1832246363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:44:31 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-cf3a1b42-dbe1-4948-b8aa-05b95d19589d tempest-VolumesGetTest-1832246363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:44:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-cf3a1b42-dbe1-4948-b8aa-05b95d19589d tempest-VolumesGetTest-1832246363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:31 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-cf3a1b42-dbe1-4948-b8aa-05b95d19589d tempest-VolumesGetTest-1832246363 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:44:31 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-cf3a1b42-dbe1-4948-b8aa-05b95d19589d tempest-VolumesGetTest-1832246363 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:44:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cf3a1b42-dbe1-4948-b8aa-05b95d19589d tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-719d4520-af2e-47e6-a6e2-519b97ce8799 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:31 devstack sudo[98289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-719d4520-af2e-47e6-a6e2-519b97ce8799 1073741824 Jul 28 10:44:31 devstack sudo[98289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-6d4e2a70-2b5b-4e8d-b87b-9eace88b6a11 tempest-VolumesDeleteCascade-1527848463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:44:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-6d4e2a70-2b5b-4e8d-b87b-9eace88b6a11 tempest-VolumesDeleteCascade-1527848463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:31 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-6d4e2a70-2b5b-4e8d-b87b-9eace88b6a11 tempest-VolumesDeleteCascade-1527848463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:44:31 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-6d4e2a70-2b5b-4e8d-b87b-9eace88b6a11 tempest-VolumesDeleteCascade-1527848463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:44:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-6d4e2a70-2b5b-4e8d-b87b-9eace88b6a11 tempest-VolumesDeleteCascade-1527848463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6d4e2a70-2b5b-4e8d-b87b-9eace88b6a11 tempest-VolumesDeleteCascade-1527848463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:31 devstack sudo[98291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:44:31 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:31 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6d4e2a70-2b5b-4e8d-b87b-9eace88b6a11 tempest-VolumesDeleteCascade-1527848463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.295s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:31 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-6d4e2a70-2b5b-4e8d-b87b-9eace88b6a11 tempest-VolumesDeleteCascade-1527848463 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:44:31 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-6d4e2a70-2b5b-4e8d-b87b-9eace88b6a11 tempest-VolumesDeleteCascade-1527848463 None] Deleted volume successfully. Jul 28 10:44:31 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-6d4e2a70-2b5b-4e8d-b87b-9eace88b6a11 tempest-VolumesDeleteCascade-1527848463 None] Lock "cinder-4b516f54-f1bf-4103-900c-56803b53e55b-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:44:31 devstack sudo[98289]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cf3a1b42-dbe1-4948-b8aa-05b95d19589d tempest-VolumesGetTest-1832246363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-719d4520-af2e-47e6-a6e2-519b97ce8799 1073741824" returned: 0 in 0.549s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cf3a1b42-dbe1-4948-b8aa-05b95d19589d tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-719d4520-af2e-47e6-a6e2-519b97ce8799 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:31 devstack sudo[98301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-719d4520-af2e-47e6-a6e2-519b97ce8799 Jul 28 10:44:31 devstack sudo[98301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:32 devstack sudo[98301]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cf3a1b42-dbe1-4948-b8aa-05b95d19589d tempest-VolumesGetTest-1832246363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-719d4520-af2e-47e6-a6e2-519b97ce8799" returned: 0 in 0.291s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:32 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-cf3a1b42-dbe1-4948-b8aa-05b95d19589d tempest-VolumesGetTest-1832246363 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:44:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-cf3a1b42-dbe1-4948-b8aa-05b95d19589d tempest-VolumesGetTest-1832246363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cf3a1b42-dbe1-4948-b8aa-05b95d19589d tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (219fd1af-d717-4aa9-b77c-cfa73edf6afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-719d4520-af2e-47e6-a6e2-519b97ce8799', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cf3a1b42-dbe1-4948-b8aa-05b95d19589d tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (756bc98c-394a-4490-a137-41f4b37ae308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:32 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-cf3a1b42-dbe1-4948-b8aa-05b95d19589d tempest-VolumesGetTest-1832246363 None] Volume volume-719d4520-af2e-47e6-a6e2-519b97ce8799 (719d4520-af2e-47e6-a6e2-519b97ce8799): created successfully Jul 28 10:44:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cf3a1b42-dbe1-4948-b8aa-05b95d19589d tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (756bc98c-394a-4490-a137-41f4b37ae308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cf3a1b42-dbe1-4948-b8aa-05b95d19589d tempest-VolumesGetTest-1832246363 None] Flow 'volume_create_manager' (251bdaa2-191a-4bba-a771-4e0174c9d9ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:44:32 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-cf3a1b42-dbe1-4948-b8aa-05b95d19589d tempest-VolumesGetTest-1832246363 None] Created volume successfully. Jul 28 10:44:32 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:44:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Flow 'volume_create_manager' (95d2d182-4efb-4e15-9294-3d4398ec8ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:44:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (903f052e-ccf9-4936-8620-d11bc48020b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (903f052e-ccf9-4936-8620-d11bc48020b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-566451121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c6355ee-d1ea-4599-9c50-cdc222e47d23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89a883a2fe0c45b79e40ba5b0e13bede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:44:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=6b904e0a-496f-4a2a-8524-5bfce99b539d,status='creating',terminated_at=None,updated_at=2026-07-28T08:44:32Z,use_quota=True,user_id='b3377b7765fd4ab19ce91f45c5cdb3ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cc1b02a-fef7-4b35-924e-d256f05c9016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cc1b02a-fef7-4b35-924e-d256f05c9016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e92e8b7-377a-4b28-8306-ea001dff146a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e92e8b7-377a-4b28-8306-ea001dff146a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0c6355ee-d1ea-4599-9c50-cdc222e47d23', 'volume_name': 'volume-0c6355ee-d1ea-4599-9c50-cdc222e47d23', 'volume_size': 2, 'source_volid': '6b904e0a-496f-4a2a-8524-5bfce99b539d', 'source_volstatus': 'available'}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ebde764-5a5b-4786-93d3-db85e12cf448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ebde764-5a5b-4786-93d3-db85e12cf448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c90de0-0a83-47ea-9e8f-eebab13be87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:32 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Volume 0c6355ee-d1ea-4599-9c50-cdc222e47d23: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0c6355ee-d1ea-4599-9c50-cdc222e47d23', 'volume_size': 2, 'source_volid': '6b904e0a-496f-4a2a-8524-5bfce99b539d', 'source_volstatus': 'available'} Jul 28 10:44:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:44:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:32 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Cloning volume 6b904e0a-496f-4a2a-8524-5bfce99b539d to volume 0c6355ee-d1ea-4599-9c50-cdc222e47d23 Jul 28 10:44:32 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Creating offline snapshot 23ee8a7e-8c39-4587-8efa-a43f1cb89092 of volume 6b904e0a-496f-4a2a-8524-5bfce99b539d {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:44:32 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8065b7-3e37-4701-a5b4-f5d869bdb078]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:44:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:32 devstack sudo[98304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d Jul 28 10:44:32 devstack sudo[98304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:33 devstack sudo[98304]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d" returned: 0 in 0.535s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d.23ee8a7e-8c39-4587-8efa-a43f1cb89092 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:33 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d.23ee8a7e-8c39-4587-8efa-a43f1cb89092 1G Jul 28 10:44:33 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:33 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d.23ee8a7e-8c39-4587-8efa-a43f1cb89092 1G" returned: 0 in 0.605s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b904e0a-496f-4a2a-8524-5bfce99b539d -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d.23ee8a7e-8c39-4587-8efa-a43f1cb89092 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:33 devstack sudo[98338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b904e0a-496f-4a2a-8524-5bfce99b539d -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d.23ee8a7e-8c39-4587-8efa-a43f1cb89092 Jul 28 10:44:33 devstack sudo[98338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:34 devstack sudo[98338]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b904e0a-496f-4a2a-8524-5bfce99b539d -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d.23ee8a7e-8c39-4587-8efa-a43f1cb89092" returned: 0 in 0.440s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:34 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d.23ee8a7e-8c39-4587-8efa-a43f1cb89092 is being set with open permissions: ugo+rw Jul 28 10:44:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d.23ee8a7e-8c39-4587-8efa-a43f1cb89092 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:34 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d.23ee8a7e-8c39-4587-8efa-a43f1cb89092 Jul 28 10:44:34 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:34 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eae177f-6b92-467b-8d74-16f2842e330f tempest-VolumesGetTest-1832246363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:44:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7eae177f-6b92-467b-8d74-16f2842e330f tempest-VolumesGetTest-1832246363 None] Flow 'volume_create_manager' (f98f1a46-486c-402c-a23b-31e9521fe628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:44:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7eae177f-6b92-467b-8d74-16f2842e330f tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81e70cda-6611-4f6d-a492-3ed90542beb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7eae177f-6b92-467b-8d74-16f2842e330f tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81e70cda-6611-4f6d-a492-3ed90542beb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:44:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1979080696',display_name='tempest-VolumesGetTest-Volume-60635717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d595ab7c-fa33-43e5-986f-65faa0b6f365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f444b5d8eb145c1a0d3a16c1a519eee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:44:34Z,use_quota=True,user_id='251d566d420f41bfb4f44a0ce4b38506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7eae177f-6b92-467b-8d74-16f2842e330f tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac1cd21b-613a-475c-a9fd-7daa1243f9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7eae177f-6b92-467b-8d74-16f2842e330f tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac1cd21b-613a-475c-a9fd-7daa1243f9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7eae177f-6b92-467b-8d74-16f2842e330f tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (195f1cfa-89b8-425f-9182-18472465e82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7eae177f-6b92-467b-8d74-16f2842e330f tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (195f1cfa-89b8-425f-9182-18472465e82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd595ab7c-fa33-43e5-986f-65faa0b6f365', 'volume_name': 'volume-d595ab7c-fa33-43e5-986f-65faa0b6f365', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7eae177f-6b92-467b-8d74-16f2842e330f tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (806c88ed-5dbb-409b-80a4-4d67f2d671c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7eae177f-6b92-467b-8d74-16f2842e330f tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (806c88ed-5dbb-409b-80a4-4d67f2d671c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7eae177f-6b92-467b-8d74-16f2842e330f tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9714fa39-f1f4-4d00-94db-8b55f066f84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:34 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-7eae177f-6b92-467b-8d74-16f2842e330f tempest-VolumesGetTest-1832246363 None] Volume d595ab7c-fa33-43e5-986f-65faa0b6f365: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d595ab7c-fa33-43e5-986f-65faa0b6f365', 'volume_size': 1} Jul 28 10:44:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7eae177f-6b92-467b-8d74-16f2842e330f tempest-VolumesGetTest-1832246363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:44:34 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d.23ee8a7e-8c39-4587-8efa-a43f1cb89092" returned: 0 in 0.351s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:34 devstack sudo[98346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d.info Jul 28 10:44:34 devstack sudo[98346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:34 devstack sudo[98346]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d.info" returned: 0 in 0.285s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:34 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d.info is being set with open permissions: ugo+rw Jul 28 10:44:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:34 devstack sudo[98349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d.info Jul 28 10:44:34 devstack sudo[98349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:35 devstack sudo[98349]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d.info" returned: 0 in 0.286s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:35 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Acquiring lock "cinder-quobyte-0c6355ee-d1ea-4599-9c50-cdc222e47d23" by "_copy_volume_from_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:44:35 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Lock "cinder-quobyte-0c6355ee-d1ea-4599-9c50-cdc222e47d23" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:44:35 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] snapshot: 23ee8a7e-8c39-4587-8efa-a43f1cb89092, volume: 0c6355ee-d1ea-4599-9c50-cdc222e47d23, {{(pid=88413) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 28 10:44:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:44:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:35 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:44:35 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:44:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:35 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bcf3ae-eca0-471a-b08f-01c595e9b920]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:44:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d.23ee8a7e-8c39-4587-8efa-a43f1cb89092 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:35 devstack sudo[98353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d.23ee8a7e-8c39-4587-8efa-a43f1cb89092 Jul 28 10:44:35 devstack sudo[98353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:35 devstack sudo[98353]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d.23ee8a7e-8c39-4587-8efa-a43f1cb89092" returned: 0 in 0.444s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:35 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b904e0a-496f-4a2a-8524-5bfce99b539d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:44:35 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d {{(pid=88413) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 28 10:44:35 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Creating direct copy from snapshot {{(pid=88413) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 28 10:44:35 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[688ed01c-5e56-417d-becf-af31c2b7d7b7]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:44:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:35 devstack sudo[98360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d Jul 28 10:44:35 devstack sudo[98360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:36 devstack sudo[98360]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d" returned: 0 in 0.551s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:36 devstack cinder-volume[88413]: DEBUG cinder.utils [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Path /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c6355ee-d1ea-4599-9c50-cdc222e47d23 not found in is_blk_device check {{(pid=88413) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 28 10:44:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c6355ee-d1ea-4599-9c50-cdc222e47d23 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:36 devstack sudo[98381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c6355ee-d1ea-4599-9c50-cdc222e47d23 Jul 28 10:44:36 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:41 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-d199e5ab-f5b4-46a5-95ce-7704e5bb7414 tempest-VolumesTransfersTest-102397712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:44:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d199e5ab-f5b4-46a5-95ce-7704e5bb7414 tempest-VolumesTransfersTest-102397712 None] Flow 'volume_create_manager' (25a71beb-43b1-4792-8c7a-6bfb6870d0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:44:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d199e5ab-f5b4-46a5-95ce-7704e5bb7414 tempest-VolumesTransfersTest-102397712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d68b0b69-6d9b-4595-9546-f96124f797f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d199e5ab-f5b4-46a5-95ce-7704e5bb7414 tempest-VolumesTransfersTest-102397712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d68b0b69-6d9b-4595-9546-f96124f797f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2028319045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcf0af7b-8324-4b4d-aefb-40a44ae386ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0da370f1acfd44749246ea05a7a99a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:44:41Z,use_quota=True,user_id='7b6cff9f4c0f4f4ebfb850ed8410717e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d199e5ab-f5b4-46a5-95ce-7704e5bb7414 tempest-VolumesTransfersTest-102397712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9059fa1-dfa2-4e3e-8d4a-ff8e01b4429b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d199e5ab-f5b4-46a5-95ce-7704e5bb7414 tempest-VolumesTransfersTest-102397712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9059fa1-dfa2-4e3e-8d4a-ff8e01b4429b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d199e5ab-f5b4-46a5-95ce-7704e5bb7414 tempest-VolumesTransfersTest-102397712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a65dfd44-5ce6-4627-a54b-212140015760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d199e5ab-f5b4-46a5-95ce-7704e5bb7414 tempest-VolumesTransfersTest-102397712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a65dfd44-5ce6-4627-a54b-212140015760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcf0af7b-8324-4b4d-aefb-40a44ae386ce', 'volume_name': 'volume-fcf0af7b-8324-4b4d-aefb-40a44ae386ce', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d199e5ab-f5b4-46a5-95ce-7704e5bb7414 tempest-VolumesTransfersTest-102397712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98a19e26-54d9-48b4-9587-31016eb1f64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d199e5ab-f5b4-46a5-95ce-7704e5bb7414 tempest-VolumesTransfersTest-102397712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98a19e26-54d9-48b4-9587-31016eb1f64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d199e5ab-f5b4-46a5-95ce-7704e5bb7414 tempest-VolumesTransfersTest-102397712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bc9bf6d-16e1-45e9-996b-9a8f896dcdad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:41 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-d199e5ab-f5b4-46a5-95ce-7704e5bb7414 tempest-VolumesTransfersTest-102397712 None] Volume fcf0af7b-8324-4b4d-aefb-40a44ae386ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcf0af7b-8324-4b4d-aefb-40a44ae386ce', 'volume_size': 1} Jul 28 10:44:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d199e5ab-f5b4-46a5-95ce-7704e5bb7414 tempest-VolumesTransfersTest-102397712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:44:42 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c6355ee-d1ea-4599-9c50-cdc222e47d23" returned: 0 in 6.425s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:42 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3db3728-20c1-4640-9b76-e8608fefda41]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:44:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:42 devstack sudo[98463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d Jul 28 10:44:42 devstack sudo[98463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:43 devstack sudo[98463]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d" returned: 0 in 0.619s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:43 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d, size 1024.00 MB, duration 6.43 sec, destination /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c6355ee-d1ea-4599-9c50-cdc222e47d23 {{(pid=88413) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 10:44:43 devstack cinder-volume[88413]: INFO cinder.image.image_utils [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Converted 1024.00 MB image at 159.35 MB/s Jul 28 10:44:43 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c6355ee-d1ea-4599-9c50-cdc222e47d23 is being set with open permissions: ugo+rw Jul 28 10:44:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c6355ee-d1ea-4599-9c50-cdc222e47d23 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:43 devstack sudo[98468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c6355ee-d1ea-4599-9c50-cdc222e47d23 Jul 28 10:44:43 devstack sudo[98468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:43 devstack sudo[98468]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c6355ee-d1ea-4599-9c50-cdc222e47d23" returned: 0 in 0.292s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:43 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Lock "cinder-quobyte-0c6355ee-d1ea-4599-9c50-cdc222e47d23" released by "_copy_volume_from_snapshot" :: held 8.450s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:44:43 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Acquiring lock "cinder-quobyte-23ee8a7e-8c39-4587-8efa-a43f1cb89092" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:44:43 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Lock "cinder-quobyte-23ee8a7e-8c39-4587-8efa-a43f1cb89092" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:44:43 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Deleting offline snapshot 23ee8a7e-8c39-4587-8efa-a43f1cb89092 of volume 6b904e0a-496f-4a2a-8524-5bfce99b539d {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:44:43 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] snapshot_file for this snap is: volume-6b904e0a-496f-4a2a-8524-5bfce99b539d.23ee8a7e-8c39-4587-8efa-a43f1cb89092 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:44:43 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7c5242-87b3-4cc1-b79f-82206bca2825]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:44:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d.23ee8a7e-8c39-4587-8efa-a43f1cb89092 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:43 devstack sudo[98472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d.23ee8a7e-8c39-4587-8efa-a43f1cb89092 Jul 28 10:44:43 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:44 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d.23ee8a7e-8c39-4587-8efa-a43f1cb89092" returned: 0 in 0.415s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:44 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b904e0a-496f-4a2a-8524-5bfce99b539d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:44:44 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6fa42b-ac08-48ef-b374-6f3178a0bbaa]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:44:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:44 devstack sudo[98478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d Jul 28 10:44:44 devstack sudo[98478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:44 devstack sudo[98478]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d" returned: 0 in 0.390s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d.23ee8a7e-8c39-4587-8efa-a43f1cb89092 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:44 devstack sudo[98483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d.23ee8a7e-8c39-4587-8efa-a43f1cb89092 Jul 28 10:44:44 devstack sudo[98483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:44 devstack sudo[98483]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d.23ee8a7e-8c39-4587-8efa-a43f1cb89092" returned: 0 in 0.328s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d.23ee8a7e-8c39-4587-8efa-a43f1cb89092 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:44 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d.23ee8a7e-8c39-4587-8efa-a43f1cb89092 Jul 28 10:44:44 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:45 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d.23ee8a7e-8c39-4587-8efa-a43f1cb89092" returned: 0 in 0.243s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:45 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Lock "cinder-quobyte-23ee8a7e-8c39-4587-8efa-a43f1cb89092" released by "_delete_snapshot" :: held 1.483s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:44:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.659s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7eae177f-6b92-467b-8d74-16f2842e330f tempest-VolumesGetTest-1832246363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.711s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:45 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7eae177f-6b92-467b-8d74-16f2842e330f tempest-VolumesGetTest-1832246363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:44:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1979080696',display_name='tempest-VolumesGetTest-Volume-60635717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d595ab7c-fa33-43e5-986f-65faa0b6f365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f444b5d8eb145c1a0d3a16c1a519eee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:44:34Z,use_quota=True,user_id='251d566d420f41bfb4f44a0ce4b38506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:44:45 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-7eae177f-6b92-467b-8d74-16f2842e330f tempest-VolumesGetTest-1832246363 None] Creating volume d595ab7c-fa33-43e5-986f-65faa0b6f365 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:44:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7eae177f-6b92-467b-8d74-16f2842e330f tempest-VolumesGetTest-1832246363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:44:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7eae177f-6b92-467b-8d74-16f2842e330f tempest-VolumesGetTest-1832246363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:45 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7eae177f-6b92-467b-8d74-16f2842e330f tempest-VolumesGetTest-1832246363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:44:45 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7eae177f-6b92-467b-8d74-16f2842e330f tempest-VolumesGetTest-1832246363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:44:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7eae177f-6b92-467b-8d74-16f2842e330f tempest-VolumesGetTest-1832246363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:45 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7eae177f-6b92-467b-8d74-16f2842e330f tempest-VolumesGetTest-1832246363 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:44:45 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-7eae177f-6b92-467b-8d74-16f2842e330f tempest-VolumesGetTest-1832246363 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:44:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7eae177f-6b92-467b-8d74-16f2842e330f tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d595ab7c-fa33-43e5-986f-65faa0b6f365 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:45 devstack sudo[98491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d595ab7c-fa33-43e5-986f-65faa0b6f365 1073741824 Jul 28 10:44:45 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c90de0-0a83-47ea-9e8f-eebab13be87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c6355ee-d1ea-4599-9c50-cdc222e47d23', 'volume_size': 2, 'source_volid': '6b904e0a-496f-4a2a-8524-5bfce99b539d', 'source_volstatus': 'available'}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:45 devstack sudo[98491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:45 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89ea83e4-cdf8-48ff-933e-7fe8c4b5b61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:45 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Volume volume-0c6355ee-d1ea-4599-9c50-cdc222e47d23 (0c6355ee-d1ea-4599-9c50-cdc222e47d23): created successfully Jul 28 10:44:45 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89ea83e4-cdf8-48ff-933e-7fe8c4b5b61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:45 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Flow 'volume_create_manager' (95d2d182-4efb-4e15-9294-3d4398ec8ac6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:44:45 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-6384b7ec-16ba-4020-a7c2-da720ae06f16 tempest-VolumesCloneTest-851449875 None] Created volume successfully. Jul 28 10:44:45 devstack sudo[98491]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7eae177f-6b92-467b-8d74-16f2842e330f tempest-VolumesGetTest-1832246363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d595ab7c-fa33-43e5-986f-65faa0b6f365 1073741824" returned: 0 in 0.441s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7eae177f-6b92-467b-8d74-16f2842e330f tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d595ab7c-fa33-43e5-986f-65faa0b6f365 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:45 devstack sudo[98497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d595ab7c-fa33-43e5-986f-65faa0b6f365 Jul 28 10:44:45 devstack sudo[98497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:45 devstack sudo[98497]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7eae177f-6b92-467b-8d74-16f2842e330f tempest-VolumesGetTest-1832246363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d595ab7c-fa33-43e5-986f-65faa0b6f365" returned: 0 in 0.263s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:46 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7eae177f-6b92-467b-8d74-16f2842e330f tempest-VolumesGetTest-1832246363 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:44:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7eae177f-6b92-467b-8d74-16f2842e330f tempest-VolumesGetTest-1832246363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d199e5ab-f5b4-46a5-95ce-7704e5bb7414 tempest-VolumesTransfersTest-102397712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.303s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:46 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-d199e5ab-f5b4-46a5-95ce-7704e5bb7414 tempest-VolumesTransfersTest-102397712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2028319045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcf0af7b-8324-4b4d-aefb-40a44ae386ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0da370f1acfd44749246ea05a7a99a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:44:41Z,use_quota=True,user_id='7b6cff9f4c0f4f4ebfb850ed8410717e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:44:46 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-d199e5ab-f5b4-46a5-95ce-7704e5bb7414 tempest-VolumesTransfersTest-102397712 None] Creating volume fcf0af7b-8324-4b4d-aefb-40a44ae386ce {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:44:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d199e5ab-f5b4-46a5-95ce-7704e5bb7414 tempest-VolumesTransfersTest-102397712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:44:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d199e5ab-f5b4-46a5-95ce-7704e5bb7414 tempest-VolumesTransfersTest-102397712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:46 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-d199e5ab-f5b4-46a5-95ce-7704e5bb7414 tempest-VolumesTransfersTest-102397712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:44:46 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-d199e5ab-f5b4-46a5-95ce-7704e5bb7414 tempest-VolumesTransfersTest-102397712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:44:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d199e5ab-f5b4-46a5-95ce-7704e5bb7414 tempest-VolumesTransfersTest-102397712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:46 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-d199e5ab-f5b4-46a5-95ce-7704e5bb7414 tempest-VolumesTransfersTest-102397712 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:44:46 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-d199e5ab-f5b4-46a5-95ce-7704e5bb7414 tempest-VolumesTransfersTest-102397712 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:44:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d199e5ab-f5b4-46a5-95ce-7704e5bb7414 tempest-VolumesTransfersTest-102397712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-fcf0af7b-8324-4b4d-aefb-40a44ae386ce 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:46 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7eae177f-6b92-467b-8d74-16f2842e330f tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9714fa39-f1f4-4d00-94db-8b55f066f84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d595ab7c-fa33-43e5-986f-65faa0b6f365', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:46 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7eae177f-6b92-467b-8d74-16f2842e330f tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba51e5ce-ef2a-44b4-9392-7f4ac5ad117b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:46 devstack sudo[98500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-fcf0af7b-8324-4b4d-aefb-40a44ae386ce 1073741824 Jul 28 10:44:46 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:46 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-7eae177f-6b92-467b-8d74-16f2842e330f tempest-VolumesGetTest-1832246363 None] Volume volume-d595ab7c-fa33-43e5-986f-65faa0b6f365 (d595ab7c-fa33-43e5-986f-65faa0b6f365): created successfully Jul 28 10:44:46 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7eae177f-6b92-467b-8d74-16f2842e330f tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba51e5ce-ef2a-44b4-9392-7f4ac5ad117b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:46 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7eae177f-6b92-467b-8d74-16f2842e330f tempest-VolumesGetTest-1832246363 None] Flow 'volume_create_manager' (f98f1a46-486c-402c-a23b-31e9521fe628) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:44:46 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-7eae177f-6b92-467b-8d74-16f2842e330f tempest-VolumesGetTest-1832246363 None] Created volume successfully. Jul 28 10:44:46 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e5a84b46-a9e8-41c7-b682-2319ace9ea5f tempest-VolumesCloneTest-851449875 None] Acquiring lock "cinder-0c6355ee-d1ea-4599-9c50-cdc222e47d23-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:44:46 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e5a84b46-a9e8-41c7-b682-2319ace9ea5f tempest-VolumesCloneTest-851449875 None] Lock "cinder-0c6355ee-d1ea-4599-9c50-cdc222e47d23-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:44:46 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e5a84b46-a9e8-41c7-b682-2319ace9ea5f tempest-VolumesCloneTest-851449875 None] Acquiring lock "cinder-quobyte-0c6355ee-d1ea-4599-9c50-cdc222e47d23" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:44:46 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e5a84b46-a9e8-41c7-b682-2319ace9ea5f tempest-VolumesCloneTest-851449875 None] Lock "cinder-quobyte-0c6355ee-d1ea-4599-9c50-cdc222e47d23" acquired by "delete_volume" :: waited 0.022s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:44:46 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[51718332-1135-49c0-8f90-7552aecdfc0e]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:44:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e5a84b46-a9e8-41c7-b682-2319ace9ea5f tempest-VolumesCloneTest-851449875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c6355ee-d1ea-4599-9c50-cdc222e47d23 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:46 devstack sudo[98502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c6355ee-d1ea-4599-9c50-cdc222e47d23 Jul 28 10:44:46 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:46 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d199e5ab-f5b4-46a5-95ce-7704e5bb7414 tempest-VolumesTransfersTest-102397712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-fcf0af7b-8324-4b4d-aefb-40a44ae386ce 1073741824" returned: 0 in 0.461s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d199e5ab-f5b4-46a5-95ce-7704e5bb7414 tempest-VolumesTransfersTest-102397712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-fcf0af7b-8324-4b4d-aefb-40a44ae386ce {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:46 devstack sudo[98508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-fcf0af7b-8324-4b4d-aefb-40a44ae386ce Jul 28 10:44:46 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:46 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e5a84b46-a9e8-41c7-b682-2319ace9ea5f tempest-VolumesCloneTest-851449875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c6355ee-d1ea-4599-9c50-cdc222e47d23" returned: 0 in 0.448s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e5a84b46-a9e8-41c7-b682-2319ace9ea5f tempest-VolumesCloneTest-851449875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c6355ee-d1ea-4599-9c50-cdc222e47d23 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:46 devstack sudo[98513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c6355ee-d1ea-4599-9c50-cdc222e47d23 Jul 28 10:44:46 devstack sudo[98513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:46 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-940598a4-1273-4d7b-95fd-b3174a5737d5 tempest-VolumesGetTest-1832246363 None] Acquiring lock "cinder-d595ab7c-fa33-43e5-986f-65faa0b6f365-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:44:46 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-940598a4-1273-4d7b-95fd-b3174a5737d5 tempest-VolumesGetTest-1832246363 None] Lock "cinder-d595ab7c-fa33-43e5-986f-65faa0b6f365-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:44:46 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-940598a4-1273-4d7b-95fd-b3174a5737d5 tempest-VolumesGetTest-1832246363 None] Acquiring lock "cinder-quobyte-d595ab7c-fa33-43e5-986f-65faa0b6f365" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:44:46 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d199e5ab-f5b4-46a5-95ce-7704e5bb7414 tempest-VolumesTransfersTest-102397712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-fcf0af7b-8324-4b4d-aefb-40a44ae386ce" returned: 0 in 0.447s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:46 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-d199e5ab-f5b4-46a5-95ce-7704e5bb7414 tempest-VolumesTransfersTest-102397712 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:44:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d199e5ab-f5b4-46a5-95ce-7704e5bb7414 tempest-VolumesTransfersTest-102397712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:46 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-940598a4-1273-4d7b-95fd-b3174a5737d5 tempest-VolumesGetTest-1832246363 None] Lock "cinder-quobyte-d595ab7c-fa33-43e5-986f-65faa0b6f365" acquired by "delete_volume" :: waited 0.028s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:44:47 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d199e5ab-f5b4-46a5-95ce-7704e5bb7414 tempest-VolumesTransfersTest-102397712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bc9bf6d-16e1-45e9-996b-9a8f896dcdad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcf0af7b-8324-4b4d-aefb-40a44ae386ce', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:47 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d199e5ab-f5b4-46a5-95ce-7704e5bb7414 tempest-VolumesTransfersTest-102397712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ac783c-f320-43f5-bda9-776f8b4edf5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:47 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fe4c6a-3992-4dd0-9792-8c31b6c1a3ef]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:44:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-940598a4-1273-4d7b-95fd-b3174a5737d5 tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d595ab7c-fa33-43e5-986f-65faa0b6f365 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:47 devstack sudo[98513]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e5a84b46-a9e8-41c7-b682-2319ace9ea5f tempest-VolumesCloneTest-851449875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c6355ee-d1ea-4599-9c50-cdc222e47d23" returned: 0 in 0.310s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:47 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e5a84b46-a9e8-41c7-b682-2319ace9ea5f tempest-VolumesCloneTest-851449875 None] Lock "cinder-quobyte-0c6355ee-d1ea-4599-9c50-cdc222e47d23" released by "delete_volume" :: held 0.806s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:44:47 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-d199e5ab-f5b4-46a5-95ce-7704e5bb7414 tempest-VolumesTransfersTest-102397712 None] Volume volume-fcf0af7b-8324-4b4d-aefb-40a44ae386ce (fcf0af7b-8324-4b4d-aefb-40a44ae386ce): created successfully Jul 28 10:44:47 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d199e5ab-f5b4-46a5-95ce-7704e5bb7414 tempest-VolumesTransfersTest-102397712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ac783c-f320-43f5-bda9-776f8b4edf5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:47 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d199e5ab-f5b4-46a5-95ce-7704e5bb7414 tempest-VolumesTransfersTest-102397712 None] Flow 'volume_create_manager' (25a71beb-43b1-4792-8c7a-6bfb6870d0e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:44:47 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-d199e5ab-f5b4-46a5-95ce-7704e5bb7414 tempest-VolumesTransfersTest-102397712 None] Created volume successfully. Jul 28 10:44:47 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-e5a84b46-a9e8-41c7-b682-2319ace9ea5f tempest-VolumesCloneTest-851449875 None] Created reservations ['caa0c4a6-865b-4e7f-ae1e-543275f615c7', 'd1443e3c-0f38-4d1d-ad63-c0fe9f6e269f', '143f2d4c-a445-47c2-8f2a-b7c125786c60', 'e9c5ab10-c8d5-4ae9-bf62-93be13cf947b'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:44:47 devstack sudo[98517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d595ab7c-fa33-43e5-986f-65faa0b6f365 Jul 28 10:44:47 devstack sudo[98517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e5a84b46-a9e8-41c7-b682-2319ace9ea5f tempest-VolumesCloneTest-851449875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:44:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e5a84b46-a9e8-41c7-b682-2319ace9ea5f tempest-VolumesCloneTest-851449875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:47 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e5a84b46-a9e8-41c7-b682-2319ace9ea5f tempest-VolumesCloneTest-851449875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:44:47 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e5a84b46-a9e8-41c7-b682-2319ace9ea5f tempest-VolumesCloneTest-851449875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:44:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e5a84b46-a9e8-41c7-b682-2319ace9ea5f tempest-VolumesCloneTest-851449875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e5a84b46-a9e8-41c7-b682-2319ace9ea5f tempest-VolumesCloneTest-851449875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:47 devstack sudo[98519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:44:47 devstack sudo[98519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:47 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-5c8b33e4-40d3-44a0-92cc-ce9fdd27eea8 tempest-VolumesCloneTest-851449875 None] Acquiring lock "cinder-6b904e0a-496f-4a2a-8524-5bfce99b539d-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:44:47 devstack sudo[98517]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-940598a4-1273-4d7b-95fd-b3174a5737d5 tempest-VolumesGetTest-1832246363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d595ab7c-fa33-43e5-986f-65faa0b6f365" returned: 0 in 0.415s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-940598a4-1273-4d7b-95fd-b3174a5737d5 tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d595ab7c-fa33-43e5-986f-65faa0b6f365 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:47 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-5c8b33e4-40d3-44a0-92cc-ce9fdd27eea8 tempest-VolumesCloneTest-851449875 None] Lock "cinder-6b904e0a-496f-4a2a-8524-5bfce99b539d-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:44:47 devstack sudo[98525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d595ab7c-fa33-43e5-986f-65faa0b6f365 Jul 28 10:44:47 devstack sudo[98525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:47 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-5c8b33e4-40d3-44a0-92cc-ce9fdd27eea8 tempest-VolumesCloneTest-851449875 None] Acquiring lock "cinder-quobyte-6b904e0a-496f-4a2a-8524-5bfce99b539d" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:44:47 devstack sudo[98519]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:47 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-5c8b33e4-40d3-44a0-92cc-ce9fdd27eea8 tempest-VolumesCloneTest-851449875 None] Lock "cinder-quobyte-6b904e0a-496f-4a2a-8524-5bfce99b539d" acquired by "delete_volume" :: waited 0.020s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:44:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e5a84b46-a9e8-41c7-b682-2319ace9ea5f tempest-VolumesCloneTest-851449875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.375s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:47 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-e5a84b46-a9e8-41c7-b682-2319ace9ea5f tempest-VolumesCloneTest-851449875 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:44:47 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-e5a84b46-a9e8-41c7-b682-2319ace9ea5f tempest-VolumesCloneTest-851449875 None] Deleted volume successfully. Jul 28 10:44:47 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e4fb8b-c3a3-4680-b46b-65e94dc67ada]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:44:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5c8b33e4-40d3-44a0-92cc-ce9fdd27eea8 tempest-VolumesCloneTest-851449875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:47 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e5a84b46-a9e8-41c7-b682-2319ace9ea5f tempest-VolumesCloneTest-851449875 None] Lock "cinder-0c6355ee-d1ea-4599-9c50-cdc222e47d23-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:44:47 devstack sudo[98525]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:47 devstack sudo[98528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d Jul 28 10:44:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-940598a4-1273-4d7b-95fd-b3174a5737d5 tempest-VolumesGetTest-1832246363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d595ab7c-fa33-43e5-986f-65faa0b6f365" returned: 0 in 0.354s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:47 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:47 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-940598a4-1273-4d7b-95fd-b3174a5737d5 tempest-VolumesGetTest-1832246363 None] Lock "cinder-quobyte-d595ab7c-fa33-43e5-986f-65faa0b6f365" released by "delete_volume" :: held 0.836s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:44:47 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-940598a4-1273-4d7b-95fd-b3174a5737d5 tempest-VolumesGetTest-1832246363 None] Created reservations ['b9eea37b-fd5f-49da-b804-7ccbef5e2cf3', 'c23df71d-af7b-4462-b55f-5134fbf95734', '338c453e-f80d-411c-ae65-3bbfebd75879', '88dccb5d-cc0a-4388-9ed5-29673aa2bf7c'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:44:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-940598a4-1273-4d7b-95fd-b3174a5737d5 tempest-VolumesGetTest-1832246363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:44:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-940598a4-1273-4d7b-95fd-b3174a5737d5 tempest-VolumesGetTest-1832246363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:48 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-940598a4-1273-4d7b-95fd-b3174a5737d5 tempest-VolumesGetTest-1832246363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:44:48 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-940598a4-1273-4d7b-95fd-b3174a5737d5 tempest-VolumesGetTest-1832246363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:44:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-940598a4-1273-4d7b-95fd-b3174a5737d5 tempest-VolumesGetTest-1832246363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-940598a4-1273-4d7b-95fd-b3174a5737d5 tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:48 devstack sudo[98533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:44:48 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:48 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5c8b33e4-40d3-44a0-92cc-ce9fdd27eea8 tempest-VolumesCloneTest-851449875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d" returned: 0 in 0.563s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5c8b33e4-40d3-44a0-92cc-ce9fdd27eea8 tempest-VolumesCloneTest-851449875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-73d7c85d-2618-4e4e-b46a-af60542cef93 tempest-VolumesGetTest-1832246363 None] Acquiring lock "cinder-719d4520-af2e-47e6-a6e2-519b97ce8799-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:44:48 devstack sudo[98536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d Jul 28 10:44:48 devstack sudo[98536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-73d7c85d-2618-4e4e-b46a-af60542cef93 tempest-VolumesGetTest-1832246363 None] Lock "cinder-719d4520-af2e-47e6-a6e2-519b97ce8799-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:44:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-73d7c85d-2618-4e4e-b46a-af60542cef93 tempest-VolumesGetTest-1832246363 None] Acquiring lock "cinder-quobyte-719d4520-af2e-47e6-a6e2-519b97ce8799" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:44:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-73d7c85d-2618-4e4e-b46a-af60542cef93 tempest-VolumesGetTest-1832246363 None] Lock "cinder-quobyte-719d4520-af2e-47e6-a6e2-519b97ce8799" acquired by "delete_volume" :: waited 0.037s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:44:48 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d27aaf6-e666-4d32-801b-2a86c4fb4023]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:44:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-73d7c85d-2618-4e4e-b46a-af60542cef93 tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-719d4520-af2e-47e6-a6e2-519b97ce8799 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:48 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-940598a4-1273-4d7b-95fd-b3174a5737d5 tempest-VolumesGetTest-1832246363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.537s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:48 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-940598a4-1273-4d7b-95fd-b3174a5737d5 tempest-VolumesGetTest-1832246363 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:44:48 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-940598a4-1273-4d7b-95fd-b3174a5737d5 tempest-VolumesGetTest-1832246363 None] Deleted volume successfully. Jul 28 10:44:48 devstack sudo[98536]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5c8b33e4-40d3-44a0-92cc-ce9fdd27eea8 tempest-VolumesCloneTest-851449875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6b904e0a-496f-4a2a-8524-5bfce99b539d" returned: 0 in 0.440s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-940598a4-1273-4d7b-95fd-b3174a5737d5 tempest-VolumesGetTest-1832246363 None] Lock "cinder-d595ab7c-fa33-43e5-986f-65faa0b6f365-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:44:48 devstack sudo[98539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-719d4520-af2e-47e6-a6e2-519b97ce8799 Jul 28 10:44:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-5c8b33e4-40d3-44a0-92cc-ce9fdd27eea8 tempest-VolumesCloneTest-851449875 None] Lock "cinder-quobyte-6b904e0a-496f-4a2a-8524-5bfce99b539d" released by "delete_volume" :: held 1.102s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:44:48 devstack sudo[98539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:48 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-5c8b33e4-40d3-44a0-92cc-ce9fdd27eea8 tempest-VolumesCloneTest-851449875 None] Created reservations ['cb0f8ac7-17c5-4cc4-9178-bbb6fbfb04e2', '36c8cd54-4fd2-4781-b708-2a810718b0ce', '759b7194-ea4f-4e18-8dcd-975281fe074e', '7fb7b0f5-083a-4976-b9ea-ca056bc6add6'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:44:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5c8b33e4-40d3-44a0-92cc-ce9fdd27eea8 tempest-VolumesCloneTest-851449875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:44:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5c8b33e4-40d3-44a0-92cc-ce9fdd27eea8 tempest-VolumesCloneTest-851449875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:48 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5c8b33e4-40d3-44a0-92cc-ce9fdd27eea8 tempest-VolumesCloneTest-851449875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:44:48 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5c8b33e4-40d3-44a0-92cc-ce9fdd27eea8 tempest-VolumesCloneTest-851449875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:44:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5c8b33e4-40d3-44a0-92cc-ce9fdd27eea8 tempest-VolumesCloneTest-851449875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5c8b33e4-40d3-44a0-92cc-ce9fdd27eea8 tempest-VolumesCloneTest-851449875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:48 devstack sudo[98542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:44:48 devstack sudo[98542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:48 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-08e19aff-7e9c-4bb3-9c3b-a32073d5f0bd tempest-VolumesTransfersTest-1535250488 None] Transfer volume completed successfully. Jul 28 10:44:48 devstack sudo[98539]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-73d7c85d-2618-4e4e-b46a-af60542cef93 tempest-VolumesGetTest-1832246363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-719d4520-af2e-47e6-a6e2-519b97ce8799" returned: 0 in 0.540s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-73d7c85d-2618-4e4e-b46a-af60542cef93 tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-719d4520-af2e-47e6-a6e2-519b97ce8799 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:49 devstack sudo[98547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-719d4520-af2e-47e6-a6e2-519b97ce8799 Jul 28 10:44:49 devstack sudo[98547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:49 devstack sudo[98542]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5c8b33e4-40d3-44a0-92cc-ce9fdd27eea8 tempest-VolumesCloneTest-851449875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.324s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:49 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-5c8b33e4-40d3-44a0-92cc-ce9fdd27eea8 tempest-VolumesCloneTest-851449875 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:44:49 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-5c8b33e4-40d3-44a0-92cc-ce9fdd27eea8 tempest-VolumesCloneTest-851449875 None] Deleted volume successfully. Jul 28 10:44:49 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-5c8b33e4-40d3-44a0-92cc-ce9fdd27eea8 tempest-VolumesCloneTest-851449875 None] Lock "cinder-6b904e0a-496f-4a2a-8524-5bfce99b539d-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:44:49 devstack sudo[98547]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-73d7c85d-2618-4e4e-b46a-af60542cef93 tempest-VolumesGetTest-1832246363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-719d4520-af2e-47e6-a6e2-519b97ce8799" returned: 0 in 0.349s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:49 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-73d7c85d-2618-4e4e-b46a-af60542cef93 tempest-VolumesGetTest-1832246363 None] Lock "cinder-quobyte-719d4520-af2e-47e6-a6e2-519b97ce8799" released by "delete_volume" :: held 0.962s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:44:49 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-73d7c85d-2618-4e4e-b46a-af60542cef93 tempest-VolumesGetTest-1832246363 None] Created reservations ['0143ee68-87e8-456b-b60d-6fb254b4b311', 'f73fdef5-3b13-49d8-9932-9c6124b56ba0', '48814447-dd07-43e3-992b-dc1dd93b3215', '16954bff-5df4-4c1c-b336-71170a8abac2'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:44:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-73d7c85d-2618-4e4e-b46a-af60542cef93 tempest-VolumesGetTest-1832246363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:44:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-73d7c85d-2618-4e4e-b46a-af60542cef93 tempest-VolumesGetTest-1832246363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:49 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-73d7c85d-2618-4e4e-b46a-af60542cef93 tempest-VolumesGetTest-1832246363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:44:49 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-73d7c85d-2618-4e4e-b46a-af60542cef93 tempest-VolumesGetTest-1832246363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:44:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-73d7c85d-2618-4e4e-b46a-af60542cef93 tempest-VolumesGetTest-1832246363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-73d7c85d-2618-4e4e-b46a-af60542cef93 tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:49 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-77c7a853-87fa-4454-afba-3312be821c3c tempest-VolumesTransfersTest-355398321 None] Acquiring lock "cinder-fcf0af7b-8324-4b4d-aefb-40a44ae386ce-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:44:49 devstack sudo[98552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:44:49 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:49 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-77c7a853-87fa-4454-afba-3312be821c3c tempest-VolumesTransfersTest-355398321 None] Lock "cinder-fcf0af7b-8324-4b4d-aefb-40a44ae386ce-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:44:49 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-77c7a853-87fa-4454-afba-3312be821c3c tempest-VolumesTransfersTest-355398321 None] Acquiring lock "cinder-quobyte-fcf0af7b-8324-4b4d-aefb-40a44ae386ce" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:44:49 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-77c7a853-87fa-4454-afba-3312be821c3c tempest-VolumesTransfersTest-355398321 None] Lock "cinder-quobyte-fcf0af7b-8324-4b4d-aefb-40a44ae386ce" acquired by "delete_volume" :: waited 0.026s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:44:49 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[390cc39b-8d52-4cae-ae71-3b29b638fffe]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:44:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-77c7a853-87fa-4454-afba-3312be821c3c tempest-VolumesTransfersTest-355398321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-fcf0af7b-8324-4b4d-aefb-40a44ae386ce {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:49 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-73d7c85d-2618-4e4e-b46a-af60542cef93 tempest-VolumesGetTest-1832246363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.311s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:49 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-73d7c85d-2618-4e4e-b46a-af60542cef93 tempest-VolumesGetTest-1832246363 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:44:49 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-73d7c85d-2618-4e4e-b46a-af60542cef93 tempest-VolumesGetTest-1832246363 None] Deleted volume successfully. Jul 28 10:44:49 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-73d7c85d-2618-4e4e-b46a-af60542cef93 tempest-VolumesGetTest-1832246363 None] Lock "cinder-719d4520-af2e-47e6-a6e2-519b97ce8799-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:44:49 devstack sudo[98554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-fcf0af7b-8324-4b4d-aefb-40a44ae386ce Jul 28 10:44:49 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:50 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-77c7a853-87fa-4454-afba-3312be821c3c tempest-VolumesTransfersTest-355398321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-fcf0af7b-8324-4b4d-aefb-40a44ae386ce" returned: 0 in 0.447s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-77c7a853-87fa-4454-afba-3312be821c3c tempest-VolumesTransfersTest-355398321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-fcf0af7b-8324-4b4d-aefb-40a44ae386ce {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:50 devstack sudo[98560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-fcf0af7b-8324-4b4d-aefb-40a44ae386ce Jul 28 10:44:50 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:50 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-77c7a853-87fa-4454-afba-3312be821c3c tempest-VolumesTransfersTest-355398321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-fcf0af7b-8324-4b4d-aefb-40a44ae386ce" returned: 0 in 0.250s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-77c7a853-87fa-4454-afba-3312be821c3c tempest-VolumesTransfersTest-355398321 None] Lock "cinder-quobyte-fcf0af7b-8324-4b4d-aefb-40a44ae386ce" released by "delete_volume" :: held 0.782s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:44:50 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-77c7a853-87fa-4454-afba-3312be821c3c tempest-VolumesTransfersTest-355398321 None] Created reservations ['ef192853-164b-48a9-b085-e19f7ac79e9f', 'ced03e31-6ba5-4375-a5cc-669f5867a3d0', '919287a5-3685-4fa7-af41-dbf737d066c8', 'c6b19c26-a316-4044-962d-54aceb257e5d'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:44:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-77c7a853-87fa-4454-afba-3312be821c3c tempest-VolumesTransfersTest-355398321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:44:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-77c7a853-87fa-4454-afba-3312be821c3c tempest-VolumesTransfersTest-355398321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:50 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-77c7a853-87fa-4454-afba-3312be821c3c tempest-VolumesTransfersTest-355398321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:44:50 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-77c7a853-87fa-4454-afba-3312be821c3c tempest-VolumesTransfersTest-355398321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:44:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-77c7a853-87fa-4454-afba-3312be821c3c tempest-VolumesTransfersTest-355398321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-77c7a853-87fa-4454-afba-3312be821c3c tempest-VolumesTransfersTest-355398321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:50 devstack sudo[98563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:44:50 devstack sudo[98563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:51 devstack sudo[98563]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-77c7a853-87fa-4454-afba-3312be821c3c tempest-VolumesTransfersTest-355398321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.563s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:51 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-77c7a853-87fa-4454-afba-3312be821c3c tempest-VolumesTransfersTest-355398321 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:44:51 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-77c7a853-87fa-4454-afba-3312be821c3c tempest-VolumesTransfersTest-355398321 None] Deleted volume successfully. Jul 28 10:44:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-77c7a853-87fa-4454-afba-3312be821c3c tempest-VolumesTransfersTest-355398321 None] Lock "cinder-fcf0af7b-8324-4b4d-aefb-40a44ae386ce-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:44:51 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-62c6cc54-41a0-4359-87c0-7016bcafc84f tempest-VolumesGetTest-1832246363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:44:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-62c6cc54-41a0-4359-87c0-7016bcafc84f tempest-VolumesGetTest-1832246363 None] Flow 'volume_create_manager' (eae9381c-0df2-47ea-9e51-5cb34eb99acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:44:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-62c6cc54-41a0-4359-87c0-7016bcafc84f tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3650c0d-30ad-4d90-bd89-023206a291cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-62c6cc54-41a0-4359-87c0-7016bcafc84f tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3650c0d-30ad-4d90-bd89-023206a291cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-477597074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f444b5d8eb145c1a0d3a16c1a519eee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:44:51Z,use_quota=True,user_id='251d566d420f41bfb4f44a0ce4b38506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-62c6cc54-41a0-4359-87c0-7016bcafc84f tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cec997bc-e255-402c-acd8-90f8d19bf862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-62c6cc54-41a0-4359-87c0-7016bcafc84f tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cec997bc-e255-402c-acd8-90f8d19bf862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-62c6cc54-41a0-4359-87c0-7016bcafc84f tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f885cea4-4107-4151-8246-c39eedde3568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-62c6cc54-41a0-4359-87c0-7016bcafc84f tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f885cea4-4107-4151-8246-c39eedde3568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1', 'volume_name': 'volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-62c6cc54-41a0-4359-87c0-7016bcafc84f tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ff5f581-156e-4df3-b777-566b8783c898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-62c6cc54-41a0-4359-87c0-7016bcafc84f tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ff5f581-156e-4df3-b777-566b8783c898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-62c6cc54-41a0-4359-87c0-7016bcafc84f tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33b6799f-7175-49a5-a265-d78e93775693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:51 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-62c6cc54-41a0-4359-87c0-7016bcafc84f tempest-VolumesGetTest-1832246363 None] Volume 44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1', 'volume_size': 1} Jul 28 10:44:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-62c6cc54-41a0-4359-87c0-7016bcafc84f tempest-VolumesGetTest-1832246363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:44:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-62c6cc54-41a0-4359-87c0-7016bcafc84f tempest-VolumesGetTest-1832246363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:51 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-62c6cc54-41a0-4359-87c0-7016bcafc84f tempest-VolumesGetTest-1832246363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-477597074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f444b5d8eb145c1a0d3a16c1a519eee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:44:51Z,use_quota=True,user_id='251d566d420f41bfb4f44a0ce4b38506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:44:51 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-62c6cc54-41a0-4359-87c0-7016bcafc84f tempest-VolumesGetTest-1832246363 None] Creating volume 44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:44:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-62c6cc54-41a0-4359-87c0-7016bcafc84f tempest-VolumesGetTest-1832246363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:44:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-62c6cc54-41a0-4359-87c0-7016bcafc84f tempest-VolumesGetTest-1832246363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:51 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-62c6cc54-41a0-4359-87c0-7016bcafc84f tempest-VolumesGetTest-1832246363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:44:51 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-62c6cc54-41a0-4359-87c0-7016bcafc84f tempest-VolumesGetTest-1832246363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:44:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-62c6cc54-41a0-4359-87c0-7016bcafc84f tempest-VolumesGetTest-1832246363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:51 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-62c6cc54-41a0-4359-87c0-7016bcafc84f tempest-VolumesGetTest-1832246363 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:44:51 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-62c6cc54-41a0-4359-87c0-7016bcafc84f tempest-VolumesGetTest-1832246363 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:44:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-62c6cc54-41a0-4359-87c0-7016bcafc84f tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:51 devstack sudo[98567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1 1073741824 Jul 28 10:44:51 devstack sudo[98567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:51 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-adfe0f52-3db3-4768-8e01-14dd8a8ec842 tempest-VolumesTransfersTest-102397712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:44:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-adfe0f52-3db3-4768-8e01-14dd8a8ec842 tempest-VolumesTransfersTest-102397712 None] Flow 'volume_create_manager' (d3771666-cea2-4a8b-b0e0-10acb74b6c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:44:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-adfe0f52-3db3-4768-8e01-14dd8a8ec842 tempest-VolumesTransfersTest-102397712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdcb51fa-2d15-4aa7-a982-9b18efad216a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-adfe0f52-3db3-4768-8e01-14dd8a8ec842 tempest-VolumesTransfersTest-102397712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdcb51fa-2d15-4aa7-a982-9b18efad216a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-776539782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ca8564c-cbcb-49fc-ab97-fd4f116bfa1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0da370f1acfd44749246ea05a7a99a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:44:52Z,use_quota=True,user_id='7b6cff9f4c0f4f4ebfb850ed8410717e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-adfe0f52-3db3-4768-8e01-14dd8a8ec842 tempest-VolumesTransfersTest-102397712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92ad1c40-ddbe-450e-b728-5bd796b83cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-adfe0f52-3db3-4768-8e01-14dd8a8ec842 tempest-VolumesTransfersTest-102397712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92ad1c40-ddbe-450e-b728-5bd796b83cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-adfe0f52-3db3-4768-8e01-14dd8a8ec842 tempest-VolumesTransfersTest-102397712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47ad907e-54b4-4fb5-b1c9-0c9f5bf3854c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-adfe0f52-3db3-4768-8e01-14dd8a8ec842 tempest-VolumesTransfersTest-102397712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47ad907e-54b4-4fb5-b1c9-0c9f5bf3854c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ca8564c-cbcb-49fc-ab97-fd4f116bfa1a', 'volume_name': 'volume-4ca8564c-cbcb-49fc-ab97-fd4f116bfa1a', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-adfe0f52-3db3-4768-8e01-14dd8a8ec842 tempest-VolumesTransfersTest-102397712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf676a49-24da-431c-b1b0-88efe8fb66ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-adfe0f52-3db3-4768-8e01-14dd8a8ec842 tempest-VolumesTransfersTest-102397712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf676a49-24da-431c-b1b0-88efe8fb66ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-adfe0f52-3db3-4768-8e01-14dd8a8ec842 tempest-VolumesTransfersTest-102397712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a813323e-3812-4a7c-9791-270633a20651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:51 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-adfe0f52-3db3-4768-8e01-14dd8a8ec842 tempest-VolumesTransfersTest-102397712 None] Volume 4ca8564c-cbcb-49fc-ab97-fd4f116bfa1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ca8564c-cbcb-49fc-ab97-fd4f116bfa1a', 'volume_size': 1} Jul 28 10:44:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-adfe0f52-3db3-4768-8e01-14dd8a8ec842 tempest-VolumesTransfersTest-102397712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:44:52 devstack sudo[98567]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-62c6cc54-41a0-4359-87c0-7016bcafc84f tempest-VolumesGetTest-1832246363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1 1073741824" returned: 0 in 0.490s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-62c6cc54-41a0-4359-87c0-7016bcafc84f tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:52 devstack sudo[98573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1 Jul 28 10:44:52 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:52 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-62c6cc54-41a0-4359-87c0-7016bcafc84f tempest-VolumesGetTest-1832246363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1" returned: 0 in 0.264s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:52 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-62c6cc54-41a0-4359-87c0-7016bcafc84f tempest-VolumesGetTest-1832246363 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:44:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-62c6cc54-41a0-4359-87c0-7016bcafc84f tempest-VolumesGetTest-1832246363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-adfe0f52-3db3-4768-8e01-14dd8a8ec842 tempest-VolumesTransfersTest-102397712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.458s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:52 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-adfe0f52-3db3-4768-8e01-14dd8a8ec842 tempest-VolumesTransfersTest-102397712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-776539782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ca8564c-cbcb-49fc-ab97-fd4f116bfa1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0da370f1acfd44749246ea05a7a99a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:44:52Z,use_quota=True,user_id='7b6cff9f4c0f4f4ebfb850ed8410717e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:44:52 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-adfe0f52-3db3-4768-8e01-14dd8a8ec842 tempest-VolumesTransfersTest-102397712 None] Creating volume 4ca8564c-cbcb-49fc-ab97-fd4f116bfa1a {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:44:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-adfe0f52-3db3-4768-8e01-14dd8a8ec842 tempest-VolumesTransfersTest-102397712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:44:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-adfe0f52-3db3-4768-8e01-14dd8a8ec842 tempest-VolumesTransfersTest-102397712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:52 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-adfe0f52-3db3-4768-8e01-14dd8a8ec842 tempest-VolumesTransfersTest-102397712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:44:52 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-adfe0f52-3db3-4768-8e01-14dd8a8ec842 tempest-VolumesTransfersTest-102397712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:44:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-adfe0f52-3db3-4768-8e01-14dd8a8ec842 tempest-VolumesTransfersTest-102397712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:52 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-adfe0f52-3db3-4768-8e01-14dd8a8ec842 tempest-VolumesTransfersTest-102397712 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:44:52 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-adfe0f52-3db3-4768-8e01-14dd8a8ec842 tempest-VolumesTransfersTest-102397712 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:44:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-adfe0f52-3db3-4768-8e01-14dd8a8ec842 tempest-VolumesTransfersTest-102397712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4ca8564c-cbcb-49fc-ab97-fd4f116bfa1a 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:52 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-62c6cc54-41a0-4359-87c0-7016bcafc84f tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33b6799f-7175-49a5-a265-d78e93775693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:52 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-62c6cc54-41a0-4359-87c0-7016bcafc84f tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21582353-5da3-4b9e-8ead-a844333c70b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:52 devstack sudo[98576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4ca8564c-cbcb-49fc-ab97-fd4f116bfa1a 1073741824 Jul 28 10:44:52 devstack sudo[98576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:52 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-62c6cc54-41a0-4359-87c0-7016bcafc84f tempest-VolumesGetTest-1832246363 None] Volume volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1 (44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1): created successfully Jul 28 10:44:52 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-62c6cc54-41a0-4359-87c0-7016bcafc84f tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21582353-5da3-4b9e-8ead-a844333c70b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:52 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-62c6cc54-41a0-4359-87c0-7016bcafc84f tempest-VolumesGetTest-1832246363 None] Flow 'volume_create_manager' (eae9381c-0df2-47ea-9e51-5cb34eb99acd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:44:52 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-62c6cc54-41a0-4359-87c0-7016bcafc84f tempest-VolumesGetTest-1832246363 None] Created volume successfully. Jul 28 10:44:52 devstack sudo[98576]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-adfe0f52-3db3-4768-8e01-14dd8a8ec842 tempest-VolumesTransfersTest-102397712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4ca8564c-cbcb-49fc-ab97-fd4f116bfa1a 1073741824" returned: 0 in 0.568s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-adfe0f52-3db3-4768-8e01-14dd8a8ec842 tempest-VolumesTransfersTest-102397712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4ca8564c-cbcb-49fc-ab97-fd4f116bfa1a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:52 devstack sudo[98603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4ca8564c-cbcb-49fc-ab97-fd4f116bfa1a Jul 28 10:44:52 devstack sudo[98603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:53 devstack sudo[98603]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-adfe0f52-3db3-4768-8e01-14dd8a8ec842 tempest-VolumesTransfersTest-102397712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4ca8564c-cbcb-49fc-ab97-fd4f116bfa1a" returned: 0 in 0.411s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:53 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-adfe0f52-3db3-4768-8e01-14dd8a8ec842 tempest-VolumesTransfersTest-102397712 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:44:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-adfe0f52-3db3-4768-8e01-14dd8a8ec842 tempest-VolumesTransfersTest-102397712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:53 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-adfe0f52-3db3-4768-8e01-14dd8a8ec842 tempest-VolumesTransfersTest-102397712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a813323e-3812-4a7c-9791-270633a20651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ca8564c-cbcb-49fc-ab97-fd4f116bfa1a', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:53 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-adfe0f52-3db3-4768-8e01-14dd8a8ec842 tempest-VolumesTransfersTest-102397712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccf9a9c5-0fb0-4a75-b30e-58969ab33b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:53 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-adfe0f52-3db3-4768-8e01-14dd8a8ec842 tempest-VolumesTransfersTest-102397712 None] Volume volume-4ca8564c-cbcb-49fc-ab97-fd4f116bfa1a (4ca8564c-cbcb-49fc-ab97-fd4f116bfa1a): created successfully Jul 28 10:44:53 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-adfe0f52-3db3-4768-8e01-14dd8a8ec842 tempest-VolumesTransfersTest-102397712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccf9a9c5-0fb0-4a75-b30e-58969ab33b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:53 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-adfe0f52-3db3-4768-8e01-14dd8a8ec842 tempest-VolumesTransfersTest-102397712 None] Flow 'volume_create_manager' (d3771666-cea2-4a8b-b0e0-10acb74b6c87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:44:53 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-adfe0f52-3db3-4768-8e01-14dd8a8ec842 tempest-VolumesTransfersTest-102397712 None] Created volume successfully. Jul 28 10:44:53 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:44:53 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Flow 'volume_create_manager' (459a6eac-a6fb-4f68-97ac-698e29c1aaf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:44:53 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cb6349d-8498-4de4-865f-6cb8f0480e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:53 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cb6349d-8498-4de4-865f-6cb8f0480e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2031710616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e13f6d36-320b-4820-93af-a3e2a0ed7ddf,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5f444b5d8eb145c1a0d3a16c1a519eee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1,status='creating',terminated_at=None,updated_at=2026-07-28T08:44:54Z,use_quota=True,user_id='251d566d420f41bfb4f44a0ce4b38506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:54 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f15cc231-4843-4d08-8b52-a6000c9a814a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:54 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f15cc231-4843-4d08-8b52-a6000c9a814a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:54 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d15b10f-e365-4a3e-b80d-22ddcb0f865e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:54 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d15b10f-e365-4a3e-b80d-22ddcb0f865e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e13f6d36-320b-4820-93af-a3e2a0ed7ddf', 'volume_name': 'volume-e13f6d36-320b-4820-93af-a3e2a0ed7ddf', 'volume_size': 1, 'source_volid': '44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1', 'source_volstatus': 'available'}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:54 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0ba97f3-a5e8-413f-8042-de14c044de5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:54 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0ba97f3-a5e8-413f-8042-de14c044de5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:44:54 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a5b1990-5371-492e-9173-df1875a773da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:44:54 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Volume e13f6d36-320b-4820-93af-a3e2a0ed7ddf: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e13f6d36-320b-4820-93af-a3e2a0ed7ddf', 'volume_size': 1, 'source_volid': '44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1', 'source_volstatus': 'available'} Jul 28 10:44:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:44:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:54 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Cloning volume 44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1 to volume e13f6d36-320b-4820-93af-a3e2a0ed7ddf Jul 28 10:44:54 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Creating offline snapshot bbdef9de-038c-48c9-be33-b6440ddc2ac4 of volume 44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1 {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:44:54 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[202fbb93-6851-420d-a941-55f7a6060d17]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:44:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:54 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-6acb5506-b553-4515-8086-45516d01fbb7 tempest-VolumesTransfersTest-355398321 None] Acquiring lock "cinder-4ca8564c-cbcb-49fc-ab97-fd4f116bfa1a-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:44:54 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-6acb5506-b553-4515-8086-45516d01fbb7 tempest-VolumesTransfersTest-355398321 None] Lock "cinder-4ca8564c-cbcb-49fc-ab97-fd4f116bfa1a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:44:54 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-6acb5506-b553-4515-8086-45516d01fbb7 tempest-VolumesTransfersTest-355398321 None] Acquiring lock "cinder-quobyte-4ca8564c-cbcb-49fc-ab97-fd4f116bfa1a" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:44:54 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-6acb5506-b553-4515-8086-45516d01fbb7 tempest-VolumesTransfersTest-355398321 None] Lock "cinder-quobyte-4ca8564c-cbcb-49fc-ab97-fd4f116bfa1a" acquired by "delete_volume" :: waited 0.021s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:44:54 devstack sudo[98608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1 Jul 28 10:44:54 devstack sudo[98608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:54 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a7367a-3f08-4517-a481-ca2fd57196ca]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:44:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6acb5506-b553-4515-8086-45516d01fbb7 tempest-VolumesTransfersTest-355398321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4ca8564c-cbcb-49fc-ab97-fd4f116bfa1a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:54 devstack sudo[98610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4ca8564c-cbcb-49fc-ab97-fd4f116bfa1a Jul 28 10:44:54 devstack sudo[98610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:54 devstack sudo[98608]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1" returned: 0 in 0.446s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1.bbdef9de-038c-48c9-be33-b6440ddc2ac4 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:54 devstack sudo[98615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1.bbdef9de-038c-48c9-be33-b6440ddc2ac4 1G Jul 28 10:44:54 devstack sudo[98615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:54 devstack sudo[98610]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6acb5506-b553-4515-8086-45516d01fbb7 tempest-VolumesTransfersTest-355398321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4ca8564c-cbcb-49fc-ab97-fd4f116bfa1a" returned: 0 in 0.407s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6acb5506-b553-4515-8086-45516d01fbb7 tempest-VolumesTransfersTest-355398321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4ca8564c-cbcb-49fc-ab97-fd4f116bfa1a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:54 devstack sudo[98620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4ca8564c-cbcb-49fc-ab97-fd4f116bfa1a Jul 28 10:44:54 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:55 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6acb5506-b553-4515-8086-45516d01fbb7 tempest-VolumesTransfersTest-355398321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4ca8564c-cbcb-49fc-ab97-fd4f116bfa1a" returned: 0 in 0.307s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:55 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-6acb5506-b553-4515-8086-45516d01fbb7 tempest-VolumesTransfersTest-355398321 None] Lock "cinder-quobyte-4ca8564c-cbcb-49fc-ab97-fd4f116bfa1a" released by "delete_volume" :: held 0.768s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:44:55 devstack sudo[98615]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1.bbdef9de-038c-48c9-be33-b6440ddc2ac4 1G" returned: 0 in 0.495s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1.bbdef9de-038c-48c9-be33-b6440ddc2ac4 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:55 devstack sudo[98626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1.bbdef9de-038c-48c9-be33-b6440ddc2ac4 Jul 28 10:44:55 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:55 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-6acb5506-b553-4515-8086-45516d01fbb7 tempest-VolumesTransfersTest-355398321 None] Created reservations ['258267b0-ce51-4d4b-82a1-a43444b30d22', 'e7726a22-9050-456a-9856-447ca97441d7', '18f06b27-9406-4f34-b88b-d0b908a743b9', '2a942636-ee6b-434f-9d9a-876df92263df'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:44:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-6acb5506-b553-4515-8086-45516d01fbb7 tempest-VolumesTransfersTest-355398321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:44:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-6acb5506-b553-4515-8086-45516d01fbb7 tempest-VolumesTransfersTest-355398321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:55 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-6acb5506-b553-4515-8086-45516d01fbb7 tempest-VolumesTransfersTest-355398321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:44:55 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-6acb5506-b553-4515-8086-45516d01fbb7 tempest-VolumesTransfersTest-355398321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:44:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-6acb5506-b553-4515-8086-45516d01fbb7 tempest-VolumesTransfersTest-355398321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6acb5506-b553-4515-8086-45516d01fbb7 tempest-VolumesTransfersTest-355398321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:55 devstack sudo[98628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:44:55 devstack sudo[98628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:55 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1.bbdef9de-038c-48c9-be33-b6440ddc2ac4" returned: 0 in 0.401s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:55 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1.bbdef9de-038c-48c9-be33-b6440ddc2ac4 is being set with open permissions: ugo+rw Jul 28 10:44:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1.bbdef9de-038c-48c9-be33-b6440ddc2ac4 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:55 devstack sudo[98628]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6acb5506-b553-4515-8086-45516d01fbb7 tempest-VolumesTransfersTest-355398321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.302s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:55 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-6acb5506-b553-4515-8086-45516d01fbb7 tempest-VolumesTransfersTest-355398321 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:44:55 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-6acb5506-b553-4515-8086-45516d01fbb7 tempest-VolumesTransfersTest-355398321 None] Deleted volume successfully. Jul 28 10:44:55 devstack sudo[98635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1.bbdef9de-038c-48c9-be33-b6440ddc2ac4 Jul 28 10:44:55 devstack sudo[98635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:55 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-6acb5506-b553-4515-8086-45516d01fbb7 tempest-VolumesTransfersTest-355398321 None] Lock "cinder-4ca8564c-cbcb-49fc-ab97-fd4f116bfa1a-delete_volume" released by "delete_volume" :: held 1.330s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:44:55 devstack sudo[98635]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1.bbdef9de-038c-48c9-be33-b6440ddc2ac4" returned: 0 in 0.281s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:55 devstack sudo[98638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1.info Jul 28 10:44:55 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:56 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1.info" returned: 0 in 0.294s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:56 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1.info is being set with open permissions: ugo+rw Jul 28 10:44:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:56 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1.info Jul 28 10:44:56 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:56 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1.info" returned: 0 in 0.259s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:56 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Acquiring lock "cinder-quobyte-e13f6d36-320b-4820-93af-a3e2a0ed7ddf" by "_copy_volume_from_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:44:56 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Lock "cinder-quobyte-e13f6d36-320b-4820-93af-a3e2a0ed7ddf" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:44:56 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] snapshot: bbdef9de-038c-48c9-be33-b6440ddc2ac4, volume: e13f6d36-320b-4820-93af-a3e2a0ed7ddf, {{(pid=88413) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 28 10:44:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:44:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:44:56 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:44:56 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:44:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:44:56 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[3513824c-4e42-4f85-afbe-4ff0bedf9399]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:44:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1.bbdef9de-038c-48c9-be33-b6440ddc2ac4 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:56 devstack sudo[98644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1.bbdef9de-038c-48c9-be33-b6440ddc2ac4 Jul 28 10:44:56 devstack sudo[98644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:57 devstack sudo[98644]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1.bbdef9de-038c-48c9-be33-b6440ddc2ac4" returned: 0 in 0.486s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:57 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:44:57 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1 {{(pid=88413) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 28 10:44:57 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Creating direct copy from snapshot {{(pid=88413) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 28 10:44:57 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5aef94-2764-42ab-bd43-f4985e457b57]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:44:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:57 devstack sudo[98649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1 Jul 28 10:44:57 devstack sudo[98649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:44:57 devstack sudo[98649]: pam_unix(sudo:session): session closed for user root Jul 28 10:44:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1" returned: 0 in 0.415s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:44:57 devstack cinder-volume[88413]: DEBUG cinder.utils [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Path /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e13f6d36-320b-4820-93af-a3e2a0ed7ddf not found in is_blk_device check {{(pid=88413) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 28 10:44:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e13f6d36-320b-4820-93af-a3e2a0ed7ddf {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:44:57 devstack sudo[98655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e13f6d36-320b-4820-93af-a3e2a0ed7ddf Jul 28 10:44:57 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:04 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e13f6d36-320b-4820-93af-a3e2a0ed7ddf" returned: 0 in 6.684s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:04 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[698758ae-cc79-4870-8dd8-40ea2b8aba53]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:45:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:04 devstack sudo[98677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1 Jul 28 10:45:04 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:04 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=104,cinder:UPDATE=129,cinder:INSERT=29,cinder:DELETE=14 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:45:04 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=104,cinder:UPDATE=139,cinder:DELETE=10,cinder:INSERT=35 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:45:04 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff9e2607-eb2a-43b5-8382-6145061a2950 tempest-AttachVolumeNegativeTest-1916507259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:45:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ff9e2607-eb2a-43b5-8382-6145061a2950 tempest-AttachVolumeNegativeTest-1916507259 None] Flow 'volume_create_manager' (f2e4eaba-55d6-47aa-b2d7-ac3d45b2ab23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:45:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ff9e2607-eb2a-43b5-8382-6145061a2950 tempest-AttachVolumeNegativeTest-1916507259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62fac7e8-c3c3-4318-8b48-d9c9cd2edc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ff9e2607-eb2a-43b5-8382-6145061a2950 tempest-AttachVolumeNegativeTest-1916507259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62fac7e8-c3c3-4318-8b48-d9c9cd2edc12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1659867185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1a2fef8-e0ac-4e00-851d-8764b522cea7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8306ee0961b64f729ddf2ae1f6f7c568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:45:05Z,use_quota=True,user_id='212a545c1dd1403bba8809b9058c167a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ff9e2607-eb2a-43b5-8382-6145061a2950 tempest-AttachVolumeNegativeTest-1916507259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fa24f0a-9ec9-48e6-ae2e-1884f07d88b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ff9e2607-eb2a-43b5-8382-6145061a2950 tempest-AttachVolumeNegativeTest-1916507259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fa24f0a-9ec9-48e6-ae2e-1884f07d88b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ff9e2607-eb2a-43b5-8382-6145061a2950 tempest-AttachVolumeNegativeTest-1916507259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c0f3091-6d7b-4ffb-8b83-aed9b2e07cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ff9e2607-eb2a-43b5-8382-6145061a2950 tempest-AttachVolumeNegativeTest-1916507259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c0f3091-6d7b-4ffb-8b83-aed9b2e07cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1a2fef8-e0ac-4e00-851d-8764b522cea7', 'volume_name': 'volume-d1a2fef8-e0ac-4e00-851d-8764b522cea7', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ff9e2607-eb2a-43b5-8382-6145061a2950 tempest-AttachVolumeNegativeTest-1916507259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f0d5e44-505e-495e-8e36-dbc28262ec0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ff9e2607-eb2a-43b5-8382-6145061a2950 tempest-AttachVolumeNegativeTest-1916507259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f0d5e44-505e-495e-8e36-dbc28262ec0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ff9e2607-eb2a-43b5-8382-6145061a2950 tempest-AttachVolumeNegativeTest-1916507259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46a546a5-2ace-4ecb-9341-c65bd90dbb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:04 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-ff9e2607-eb2a-43b5-8382-6145061a2950 tempest-AttachVolumeNegativeTest-1916507259 None] Volume d1a2fef8-e0ac-4e00-851d-8764b522cea7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1a2fef8-e0ac-4e00-851d-8764b522cea7', 'volume_size': 1} Jul 28 10:45:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ff9e2607-eb2a-43b5-8382-6145061a2950 tempest-AttachVolumeNegativeTest-1916507259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:04 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1" returned: 0 in 0.820s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:04 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1, size 1024.00 MB, duration 6.69 sec, destination /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e13f6d36-320b-4820-93af-a3e2a0ed7ddf {{(pid=88413) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 10:45:04 devstack cinder-volume[88413]: INFO cinder.image.image_utils [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Converted 1024.00 MB image at 153.13 MB/s Jul 28 10:45:04 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e13f6d36-320b-4820-93af-a3e2a0ed7ddf is being set with open permissions: ugo+rw Jul 28 10:45:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e13f6d36-320b-4820-93af-a3e2a0ed7ddf {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:04 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e13f6d36-320b-4820-93af-a3e2a0ed7ddf Jul 28 10:45:04 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:05 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e13f6d36-320b-4820-93af-a3e2a0ed7ddf" returned: 0 in 0.283s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:05 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Lock "cinder-quobyte-e13f6d36-320b-4820-93af-a3e2a0ed7ddf" released by "_copy_volume_from_snapshot" :: held 8.797s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:45:05 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Acquiring lock "cinder-quobyte-bbdef9de-038c-48c9-be33-b6440ddc2ac4" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:45:05 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Lock "cinder-quobyte-bbdef9de-038c-48c9-be33-b6440ddc2ac4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:45:05 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Deleting offline snapshot bbdef9de-038c-48c9-be33-b6440ddc2ac4 of volume 44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:45:05 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] snapshot_file for this snap is: volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1.bbdef9de-038c-48c9-be33-b6440ddc2ac4 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:45:05 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[727e2943-04fd-4857-9967-c3a1d8e8e991]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:45:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1.bbdef9de-038c-48c9-be33-b6440ddc2ac4 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:05 devstack sudo[98685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1.bbdef9de-038c-48c9-be33-b6440ddc2ac4 Jul 28 10:45:05 devstack sudo[98685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:05 devstack sudo[98685]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1.bbdef9de-038c-48c9-be33-b6440ddc2ac4" returned: 0 in 0.442s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:05 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:45:05 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[4939fe35-c39b-4b73-93e2-76d5441548ba]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:45:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:05 devstack sudo[98691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1 Jul 28 10:45:05 devstack sudo[98691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:06 devstack sudo[98691]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1" returned: 0 in 0.432s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1.bbdef9de-038c-48c9-be33-b6440ddc2ac4 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:06 devstack sudo[98696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1.bbdef9de-038c-48c9-be33-b6440ddc2ac4 Jul 28 10:45:06 devstack sudo[98696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:06 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:45:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Flow 'volume_create_manager' (e6eecbba-962c-4932-954a-dffb63c6d3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:45:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2da9cc7a-63aa-4132-a47c-066a0fa2afc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2da9cc7a-63aa-4132-a47c-066a0fa2afc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-799755416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29addd50-5773-472a-8bba-85f36003e96a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8763ea2bb3d64ea8944b2d8aa57fa20d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:45:06Z,use_quota=True,user_id='d5997d42110c47108f36faebe040aca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (015d4a03-ac37-423f-b305-ebb40f243d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (015d4a03-ac37-423f-b305-ebb40f243d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c41419e-a211-431e-b734-a80bba410b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:06 devstack cinder-volume[88413]: DEBUG cinder.image.glance [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Creating Keystone auth plugin from conf {{(pid=88413) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 28 10:45:06 devstack sudo[98696]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1.bbdef9de-038c-48c9-be33-b6440ddc2ac4" returned: 0 in 0.487s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1.bbdef9de-038c-48c9-be33-b6440ddc2ac4 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c41419e-a211-431e-b734-a80bba410b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '29addd50-5773-472a-8bba-85f36003e96a', 'volume_name': 'volume-29addd50-5773-472a-8bba-85f36003e96a', 'volume_size': 1, 'image_id': '3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b606c34dd1dc45a6a010943235754dcb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'created_at': datetime.datetime(2026, 7, 28, 8, 30, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 8, 30, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c7ac9f7-f638-43c1-9c8d-41f36b0aec05/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82dacf84-87ef-4cbd-bcfe-93cba8538db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:06 devstack sudo[98701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1.bbdef9de-038c-48c9-be33-b6440ddc2ac4 Jul 28 10:45:06 devstack sudo[98701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82dacf84-87ef-4cbd-bcfe-93cba8538db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2a2d990-5958-4b63-9948-041d3c28a640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:06 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Volume 29addd50-5773-472a-8bba-85f36003e96a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-29addd50-5773-472a-8bba-85f36003e96a', 'volume_size': 1, 'image_id': '3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b606c34dd1dc45a6a010943235754dcb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'created_at': datetime.datetime(2026, 7, 28, 8, 30, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 8, 30, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c7ac9f7-f638-43c1-9c8d-41f36b0aec05/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 28 10:45:06 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Trying to clone 29addd50-5773-472a-8bba-85f36003e96a from image 3c7ac9f7-f638-43c1-9c8d-41f36b0aec05 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'metadata': {}}]). {{(pid=88413) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 28 10:45:07 devstack sudo[98701]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1.bbdef9de-038c-48c9-be33-b6440ddc2ac4" returned: 0 in 0.440s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:07 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_vimaadqpdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88413) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 28 10:45:07 devstack cinder-volume[88413]: INFO cinder.image.image_utils [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Image download 20.69 MB at 20.69 MB/s Jul 28 10:45:07 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Lock "cinder-quobyte-bbdef9de-038c-48c9-be33-b6440ddc2ac4" released by "_delete_snapshot" :: held 1.969s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:45:07 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[befc7a70-8cea-4bb0-9db1-6b3686cb03d3]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:45:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_vimaadqpdevstack@QuobyteHD {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.254s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ff9e2607-eb2a-43b5-8382-6145061a2950 tempest-AttachVolumeNegativeTest-1916507259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.621s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:07 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-ff9e2607-eb2a-43b5-8382-6145061a2950 tempest-AttachVolumeNegativeTest-1916507259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1659867185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1a2fef8-e0ac-4e00-851d-8764b522cea7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8306ee0961b64f729ddf2ae1f6f7c568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:45:05Z,use_quota=True,user_id='212a545c1dd1403bba8809b9058c167a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:45:07 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-ff9e2607-eb2a-43b5-8382-6145061a2950 tempest-AttachVolumeNegativeTest-1916507259 None] Creating volume d1a2fef8-e0ac-4e00-851d-8764b522cea7 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:45:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ff9e2607-eb2a-43b5-8382-6145061a2950 tempest-AttachVolumeNegativeTest-1916507259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ff9e2607-eb2a-43b5-8382-6145061a2950 tempest-AttachVolumeNegativeTest-1916507259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:07 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-ff9e2607-eb2a-43b5-8382-6145061a2950 tempest-AttachVolumeNegativeTest-1916507259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:45:07 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-ff9e2607-eb2a-43b5-8382-6145061a2950 tempest-AttachVolumeNegativeTest-1916507259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:45:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ff9e2607-eb2a-43b5-8382-6145061a2950 tempest-AttachVolumeNegativeTest-1916507259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:07 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-ff9e2607-eb2a-43b5-8382-6145061a2950 tempest-AttachVolumeNegativeTest-1916507259 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:45:07 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-ff9e2607-eb2a-43b5-8382-6145061a2950 tempest-AttachVolumeNegativeTest-1916507259 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:45:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ff9e2607-eb2a-43b5-8382-6145061a2950 tempest-AttachVolumeNegativeTest-1916507259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d1a2fef8-e0ac-4e00-851d-8764b522cea7 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:07 devstack sudo[98706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d1a2fef8-e0ac-4e00-851d-8764b522cea7 1073741824 Jul 28 10:45:07 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a5b1990-5371-492e-9173-df1875a773da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e13f6d36-320b-4820-93af-a3e2a0ed7ddf', 'volume_size': 1, 'source_volid': '44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1', 'source_volstatus': 'available'}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89ec0418-7d70-4d0c-b5af-b5347c1e1c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:07 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Volume volume-e13f6d36-320b-4820-93af-a3e2a0ed7ddf (e13f6d36-320b-4820-93af-a3e2a0ed7ddf): created successfully Jul 28 10:45:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89ec0418-7d70-4d0c-b5af-b5347c1e1c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Flow 'volume_create_manager' (459a6eac-a6fb-4f68-97ac-698e29c1aaf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:45:07 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-18cf2775-8e02-4e83-b393-3612439a9e4a tempest-VolumesGetTest-1832246363 None] Created volume successfully. Jul 28 10:45:07 devstack sudo[98705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_vimaadqpdevstack@QuobyteHD Jul 28 10:45:07 devstack sudo[98705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:07 devstack sudo[98705]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_vimaadqpdevstack@QuobyteHD" returned: 0 in 0.530s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:07 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Temporary image 3c7ac9f7-f638-43c1-9c8d-41f36b0aec05 is fetched for user d5997d42110c47108f36faebe040aca6. {{(pid=88413) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 28 10:45:07 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[8058460e-afb2-4ecf-a11d-bf5aec8a39e3]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:45:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_vimaadqpdevstack@QuobyteHD {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:08 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ff9e2607-eb2a-43b5-8382-6145061a2950 tempest-AttachVolumeNegativeTest-1916507259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d1a2fef8-e0ac-4e00-851d-8764b522cea7 1073741824" returned: 0 in 0.667s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ff9e2607-eb2a-43b5-8382-6145061a2950 tempest-AttachVolumeNegativeTest-1916507259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d1a2fef8-e0ac-4e00-851d-8764b522cea7 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:08 devstack sudo[98717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_vimaadqpdevstack@QuobyteHD Jul 28 10:45:08 devstack sudo[98717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:08 devstack sudo[98718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d1a2fef8-e0ac-4e00-851d-8764b522cea7 Jul 28 10:45:08 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:08 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ff9e2607-eb2a-43b5-8382-6145061a2950 tempest-AttachVolumeNegativeTest-1916507259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d1a2fef8-e0ac-4e00-851d-8764b522cea7" returned: 0 in 0.370s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:08 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-ff9e2607-eb2a-43b5-8382-6145061a2950 tempest-AttachVolumeNegativeTest-1916507259 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:45:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ff9e2607-eb2a-43b5-8382-6145061a2950 tempest-AttachVolumeNegativeTest-1916507259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ff9e2607-eb2a-43b5-8382-6145061a2950 tempest-AttachVolumeNegativeTest-1916507259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46a546a5-2ace-4ecb-9341-c65bd90dbb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1a2fef8-e0ac-4e00-851d-8764b522cea7', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:08 devstack sudo[98717]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ff9e2607-eb2a-43b5-8382-6145061a2950 tempest-AttachVolumeNegativeTest-1916507259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bcbe562-683a-4caf-a858-5ef77882be55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_vimaadqpdevstack@QuobyteHD" returned: 0 in 0.543s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:08 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-799755416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29addd50-5773-472a-8bba-85f36003e96a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8763ea2bb3d64ea8944b2d8aa57fa20d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:45:06Z,use_quota=True,user_id='d5997d42110c47108f36faebe040aca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:45:08 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Creating volume 29addd50-5773-472a-8bba-85f36003e96a {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:45:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:08 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:45:08 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:45:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:08 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:45:08 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:45:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-29addd50-5773-472a-8bba-85f36003e96a 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:08 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-ff9e2607-eb2a-43b5-8382-6145061a2950 tempest-AttachVolumeNegativeTest-1916507259 None] Volume volume-d1a2fef8-e0ac-4e00-851d-8764b522cea7 (d1a2fef8-e0ac-4e00-851d-8764b522cea7): created successfully Jul 28 10:45:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ff9e2607-eb2a-43b5-8382-6145061a2950 tempest-AttachVolumeNegativeTest-1916507259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bcbe562-683a-4caf-a858-5ef77882be55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ff9e2607-eb2a-43b5-8382-6145061a2950 tempest-AttachVolumeNegativeTest-1916507259 None] Flow 'volume_create_manager' (f2e4eaba-55d6-47aa-b2d7-ac3d45b2ab23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:45:08 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-29addd50-5773-472a-8bba-85f36003e96a 1073741824 Jul 28 10:45:08 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:08 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-ff9e2607-eb2a-43b5-8382-6145061a2950 tempest-AttachVolumeNegativeTest-1916507259 None] Created volume successfully. Jul 28 10:45:09 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-29addd50-5773-472a-8bba-85f36003e96a 1073741824" returned: 0 in 0.723s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-29addd50-5773-472a-8bba-85f36003e96a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:09 devstack sudo[98734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-29addd50-5773-472a-8bba-85f36003e96a Jul 28 10:45:09 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:09 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e5dda38-8579-4fc6-8345-9a28b3c01cea tempest-VolumesGetTest-1832246363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:45:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0e5dda38-8579-4fc6-8345-9a28b3c01cea tempest-VolumesGetTest-1832246363 None] Flow 'volume_create_manager' (1e87fcf3-7db6-4298-9b46-5483cc1142a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:45:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0e5dda38-8579-4fc6-8345-9a28b3c01cea tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63693948-05ca-40e2-85f5-345af30c113c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0e5dda38-8579-4fc6-8345-9a28b3c01cea tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63693948-05ca-40e2-85f5-345af30c113c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:45:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1729486684',display_name='tempest-VolumesGetTest-Volume-637248132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57f05413-7528-473c-8bd2-2d1d541ea353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f444b5d8eb145c1a0d3a16c1a519eee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:45:09Z,use_quota=True,user_id='251d566d420f41bfb4f44a0ce4b38506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0e5dda38-8579-4fc6-8345-9a28b3c01cea tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1b63c14-f43a-41b0-b5d6-086e36f1a04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0e5dda38-8579-4fc6-8345-9a28b3c01cea tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1b63c14-f43a-41b0-b5d6-086e36f1a04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0e5dda38-8579-4fc6-8345-9a28b3c01cea tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc41a133-ce90-4a87-b99d-8f7c592cd976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0e5dda38-8579-4fc6-8345-9a28b3c01cea tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc41a133-ce90-4a87-b99d-8f7c592cd976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57f05413-7528-473c-8bd2-2d1d541ea353', 'volume_name': 'volume-57f05413-7528-473c-8bd2-2d1d541ea353', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0e5dda38-8579-4fc6-8345-9a28b3c01cea tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a666ffa9-3be8-43d8-874c-938e61d61afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0e5dda38-8579-4fc6-8345-9a28b3c01cea tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a666ffa9-3be8-43d8-874c-938e61d61afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0e5dda38-8579-4fc6-8345-9a28b3c01cea tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41417da9-10d8-47ff-b5aa-a35e8d5575e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:09 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-0e5dda38-8579-4fc6-8345-9a28b3c01cea tempest-VolumesGetTest-1832246363 None] Volume 57f05413-7528-473c-8bd2-2d1d541ea353: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57f05413-7528-473c-8bd2-2d1d541ea353', 'volume_size': 1} Jul 28 10:45:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0e5dda38-8579-4fc6-8345-9a28b3c01cea tempest-VolumesGetTest-1832246363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:09 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-29addd50-5773-472a-8bba-85f36003e96a" returned: 0 in 0.381s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:09 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:45:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0e5dda38-8579-4fc6-8345-9a28b3c01cea tempest-VolumesGetTest-1832246363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.175s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:09 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0e5dda38-8579-4fc6-8345-9a28b3c01cea tempest-VolumesGetTest-1832246363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:45:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1729486684',display_name='tempest-VolumesGetTest-Volume-637248132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57f05413-7528-473c-8bd2-2d1d541ea353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f444b5d8eb145c1a0d3a16c1a519eee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:45:09Z,use_quota=True,user_id='251d566d420f41bfb4f44a0ce4b38506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:45:09 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-0e5dda38-8579-4fc6-8345-9a28b3c01cea tempest-VolumesGetTest-1832246363 None] Creating volume 57f05413-7528-473c-8bd2-2d1d541ea353 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:45:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0e5dda38-8579-4fc6-8345-9a28b3c01cea tempest-VolumesGetTest-1832246363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0e5dda38-8579-4fc6-8345-9a28b3c01cea tempest-VolumesGetTest-1832246363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:09 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0e5dda38-8579-4fc6-8345-9a28b3c01cea tempest-VolumesGetTest-1832246363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:45:09 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0e5dda38-8579-4fc6-8345-9a28b3c01cea tempest-VolumesGetTest-1832246363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:45:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0e5dda38-8579-4fc6-8345-9a28b3c01cea tempest-VolumesGetTest-1832246363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:09 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0e5dda38-8579-4fc6-8345-9a28b3c01cea tempest-VolumesGetTest-1832246363 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:45:09 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-0e5dda38-8579-4fc6-8345-9a28b3c01cea tempest-VolumesGetTest-1832246363 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:45:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0e5dda38-8579-4fc6-8345-9a28b3c01cea tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-57f05413-7528-473c-8bd2-2d1d541ea353 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:09 devstack sudo[98746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-57f05413-7528-473c-8bd2-2d1d541ea353 1073741824 Jul 28 10:45:09 devstack sudo[98746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:09 devstack cinder-volume[88413]: DEBUG cinder.volume.volume_utils [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Attempting download of 3c7ac9f7-f638-43c1-9c8d-41f36b0aec05 ((None, [{'url': 'file:///opt/stack/data/glance/images/3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'metadata': {}}])) to volume 29addd50-5773-472a-8bba-85f36003e96a. {{(pid=88413) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 28 10:45:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-c217053c-a692-4bad-8006-be710dd388f5 req-3d3056c9-fc97-4699-a261-6dcaf7cc9f3e tempest-AttachVolumeNegativeTest-1916507259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:09 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[655c7c1d-6d8d-400b-a866-767b38c3366c]: (4, 'raw') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:45:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_g5hwlan7 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:09 devstack sudo[98748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_g5hwlan7 Jul 28 10:45:09 devstack sudo[98748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:10 devstack sudo[98748]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_g5hwlan7" returned: 0 in 0.409s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_g5hwlan7 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:10 devstack sudo[98746]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0e5dda38-8579-4fc6-8345-9a28b3c01cea tempest-VolumesGetTest-1832246363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-57f05413-7528-473c-8bd2-2d1d541ea353 1073741824" returned: 0 in 0.576s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0e5dda38-8579-4fc6-8345-9a28b3c01cea tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-57f05413-7528-473c-8bd2-2d1d541ea353 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:10 devstack sudo[98757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-57f05413-7528-473c-8bd2-2d1d541ea353 Jul 28 10:45:10 devstack sudo[98757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:10 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_g5hwlan7 Jul 28 10:45:10 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:10 devstack sudo[98757]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0e5dda38-8579-4fc6-8345-9a28b3c01cea tempest-VolumesGetTest-1832246363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-57f05413-7528-473c-8bd2-2d1d541ea353" returned: 0 in 0.323s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:10 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0e5dda38-8579-4fc6-8345-9a28b3c01cea tempest-VolumesGetTest-1832246363 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:45:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0e5dda38-8579-4fc6-8345-9a28b3c01cea tempest-VolumesGetTest-1832246363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-c217053c-a692-4bad-8006-be710dd388f5 req-3d3056c9-fc97-4699-a261-6dcaf7cc9f3e tempest-AttachVolumeNegativeTest-1916507259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.843s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-c217053c-a692-4bad-8006-be710dd388f5 req-3d3056c9-fc97-4699-a261-6dcaf7cc9f3e tempest-AttachVolumeNegativeTest-1916507259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0e5dda38-8579-4fc6-8345-9a28b3c01cea tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41417da9-10d8-47ff-b5aa-a35e8d5575e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57f05413-7528-473c-8bd2-2d1d541ea353', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:10 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0e5dda38-8579-4fc6-8345-9a28b3c01cea tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef54e4cc-2864-4e40-85af-4e62ed8d0fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_g5hwlan7" returned: 1 in 0.473s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_g5hwlan7' failed. Not Retrying. {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 10:45:10 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[962c6949-111d-40f3-bbbc-88dd5026dbb3]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:45:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_vimaadqpdevstack@QuobyteHD {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:10 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-0e5dda38-8579-4fc6-8345-9a28b3c01cea tempest-VolumesGetTest-1832246363 None] Volume volume-57f05413-7528-473c-8bd2-2d1d541ea353 (57f05413-7528-473c-8bd2-2d1d541ea353): created successfully Jul 28 10:45:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0e5dda38-8579-4fc6-8345-9a28b3c01cea tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef54e4cc-2864-4e40-85af-4e62ed8d0fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0e5dda38-8579-4fc6-8345-9a28b3c01cea tempest-VolumesGetTest-1832246363 None] Flow 'volume_create_manager' (1e87fcf3-7db6-4298-9b46-5483cc1142a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:45:10 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-0e5dda38-8579-4fc6-8345-9a28b3c01cea tempest-VolumesGetTest-1832246363 None] Created volume successfully. Jul 28 10:45:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-c217053c-a692-4bad-8006-be710dd388f5 req-3d3056c9-fc97-4699-a261-6dcaf7cc9f3e tempest-AttachVolumeNegativeTest-1916507259 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7', 'name': 'volume-d1a2fef8-e0ac-4e00-851d-8764b522cea7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fb83aa6a-e3ab-4c39-9f3b-ca4bb880ab3c', 'enforce_multipath': True} {{(pid=88413) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 10:45:10 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-c217053c-a692-4bad-8006-be710dd388f5 req-3d3056c9-fc97-4699-a261-6dcaf7cc9f3e tempest-AttachVolumeNegativeTest-1916507259 None] attachment_update completed successfully. Jul 28 10:45:10 devstack sudo[98763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_vimaadqpdevstack@QuobyteHD Jul 28 10:45:10 devstack sudo[98763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:11 devstack sudo[98763]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_vimaadqpdevstack@QuobyteHD" returned: 0 in 0.369s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:11 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] 3c7ac9f7-f638-43c1-9c8d-41f36b0aec05 was qcow2, converting to qcow2 {{(pid=88413) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 28 10:45:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_vimaadqpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-29addd50-5773-472a-8bba-85f36003e96a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:11 devstack sudo[98835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_vimaadqpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-29addd50-5773-472a-8bba-85f36003e96a Jul 28 10:45:11 devstack sudo[98835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:11 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-d22b9a26-ff2f-47f4-b813-8260dae057bb tempest-VolumesGetTest-1832246363 None] Acquiring lock "cinder-57f05413-7528-473c-8bd2-2d1d541ea353-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:45:11 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-d22b9a26-ff2f-47f4-b813-8260dae057bb tempest-VolumesGetTest-1832246363 None] Lock "cinder-57f05413-7528-473c-8bd2-2d1d541ea353-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:45:11 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-d22b9a26-ff2f-47f4-b813-8260dae057bb tempest-VolumesGetTest-1832246363 None] Acquiring lock "cinder-quobyte-57f05413-7528-473c-8bd2-2d1d541ea353" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:45:11 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-d22b9a26-ff2f-47f4-b813-8260dae057bb tempest-VolumesGetTest-1832246363 None] Lock "cinder-quobyte-57f05413-7528-473c-8bd2-2d1d541ea353" acquired by "delete_volume" :: waited 0.020s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:45:11 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[50487b4d-1a40-4f37-a2fa-523fa37c0d9f]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:45:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d22b9a26-ff2f-47f4-b813-8260dae057bb tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-57f05413-7528-473c-8bd2-2d1d541ea353 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:11 devstack sudo[99161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-57f05413-7528-473c-8bd2-2d1d541ea353 Jul 28 10:45:11 devstack sudo[99161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:12 devstack sudo[99161]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d22b9a26-ff2f-47f4-b813-8260dae057bb tempest-VolumesGetTest-1832246363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-57f05413-7528-473c-8bd2-2d1d541ea353" returned: 0 in 0.463s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d22b9a26-ff2f-47f4-b813-8260dae057bb tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-57f05413-7528-473c-8bd2-2d1d541ea353 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:12 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-57f05413-7528-473c-8bd2-2d1d541ea353 Jul 28 10:45:12 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:12 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d22b9a26-ff2f-47f4-b813-8260dae057bb tempest-VolumesGetTest-1832246363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-57f05413-7528-473c-8bd2-2d1d541ea353" returned: 0 in 0.282s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:12 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-d22b9a26-ff2f-47f4-b813-8260dae057bb tempest-VolumesGetTest-1832246363 None] Lock "cinder-quobyte-57f05413-7528-473c-8bd2-2d1d541ea353" released by "delete_volume" :: held 0.804s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:45:12 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-d22b9a26-ff2f-47f4-b813-8260dae057bb tempest-VolumesGetTest-1832246363 None] Created reservations ['e1c6e1ae-cb64-445a-961c-3f2ce361466c', 'd868dd08-7cba-42a0-afdb-760bca6258ed', '19ef4a3a-9b3f-40f8-836e-5602854a0145', 'b61b1e5a-c4ce-4f68-a22f-42d4fb56e7ed'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:45:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d22b9a26-ff2f-47f4-b813-8260dae057bb tempest-VolumesGetTest-1832246363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d22b9a26-ff2f-47f4-b813-8260dae057bb tempest-VolumesGetTest-1832246363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-d22b9a26-ff2f-47f4-b813-8260dae057bb tempest-VolumesGetTest-1832246363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:45:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-d22b9a26-ff2f-47f4-b813-8260dae057bb tempest-VolumesGetTest-1832246363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:45:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d22b9a26-ff2f-47f4-b813-8260dae057bb tempest-VolumesGetTest-1832246363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d22b9a26-ff2f-47f4-b813-8260dae057bb tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:12 devstack sudo[99169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:45:12 devstack sudo[99169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:13 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-dfc5287e-257d-4f70-a678-a5039e3e1655 tempest-VolumesGetTest-1832246363 None] Acquiring lock "cinder-e13f6d36-320b-4820-93af-a3e2a0ed7ddf-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:45:13 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-dfc5287e-257d-4f70-a678-a5039e3e1655 tempest-VolumesGetTest-1832246363 None] Lock "cinder-e13f6d36-320b-4820-93af-a3e2a0ed7ddf-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:45:13 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-dfc5287e-257d-4f70-a678-a5039e3e1655 tempest-VolumesGetTest-1832246363 None] Acquiring lock "cinder-quobyte-e13f6d36-320b-4820-93af-a3e2a0ed7ddf" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:45:13 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-dfc5287e-257d-4f70-a678-a5039e3e1655 tempest-VolumesGetTest-1832246363 None] Lock "cinder-quobyte-e13f6d36-320b-4820-93af-a3e2a0ed7ddf" acquired by "delete_volume" :: waited 0.023s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:45:13 devstack sudo[99169]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d22b9a26-ff2f-47f4-b813-8260dae057bb tempest-VolumesGetTest-1832246363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.447s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:13 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-d22b9a26-ff2f-47f4-b813-8260dae057bb tempest-VolumesGetTest-1832246363 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:45:13 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-d22b9a26-ff2f-47f4-b813-8260dae057bb tempest-VolumesGetTest-1832246363 None] Deleted volume successfully. Jul 28 10:45:13 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0e8915-b6f0-4ed1-a0b4-4c178a3d14e4]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:45:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dfc5287e-257d-4f70-a678-a5039e3e1655 tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e13f6d36-320b-4820-93af-a3e2a0ed7ddf {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:13 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-d22b9a26-ff2f-47f4-b813-8260dae057bb tempest-VolumesGetTest-1832246363 None] Lock "cinder-57f05413-7528-473c-8bd2-2d1d541ea353-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:45:13 devstack sudo[99172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e13f6d36-320b-4820-93af-a3e2a0ed7ddf Jul 28 10:45:13 devstack sudo[99172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:13 devstack sudo[98835]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_vimaadqpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-29addd50-5773-472a-8bba-85f36003e96a" returned: 0 in 2.539s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:13 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_vimaadqpdevstack@QuobyteHD, size 112.00 MB, duration 2.54 sec, destination /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-29addd50-5773-472a-8bba-85f36003e96a {{(pid=88413) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 10:45:13 devstack cinder-volume[88413]: INFO cinder.image.image_utils [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Converted 112.00 MB image at 44.05 MB/s Jul 28 10:45:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-29addd50-5773-472a-8bba-85f36003e96a 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:13 devstack sudo[99174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-29addd50-5773-472a-8bba-85f36003e96a 1G Jul 28 10:45:13 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:13 devstack sudo[99172]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dfc5287e-257d-4f70-a678-a5039e3e1655 tempest-VolumesGetTest-1832246363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e13f6d36-320b-4820-93af-a3e2a0ed7ddf" returned: 0 in 0.549s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dfc5287e-257d-4f70-a678-a5039e3e1655 tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e13f6d36-320b-4820-93af-a3e2a0ed7ddf {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:13 devstack sudo[99179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e13f6d36-320b-4820-93af-a3e2a0ed7ddf Jul 28 10:45:13 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:14 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:14 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dfc5287e-257d-4f70-a678-a5039e3e1655 tempest-VolumesGetTest-1832246363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e13f6d36-320b-4820-93af-a3e2a0ed7ddf" returned: 0 in 0.419s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-29addd50-5773-472a-8bba-85f36003e96a 1G" returned: 0 in 0.573s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:14 devstack cinder-volume[88413]: DEBUG cinder.volume.volume_utils [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Downloaded image 3c7ac9f7-f638-43c1-9c8d-41f36b0aec05 ((None, [{'url': 'file:///opt/stack/data/glance/images/3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'metadata': {}}])) to volume 29addd50-5773-472a-8bba-85f36003e96a successfully. {{(pid=88413) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 28 10:45:14 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Temporary image 3c7ac9f7-f638-43c1-9c8d-41f36b0aec05 for user d5997d42110c47108f36faebe040aca6 is deleted. {{(pid=88413) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 28 10:45:14 devstack cinder-volume[88413]: DEBUG cinder.volume.volume_utils [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Marking volume 29addd50-5773-472a-8bba-85f36003e96a as bootable. {{(pid=88413) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 28 10:45:14 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-dfc5287e-257d-4f70-a678-a5039e3e1655 tempest-VolumesGetTest-1832246363 None] Lock "cinder-quobyte-e13f6d36-320b-4820-93af-a3e2a0ed7ddf" released by "delete_volume" :: held 1.073s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:45:14 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-24787677-a308-46f6-8dbb-6e3952dd3f3c req-98543bd1-b7aa-4b03-945c-211dc2e85692 tempest-AttachVolumeNegativeTest-1916507259 None] Terminate volume connection completed successfully. Jul 28 10:45:14 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-24787677-a308-46f6-8dbb-6e3952dd3f3c req-98543bd1-b7aa-4b03-945c-211dc2e85692 tempest-AttachVolumeNegativeTest-1916507259 None] Deleting attachment fb83aa6a-e3ab-4c39-9f3b-ca4bb880ab3c. {{(pid=88413) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 10:45:14 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Copying metadata from image 3c7ac9f7-f638-43c1-9c8d-41f36b0aec05 to 29addd50-5773-472a-8bba-85f36003e96a. {{(pid=88413) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 28 10:45:14 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Creating volume glance metadata for volume 29addd50-5773-472a-8bba-85f36003e96a backed by image 3c7ac9f7-f638-43c1-9c8d-41f36b0aec05 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88413) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 28 10:45:14 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-dfc5287e-257d-4f70-a678-a5039e3e1655 tempest-VolumesGetTest-1832246363 None] Created reservations ['0c193fa7-d398-4287-b4b8-cde22bc27558', '41eaa2ea-a33e-48a5-b6e7-2923968909ba', 'e1bc7917-4de2-47a8-9694-bb7c82914449', '36b784bc-6458-43ed-8dbb-96ba20982bd0'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:45:14 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2a2d990-5958-4b63-9948-041d3c28a640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29addd50-5773-472a-8bba-85f36003e96a', 'volume_size': 1, 'image_id': '3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b606c34dd1dc45a6a010943235754dcb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'created_at': datetime.datetime(2026, 7, 28, 8, 30, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 8, 30, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c7ac9f7-f638-43c1-9c8d-41f36b0aec05/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:14 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6078f868-7b9a-401e-bdd8-807d3ad537df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:14 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Volume volume-29addd50-5773-472a-8bba-85f36003e96a (29addd50-5773-472a-8bba-85f36003e96a): created successfully Jul 28 10:45:14 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6078f868-7b9a-401e-bdd8-807d3ad537df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:14 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Flow 'volume_create_manager' (e6eecbba-962c-4932-954a-dffb63c6d3ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:45:14 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-37ce135d-7ce1-4469-8eac-fc7353914ef9 tempest-VolumesExtendTest-712998724 None] Created volume successfully. Jul 28 10:45:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-dfc5287e-257d-4f70-a678-a5039e3e1655 tempest-VolumesGetTest-1832246363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-dfc5287e-257d-4f70-a678-a5039e3e1655 tempest-VolumesGetTest-1832246363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:14 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-dfc5287e-257d-4f70-a678-a5039e3e1655 tempest-VolumesGetTest-1832246363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:45:14 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-dfc5287e-257d-4f70-a678-a5039e3e1655 tempest-VolumesGetTest-1832246363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:45:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-dfc5287e-257d-4f70-a678-a5039e3e1655 tempest-VolumesGetTest-1832246363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dfc5287e-257d-4f70-a678-a5039e3e1655 tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:14 devstack sudo[99220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:45:14 devstack sudo[99220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:14 devstack sudo[99220]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dfc5287e-257d-4f70-a678-a5039e3e1655 tempest-VolumesGetTest-1832246363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.304s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:14 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-dfc5287e-257d-4f70-a678-a5039e3e1655 tempest-VolumesGetTest-1832246363 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:45:14 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-dfc5287e-257d-4f70-a678-a5039e3e1655 tempest-VolumesGetTest-1832246363 None] Deleted volume successfully. Jul 28 10:45:14 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-dfc5287e-257d-4f70-a678-a5039e3e1655 tempest-VolumesGetTest-1832246363 None] Lock "cinder-e13f6d36-320b-4820-93af-a3e2a0ed7ddf-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:45:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c000cc2f-18ab-4b1b-9116-b33966114208 tempest-VolumesExtendTest-712998724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c000cc2f-18ab-4b1b-9116-b33966114208 tempest-VolumesExtendTest-712998724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:15 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8c8c5727-f8cc-4585-b042-d294ca8e7120 tempest-VolumesGetTest-1832246363 None] Acquiring lock "cinder-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:45:15 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8c8c5727-f8cc-4585-b042-d294ca8e7120 tempest-VolumesGetTest-1832246363 None] Lock "cinder-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:45:15 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[f531e6a3-4294-4956-bd05-cd5d118032b0]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:45:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c000cc2f-18ab-4b1b-9116-b33966114208 tempest-VolumesExtendTest-712998724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-29addd50-5773-472a-8bba-85f36003e96a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:15 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8c8c5727-f8cc-4585-b042-d294ca8e7120 tempest-VolumesGetTest-1832246363 None] Acquiring lock "cinder-quobyte-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:45:15 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8c8c5727-f8cc-4585-b042-d294ca8e7120 tempest-VolumesGetTest-1832246363 None] Lock "cinder-quobyte-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1" acquired by "delete_volume" :: waited 0.045s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:45:15 devstack sudo[99234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-29addd50-5773-472a-8bba-85f36003e96a Jul 28 10:45:15 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:15 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[78552a66-7fdb-46f4-9fa2-9f803e271a11]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:45:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8c8c5727-f8cc-4585-b042-d294ca8e7120 tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:16 devstack sudo[99247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1 Jul 28 10:45:16 devstack sudo[99247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:16 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c000cc2f-18ab-4b1b-9116-b33966114208 tempest-VolumesExtendTest-712998724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-29addd50-5773-472a-8bba-85f36003e96a" returned: 0 in 0.618s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c000cc2f-18ab-4b1b-9116-b33966114208 tempest-VolumesExtendTest-712998724 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-29addd50-5773-472a-8bba-85f36003e96a 2G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c000cc2f-18ab-4b1b-9116-b33966114208 tempest-VolumesExtendTest-712998724 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-29addd50-5773-472a-8bba-85f36003e96a 2G" returned: 0 in 0.143s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c000cc2f-18ab-4b1b-9116-b33966114208 tempest-VolumesExtendTest-712998724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.822s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:16 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-c000cc2f-18ab-4b1b-9116-b33966114208 tempest-VolumesExtendTest-712998724 None] Extend volume completed successfully. Jul 28 10:45:16 devstack sudo[99247]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8c8c5727-f8cc-4585-b042-d294ca8e7120 tempest-VolumesGetTest-1832246363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1" returned: 0 in 0.522s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8c8c5727-f8cc-4585-b042-d294ca8e7120 tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:16 devstack sudo[99264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1 Jul 28 10:45:16 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:16 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8c8c5727-f8cc-4585-b042-d294ca8e7120 tempest-VolumesGetTest-1832246363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1" returned: 0 in 0.321s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:16 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8c8c5727-f8cc-4585-b042-d294ca8e7120 tempest-VolumesGetTest-1832246363 None] Lock "cinder-quobyte-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1" released by "delete_volume" :: held 1.012s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:45:16 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-8c8c5727-f8cc-4585-b042-d294ca8e7120 tempest-VolumesGetTest-1832246363 None] Created reservations ['b1898c9e-6bf0-4ff1-b54e-bf74d9e0c2f3', 'c557fa0a-e6ff-4cd2-b3c9-62ba02b3e1a0', '8c642596-a416-40c5-9fbe-0d82e854c489', '77c295fa-0910-4108-abca-21c87e55b7ee'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:45:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8c8c5727-f8cc-4585-b042-d294ca8e7120 tempest-VolumesGetTest-1832246363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8c8c5727-f8cc-4585-b042-d294ca8e7120 tempest-VolumesGetTest-1832246363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:16 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8c8c5727-f8cc-4585-b042-d294ca8e7120 tempest-VolumesGetTest-1832246363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:45:16 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8c8c5727-f8cc-4585-b042-d294ca8e7120 tempest-VolumesGetTest-1832246363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:45:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8c8c5727-f8cc-4585-b042-d294ca8e7120 tempest-VolumesGetTest-1832246363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8c8c5727-f8cc-4585-b042-d294ca8e7120 tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:16 devstack sudo[99267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:45:16 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:17 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-6f72eaf5-29cf-401a-81f7-c0f839a7b11e tempest-VolumesExtendTest-712998724 None] Acquiring lock "cinder-29addd50-5773-472a-8bba-85f36003e96a-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:45:17 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-6f72eaf5-29cf-401a-81f7-c0f839a7b11e tempest-VolumesExtendTest-712998724 None] Lock "cinder-29addd50-5773-472a-8bba-85f36003e96a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:45:17 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-6f72eaf5-29cf-401a-81f7-c0f839a7b11e tempest-VolumesExtendTest-712998724 None] Acquiring lock "cinder-quobyte-29addd50-5773-472a-8bba-85f36003e96a" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:45:17 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-6f72eaf5-29cf-401a-81f7-c0f839a7b11e tempest-VolumesExtendTest-712998724 None] Lock "cinder-quobyte-29addd50-5773-472a-8bba-85f36003e96a" acquired by "delete_volume" :: waited 0.017s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:45:17 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[f034c332-c18e-4632-927d-2ebc3208dec6]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:45:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6f72eaf5-29cf-401a-81f7-c0f839a7b11e tempest-VolumesExtendTest-712998724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-29addd50-5773-472a-8bba-85f36003e96a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:17 devstack sudo[99269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-29addd50-5773-472a-8bba-85f36003e96a Jul 28 10:45:17 devstack sudo[99269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:17 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8c8c5727-f8cc-4585-b042-d294ca8e7120 tempest-VolumesGetTest-1832246363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.386s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:17 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-8c8c5727-f8cc-4585-b042-d294ca8e7120 tempest-VolumesGetTest-1832246363 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:45:17 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-8c8c5727-f8cc-4585-b042-d294ca8e7120 tempest-VolumesGetTest-1832246363 None] Deleted volume successfully. Jul 28 10:45:17 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8c8c5727-f8cc-4585-b042-d294ca8e7120 tempest-VolumesGetTest-1832246363 None] Lock "cinder-44fcf639-2f7f-4058-b6d5-cd7ad5c9b8f1-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:45:17 devstack sudo[99269]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6f72eaf5-29cf-401a-81f7-c0f839a7b11e tempest-VolumesExtendTest-712998724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-29addd50-5773-472a-8bba-85f36003e96a" returned: 0 in 0.487s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6f72eaf5-29cf-401a-81f7-c0f839a7b11e tempest-VolumesExtendTest-712998724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-29addd50-5773-472a-8bba-85f36003e96a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:17 devstack sudo[99275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-29addd50-5773-472a-8bba-85f36003e96a Jul 28 10:45:17 devstack sudo[99275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:18 devstack sudo[99275]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6f72eaf5-29cf-401a-81f7-c0f839a7b11e tempest-VolumesExtendTest-712998724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-29addd50-5773-472a-8bba-85f36003e96a" returned: 0 in 0.431s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:18 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-6f72eaf5-29cf-401a-81f7-c0f839a7b11e tempest-VolumesExtendTest-712998724 None] Lock "cinder-quobyte-29addd50-5773-472a-8bba-85f36003e96a" released by "delete_volume" :: held 0.975s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:45:18 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-6f72eaf5-29cf-401a-81f7-c0f839a7b11e tempest-VolumesExtendTest-712998724 None] Created reservations ['70a383be-8081-4927-b2cf-815552c552a9', 'c6c8a0e3-0399-4e1b-8599-d3f55f816fdc', '7204c286-b82d-4736-95a8-04f5592ca9f6', 'fb404631-06bf-41b8-8411-bd8d8dce7d62'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:45:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-6f72eaf5-29cf-401a-81f7-c0f839a7b11e tempest-VolumesExtendTest-712998724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-6f72eaf5-29cf-401a-81f7-c0f839a7b11e tempest-VolumesExtendTest-712998724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:18 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-6f72eaf5-29cf-401a-81f7-c0f839a7b11e tempest-VolumesExtendTest-712998724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:45:18 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-6f72eaf5-29cf-401a-81f7-c0f839a7b11e tempest-VolumesExtendTest-712998724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:45:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-6f72eaf5-29cf-401a-81f7-c0f839a7b11e tempest-VolumesExtendTest-712998724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6f72eaf5-29cf-401a-81f7-c0f839a7b11e tempest-VolumesExtendTest-712998724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:18 devstack sudo[99279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:45:18 devstack sudo[99279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:18 devstack sudo[99279]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6f72eaf5-29cf-401a-81f7-c0f839a7b11e tempest-VolumesExtendTest-712998724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.469s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:18 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-6f72eaf5-29cf-401a-81f7-c0f839a7b11e tempest-VolumesExtendTest-712998724 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:45:18 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-6f72eaf5-29cf-401a-81f7-c0f839a7b11e tempest-VolumesExtendTest-712998724 None] Deleted volume successfully. Jul 28 10:45:18 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-6f72eaf5-29cf-401a-81f7-c0f839a7b11e tempest-VolumesExtendTest-712998724 None] Lock "cinder-29addd50-5773-472a-8bba-85f36003e96a-delete_volume" released by "delete_volume" :: held 1.847s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:45:18 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:45:18 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Flow 'volume_create_manager' (3018c0bb-f0f3-410f-9fc9-ffd7af91c48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:45:18 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ebac388-d640-4d44-a4d0-aa3bcfbace70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:18 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ebac388-d640-4d44-a4d0-aa3bcfbace70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1898476521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9072c797-1c69-4f19-bb87-4c71ee032386,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5f444b5d8eb145c1a0d3a16c1a519eee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:45:19Z,use_quota=True,user_id='251d566d420f41bfb4f44a0ce4b38506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:18 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec17bf98-d329-44c0-a93d-4039559b7048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:18 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec17bf98-d329-44c0-a93d-4039559b7048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b9cae3c-9217-4d1b-b992-761a620ecde3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:19 devstack cinder-volume[88413]: DEBUG cinder.image.glance [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Creating Keystone auth plugin from conf {{(pid=88413) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 28 10:45:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b9cae3c-9217-4d1b-b992-761a620ecde3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9072c797-1c69-4f19-bb87-4c71ee032386', 'volume_name': 'volume-9072c797-1c69-4f19-bb87-4c71ee032386', 'volume_size': 1, 'image_id': '3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b606c34dd1dc45a6a010943235754dcb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'created_at': datetime.datetime(2026, 7, 28, 8, 30, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 8, 30, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c7ac9f7-f638-43c1-9c8d-41f36b0aec05/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a002f21d-e79e-4c95-89a7-706e4bf9a1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a002f21d-e79e-4c95-89a7-706e4bf9a1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82aa5f0f-3ee3-4f3c-a8ba-b0f81641e8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:19 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Volume 9072c797-1c69-4f19-bb87-4c71ee032386: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9072c797-1c69-4f19-bb87-4c71ee032386', 'volume_size': 1, 'image_id': '3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b606c34dd1dc45a6a010943235754dcb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'created_at': datetime.datetime(2026, 7, 28, 8, 30, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 8, 30, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c7ac9f7-f638-43c1-9c8d-41f36b0aec05/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 28 10:45:19 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Trying to clone 9072c797-1c69-4f19-bb87-4c71ee032386 from image 3c7ac9f7-f638-43c1-9c8d-41f36b0aec05 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'metadata': {}}]). {{(pid=88413) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 28 10:45:19 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-e58f2f25-9e48-4600-9bd7-f7886dbb0a1b tempest-VolumesExtendTest-712998724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:45:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e58f2f25-9e48-4600-9bd7-f7886dbb0a1b tempest-VolumesExtendTest-712998724 None] Flow 'volume_create_manager' (18c48a65-fea3-499c-a4be-f59f8fa51a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:45:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e58f2f25-9e48-4600-9bd7-f7886dbb0a1b tempest-VolumesExtendTest-712998724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e3046fa-bb55-4ca0-8f86-8db1b5f34a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e58f2f25-9e48-4600-9bd7-f7886dbb0a1b tempest-VolumesExtendTest-712998724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e3046fa-bb55-4ca0-8f86-8db1b5f34a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1170722034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59bd6fb5-66b6-43a8-8750-a2183ecd5d5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8763ea2bb3d64ea8944b2d8aa57fa20d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:45:20Z,use_quota=True,user_id='d5997d42110c47108f36faebe040aca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e58f2f25-9e48-4600-9bd7-f7886dbb0a1b tempest-VolumesExtendTest-712998724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (317f85cb-dd71-475d-b7d9-31b4dc1c7893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e58f2f25-9e48-4600-9bd7-f7886dbb0a1b tempest-VolumesExtendTest-712998724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (317f85cb-dd71-475d-b7d9-31b4dc1c7893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e58f2f25-9e48-4600-9bd7-f7886dbb0a1b tempest-VolumesExtendTest-712998724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c17441f4-be4c-4865-81cd-a45a8a43db3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e58f2f25-9e48-4600-9bd7-f7886dbb0a1b tempest-VolumesExtendTest-712998724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c17441f4-be4c-4865-81cd-a45a8a43db3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59bd6fb5-66b6-43a8-8750-a2183ecd5d5c', 'volume_name': 'volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e58f2f25-9e48-4600-9bd7-f7886dbb0a1b tempest-VolumesExtendTest-712998724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83dd03b7-5915-4411-ad00-aa2a2a7f7de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e58f2f25-9e48-4600-9bd7-f7886dbb0a1b tempest-VolumesExtendTest-712998724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83dd03b7-5915-4411-ad00-aa2a2a7f7de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e58f2f25-9e48-4600-9bd7-f7886dbb0a1b tempest-VolumesExtendTest-712998724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e17395f4-c947-444b-a7cb-20978525f131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:20 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-e58f2f25-9e48-4600-9bd7-f7886dbb0a1b tempest-VolumesExtendTest-712998724 None] Volume 59bd6fb5-66b6-43a8-8750-a2183ecd5d5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c', 'volume_size': 1} Jul 28 10:45:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e58f2f25-9e48-4600-9bd7-f7886dbb0a1b tempest-VolumesExtendTest-712998724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e58f2f25-9e48-4600-9bd7-f7886dbb0a1b tempest-VolumesExtendTest-712998724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:20 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e58f2f25-9e48-4600-9bd7-f7886dbb0a1b tempest-VolumesExtendTest-712998724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1170722034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59bd6fb5-66b6-43a8-8750-a2183ecd5d5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8763ea2bb3d64ea8944b2d8aa57fa20d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:45:20Z,use_quota=True,user_id='d5997d42110c47108f36faebe040aca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:45:20 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-e58f2f25-9e48-4600-9bd7-f7886dbb0a1b tempest-VolumesExtendTest-712998724 None] Creating volume 59bd6fb5-66b6-43a8-8750-a2183ecd5d5c {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:45:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e58f2f25-9e48-4600-9bd7-f7886dbb0a1b tempest-VolumesExtendTest-712998724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e58f2f25-9e48-4600-9bd7-f7886dbb0a1b tempest-VolumesExtendTest-712998724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:20 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e58f2f25-9e48-4600-9bd7-f7886dbb0a1b tempest-VolumesExtendTest-712998724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:45:20 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e58f2f25-9e48-4600-9bd7-f7886dbb0a1b tempest-VolumesExtendTest-712998724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:45:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e58f2f25-9e48-4600-9bd7-f7886dbb0a1b tempest-VolumesExtendTest-712998724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:20 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e58f2f25-9e48-4600-9bd7-f7886dbb0a1b tempest-VolumesExtendTest-712998724 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:45:20 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-e58f2f25-9e48-4600-9bd7-f7886dbb0a1b tempest-VolumesExtendTest-712998724 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:45:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e58f2f25-9e48-4600-9bd7-f7886dbb0a1b tempest-VolumesExtendTest-712998724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:20 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c 1073741824 Jul 28 10:45:20 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:20 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_i0qedbnsdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88413) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 28 10:45:20 devstack cinder-volume[88413]: INFO cinder.image.image_utils [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Image download 20.69 MB at 20.69 MB/s Jul 28 10:45:20 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c3d817-a1da-438e-a8c9-ce5d7738bd95]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:45:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_i0qedbnsdevstack@QuobyteHD {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:20 devstack sudo[99287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_i0qedbnsdevstack@QuobyteHD Jul 28 10:45:20 devstack sudo[99287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:20 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e58f2f25-9e48-4600-9bd7-f7886dbb0a1b tempest-VolumesExtendTest-712998724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c 1073741824" returned: 0 in 0.679s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:20 devstack sudo[99287]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e58f2f25-9e48-4600-9bd7-f7886dbb0a1b tempest-VolumesExtendTest-712998724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_i0qedbnsdevstack@QuobyteHD" returned: 0 in 0.535s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:20 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Temporary image 3c7ac9f7-f638-43c1-9c8d-41f36b0aec05 is fetched for user 251d566d420f41bfb4f44a0ce4b38506. {{(pid=88413) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 28 10:45:20 devstack sudo[99330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c Jul 28 10:45:20 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:21 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[afade163-d777-4bd9-8dfd-83655dbb0aff]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:45:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_i0qedbnsdevstack@QuobyteHD {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:21 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e58f2f25-9e48-4600-9bd7-f7886dbb0a1b tempest-VolumesExtendTest-712998724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c" returned: 0 in 0.430s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:21 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e58f2f25-9e48-4600-9bd7-f7886dbb0a1b tempest-VolumesExtendTest-712998724 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:45:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e58f2f25-9e48-4600-9bd7-f7886dbb0a1b tempest-VolumesExtendTest-712998724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:21 devstack sudo[99332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_i0qedbnsdevstack@QuobyteHD Jul 28 10:45:21 devstack sudo[99332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:21 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e58f2f25-9e48-4600-9bd7-f7886dbb0a1b tempest-VolumesExtendTest-712998724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e17395f4-c947-444b-a7cb-20978525f131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:21 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e58f2f25-9e48-4600-9bd7-f7886dbb0a1b tempest-VolumesExtendTest-712998724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7ec37bd-131f-4f4b-9b75-3bcadfbda1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:21 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-e58f2f25-9e48-4600-9bd7-f7886dbb0a1b tempest-VolumesExtendTest-712998724 None] Volume volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c (59bd6fb5-66b6-43a8-8750-a2183ecd5d5c): created successfully Jul 28 10:45:21 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e58f2f25-9e48-4600-9bd7-f7886dbb0a1b tempest-VolumesExtendTest-712998724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7ec37bd-131f-4f4b-9b75-3bcadfbda1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:21 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e58f2f25-9e48-4600-9bd7-f7886dbb0a1b tempest-VolumesExtendTest-712998724 None] Flow 'volume_create_manager' (18c48a65-fea3-499c-a4be-f59f8fa51a88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:45:21 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-e58f2f25-9e48-4600-9bd7-f7886dbb0a1b tempest-VolumesExtendTest-712998724 None] Created volume successfully. Jul 28 10:45:21 devstack sudo[99332]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_i0qedbnsdevstack@QuobyteHD" returned: 0 in 0.549s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:21 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1898476521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9072c797-1c69-4f19-bb87-4c71ee032386,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5f444b5d8eb145c1a0d3a16c1a519eee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:45:19Z,use_quota=True,user_id='251d566d420f41bfb4f44a0ce4b38506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:45:21 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Creating volume 9072c797-1c69-4f19-bb87-4c71ee032386 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:45:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:21 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:45:21 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:45:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:21 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:45:21 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:45:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9072c797-1c69-4f19-bb87-4c71ee032386 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:21 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9072c797-1c69-4f19-bb87-4c71ee032386 1073741824 Jul 28 10:45:21 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:22 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9072c797-1c69-4f19-bb87-4c71ee032386 1073741824" returned: 0 in 0.579s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9072c797-1c69-4f19-bb87-4c71ee032386 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:22 devstack sudo[99346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9072c797-1c69-4f19-bb87-4c71ee032386 Jul 28 10:45:22 devstack sudo[99346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-6ed45db0-ce41-40dc-922d-d5fcf37eb70b tempest-VolumesExtendTest-712998724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:22 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-71b4cfae-0c32-4b78-9fde-ab0f1fa198ef tempest-AttachVolumeNegativeTest-1916507259 None] Acquiring lock "cinder-d1a2fef8-e0ac-4e00-851d-8764b522cea7-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:45:22 devstack sudo[99346]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:22 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-71b4cfae-0c32-4b78-9fde-ab0f1fa198ef tempest-AttachVolumeNegativeTest-1916507259 None] Lock "cinder-d1a2fef8-e0ac-4e00-851d-8764b522cea7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:45:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9072c797-1c69-4f19-bb87-4c71ee032386" returned: 0 in 0.326s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:22 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:45:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-6ed45db0-ce41-40dc-922d-d5fcf37eb70b tempest-VolumesExtendTest-712998724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.216s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:22 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-6ed45db0-ce41-40dc-922d-d5fcf37eb70b tempest-VolumesExtendTest-712998724 None] Creating offline snapshot a5ee471a-833a-4035-a66a-d8933469e10a of volume 59bd6fb5-66b6-43a8-8750-a2183ecd5d5c {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:45:22 devstack cinder-volume[88413]: DEBUG cinder.volume.volume_utils [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Attempting download of 3c7ac9f7-f638-43c1-9c8d-41f36b0aec05 ((None, [{'url': 'file:///opt/stack/data/glance/images/3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'metadata': {}}])) to volume 9072c797-1c69-4f19-bb87-4c71ee032386. {{(pid=88413) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 28 10:45:22 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed51cf5-c2cd-4f2e-ac03-1e75711b8af6]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:45:22 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-71b4cfae-0c32-4b78-9fde-ab0f1fa198ef tempest-AttachVolumeNegativeTest-1916507259 None] Acquiring lock "cinder-quobyte-d1a2fef8-e0ac-4e00-851d-8764b522cea7" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:45:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6ed45db0-ce41-40dc-922d-d5fcf37eb70b tempest-VolumesExtendTest-712998724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:22 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-71b4cfae-0c32-4b78-9fde-ab0f1fa198ef tempest-AttachVolumeNegativeTest-1916507259 None] Lock "cinder-quobyte-d1a2fef8-e0ac-4e00-851d-8764b522cea7" acquired by "delete_volume" :: waited 0.036s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:45:22 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f988b4d-d2b5-416f-adab-b82c7e31678a]: (4, 'raw') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:45:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_yolhyn97 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:22 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98a46a2-ca33-4192-81bc-fcd8de2ccdf4]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:45:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-71b4cfae-0c32-4b78-9fde-ab0f1fa198ef tempest-AttachVolumeNegativeTest-1916507259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d1a2fef8-e0ac-4e00-851d-8764b522cea7 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:22 devstack sudo[99352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d1a2fef8-e0ac-4e00-851d-8764b522cea7 Jul 28 10:45:22 devstack sudo[99352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:22 devstack sudo[99349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c Jul 28 10:45:22 devstack sudo[99351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_yolhyn97 Jul 28 10:45:22 devstack sudo[99349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:22 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:23 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_yolhyn97" returned: 0 in 0.387s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_yolhyn97 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:23 devstack sudo[99349]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6ed45db0-ce41-40dc-922d-d5fcf37eb70b tempest-VolumesExtendTest-712998724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c" returned: 0 in 0.546s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6ed45db0-ce41-40dc-922d-d5fcf37eb70b tempest-VolumesExtendTest-712998724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c.a5ee471a-833a-4035-a66a-d8933469e10a 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:23 devstack sudo[99352]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-71b4cfae-0c32-4b78-9fde-ab0f1fa198ef tempest-AttachVolumeNegativeTest-1916507259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d1a2fef8-e0ac-4e00-851d-8764b522cea7" returned: 0 in 0.493s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:23 devstack sudo[99364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_yolhyn97 Jul 28 10:45:23 devstack sudo[99364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-71b4cfae-0c32-4b78-9fde-ab0f1fa198ef tempest-AttachVolumeNegativeTest-1916507259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d1a2fef8-e0ac-4e00-851d-8764b522cea7 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:23 devstack sudo[99366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c.a5ee471a-833a-4035-a66a-d8933469e10a 1G Jul 28 10:45:23 devstack sudo[99366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:23 devstack sudo[99368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d1a2fef8-e0ac-4e00-851d-8764b522cea7 Jul 28 10:45:23 devstack sudo[99368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:23 devstack sudo[99364]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_yolhyn97" returned: 1 in 0.338s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_yolhyn97' failed. Not Retrying. {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 10:45:23 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda4f111-e6b5-479a-812e-d2e17957759f]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:45:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_i0qedbnsdevstack@QuobyteHD {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:23 devstack sudo[99368]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-71b4cfae-0c32-4b78-9fde-ab0f1fa198ef tempest-AttachVolumeNegativeTest-1916507259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d1a2fef8-e0ac-4e00-851d-8764b522cea7" returned: 0 in 0.294s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:23 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-71b4cfae-0c32-4b78-9fde-ab0f1fa198ef tempest-AttachVolumeNegativeTest-1916507259 None] Lock "cinder-quobyte-d1a2fef8-e0ac-4e00-851d-8764b522cea7" released by "delete_volume" :: held 0.849s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:45:23 devstack sudo[99373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_i0qedbnsdevstack@QuobyteHD Jul 28 10:45:23 devstack sudo[99373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:23 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-71b4cfae-0c32-4b78-9fde-ab0f1fa198ef tempest-AttachVolumeNegativeTest-1916507259 None] Created reservations ['1c9d2378-a8cc-41d0-95c4-b6022ae02e50', 'e94ecc89-7b6c-4466-8f53-86645c3abc32', '3f5a46c3-df09-4f6a-a306-3d3f95eaf0a8', 'e9a0e2b9-ef2a-43e8-9c09-292475d92a79'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:45:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-71b4cfae-0c32-4b78-9fde-ab0f1fa198ef tempest-AttachVolumeNegativeTest-1916507259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-71b4cfae-0c32-4b78-9fde-ab0f1fa198ef tempest-AttachVolumeNegativeTest-1916507259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:23 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-71b4cfae-0c32-4b78-9fde-ab0f1fa198ef tempest-AttachVolumeNegativeTest-1916507259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:45:23 devstack sudo[99366]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:23 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-71b4cfae-0c32-4b78-9fde-ab0f1fa198ef tempest-AttachVolumeNegativeTest-1916507259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:45:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-71b4cfae-0c32-4b78-9fde-ab0f1fa198ef tempest-AttachVolumeNegativeTest-1916507259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-71b4cfae-0c32-4b78-9fde-ab0f1fa198ef tempest-AttachVolumeNegativeTest-1916507259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6ed45db0-ce41-40dc-922d-d5fcf37eb70b tempest-VolumesExtendTest-712998724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c.a5ee471a-833a-4035-a66a-d8933469e10a 1G" returned: 0 in 0.547s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6ed45db0-ce41-40dc-922d-d5fcf37eb70b tempest-VolumesExtendTest-712998724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c.a5ee471a-833a-4035-a66a-d8933469e10a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:23 devstack sudo[99380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:45:23 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:23 devstack sudo[99381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c.a5ee471a-833a-4035-a66a-d8933469e10a Jul 28 10:45:23 devstack sudo[99381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:23 devstack sudo[99373]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_i0qedbnsdevstack@QuobyteHD" returned: 0 in 0.464s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:23 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] 3c7ac9f7-f638-43c1-9c8d-41f36b0aec05 was qcow2, converting to qcow2 {{(pid=88413) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 28 10:45:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_i0qedbnsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9072c797-1c69-4f19-bb87-4c71ee032386 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:23 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-14a0385c-1023-40f5-aeee-7dcede190bf7 tempest-AttachVolumeNegativeTest-1916507259 None] Acquiring lock "cinder-777db935-85f6-4cbc-a9b3-b28d188934ac-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:45:23 devstack sudo[99387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_i0qedbnsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9072c797-1c69-4f19-bb87-4c71ee032386 Jul 28 10:45:23 devstack sudo[99387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:24 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-14a0385c-1023-40f5-aeee-7dcede190bf7 tempest-AttachVolumeNegativeTest-1916507259 None] Lock "cinder-777db935-85f6-4cbc-a9b3-b28d188934ac-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:45:24 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-14a0385c-1023-40f5-aeee-7dcede190bf7 tempest-AttachVolumeNegativeTest-1916507259 None] Acquiring lock "cinder-quobyte-777db935-85f6-4cbc-a9b3-b28d188934ac" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:45:24 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-14a0385c-1023-40f5-aeee-7dcede190bf7 tempest-AttachVolumeNegativeTest-1916507259 None] Lock "cinder-quobyte-777db935-85f6-4cbc-a9b3-b28d188934ac" acquired by "delete_volume" :: waited 0.031s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:45:24 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[191b9e6f-d1c5-407d-8bcc-25d21152bb7c]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:45:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-14a0385c-1023-40f5-aeee-7dcede190bf7 tempest-AttachVolumeNegativeTest-1916507259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-777db935-85f6-4cbc-a9b3-b28d188934ac {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:24 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-71b4cfae-0c32-4b78-9fde-ab0f1fa198ef tempest-AttachVolumeNegativeTest-1916507259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.453s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:24 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-71b4cfae-0c32-4b78-9fde-ab0f1fa198ef tempest-AttachVolumeNegativeTest-1916507259 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:45:24 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-71b4cfae-0c32-4b78-9fde-ab0f1fa198ef tempest-AttachVolumeNegativeTest-1916507259 None] Deleted volume successfully. Jul 28 10:45:24 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-71b4cfae-0c32-4b78-9fde-ab0f1fa198ef tempest-AttachVolumeNegativeTest-1916507259 None] Lock "cinder-d1a2fef8-e0ac-4e00-851d-8764b522cea7-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:45:24 devstack sudo[99381]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6ed45db0-ce41-40dc-922d-d5fcf37eb70b tempest-VolumesExtendTest-712998724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c.a5ee471a-833a-4035-a66a-d8933469e10a" returned: 0 in 0.524s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:24 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-6ed45db0-ce41-40dc-922d-d5fcf37eb70b tempest-VolumesExtendTest-712998724 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c.a5ee471a-833a-4035-a66a-d8933469e10a is being set with open permissions: ugo+rw Jul 28 10:45:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6ed45db0-ce41-40dc-922d-d5fcf37eb70b tempest-VolumesExtendTest-712998724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c.a5ee471a-833a-4035-a66a-d8933469e10a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:24 devstack sudo[99394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c.a5ee471a-833a-4035-a66a-d8933469e10a Jul 28 10:45:24 devstack sudo[99394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:24 devstack sudo[99393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-777db935-85f6-4cbc-a9b3-b28d188934ac Jul 28 10:45:24 devstack sudo[99393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:24 devstack sudo[99394]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6ed45db0-ce41-40dc-922d-d5fcf37eb70b tempest-VolumesExtendTest-712998724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c.a5ee471a-833a-4035-a66a-d8933469e10a" returned: 0 in 0.299s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6ed45db0-ce41-40dc-922d-d5fcf37eb70b tempest-VolumesExtendTest-712998724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:24 devstack sudo[99406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c.info Jul 28 10:45:24 devstack sudo[99406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:24 devstack sudo[99393]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-14a0385c-1023-40f5-aeee-7dcede190bf7 tempest-AttachVolumeNegativeTest-1916507259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-777db935-85f6-4cbc-a9b3-b28d188934ac" returned: 0 in 0.522s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-14a0385c-1023-40f5-aeee-7dcede190bf7 tempest-AttachVolumeNegativeTest-1916507259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-777db935-85f6-4cbc-a9b3-b28d188934ac {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:24 devstack sudo[99408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-777db935-85f6-4cbc-a9b3-b28d188934ac Jul 28 10:45:24 devstack sudo[99408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:24 devstack sudo[99406]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6ed45db0-ce41-40dc-922d-d5fcf37eb70b tempest-VolumesExtendTest-712998724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c.info" returned: 0 in 0.296s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:24 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-6ed45db0-ce41-40dc-922d-d5fcf37eb70b tempest-VolumesExtendTest-712998724 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c.info is being set with open permissions: ugo+rw Jul 28 10:45:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6ed45db0-ce41-40dc-922d-d5fcf37eb70b tempest-VolumesExtendTest-712998724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:24 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c.info Jul 28 10:45:24 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:24 devstack sudo[99408]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-14a0385c-1023-40f5-aeee-7dcede190bf7 tempest-AttachVolumeNegativeTest-1916507259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-777db935-85f6-4cbc-a9b3-b28d188934ac" returned: 0 in 0.287s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:24 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-14a0385c-1023-40f5-aeee-7dcede190bf7 tempest-AttachVolumeNegativeTest-1916507259 None] Lock "cinder-quobyte-777db935-85f6-4cbc-a9b3-b28d188934ac" released by "delete_volume" :: held 0.875s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:45:25 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-14a0385c-1023-40f5-aeee-7dcede190bf7 tempest-AttachVolumeNegativeTest-1916507259 None] Created reservations ['5f79460d-f2a8-44c9-bb94-d92fbe3fa06e', '86afe66e-2cdc-4fd1-afc7-a194b8e53ba0', '9e67b4fd-0422-43cb-add6-2df2cb94f0b6', '1240e88e-3932-4f68-9256-7117b4e55e26'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:45:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-14a0385c-1023-40f5-aeee-7dcede190bf7 tempest-AttachVolumeNegativeTest-1916507259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-14a0385c-1023-40f5-aeee-7dcede190bf7 tempest-AttachVolumeNegativeTest-1916507259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:25 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-14a0385c-1023-40f5-aeee-7dcede190bf7 tempest-AttachVolumeNegativeTest-1916507259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:45:25 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-14a0385c-1023-40f5-aeee-7dcede190bf7 tempest-AttachVolumeNegativeTest-1916507259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:45:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-14a0385c-1023-40f5-aeee-7dcede190bf7 tempest-AttachVolumeNegativeTest-1916507259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-14a0385c-1023-40f5-aeee-7dcede190bf7 tempest-AttachVolumeNegativeTest-1916507259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:25 devstack sudo[99416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:45:25 devstack sudo[99416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:25 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6ed45db0-ce41-40dc-922d-d5fcf37eb70b tempest-VolumesExtendTest-712998724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c.info" returned: 0 in 0.340s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-6ed45db0-ce41-40dc-922d-d5fcf37eb70b tempest-VolumesExtendTest-712998724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.694s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:25 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-6ed45db0-ce41-40dc-922d-d5fcf37eb70b tempest-VolumesExtendTest-712998724 None] Create snapshot completed successfully Jul 28 10:45:25 devstack sudo[99416]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-14a0385c-1023-40f5-aeee-7dcede190bf7 tempest-AttachVolumeNegativeTest-1916507259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.313s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:25 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-14a0385c-1023-40f5-aeee-7dcede190bf7 tempest-AttachVolumeNegativeTest-1916507259 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:45:25 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-14a0385c-1023-40f5-aeee-7dcede190bf7 tempest-AttachVolumeNegativeTest-1916507259 None] Deleted volume successfully. Jul 28 10:45:25 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-14a0385c-1023-40f5-aeee-7dcede190bf7 tempest-AttachVolumeNegativeTest-1916507259 None] Lock "cinder-777db935-85f6-4cbc-a9b3-b28d188934ac-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:45:25 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-d8b121fa-0d27-4d18-9d99-e66c0272ce68 tempest-AttachVolumeNegativeTest-1916507259 None] Acquiring lock "cinder-d17af338-d10c-4940-974b-60bcdd2139dd-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:45:25 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-d8b121fa-0d27-4d18-9d99-e66c0272ce68 tempest-AttachVolumeNegativeTest-1916507259 None] Lock "cinder-d17af338-d10c-4940-974b-60bcdd2139dd-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:45:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1913197c-1eda-4cab-a631-9c8e6719924e tempest-VolumesExtendTest-712998724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1913197c-1eda-4cab-a631-9c8e6719924e tempest-VolumesExtendTest-712998724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:25 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-45d256ba-5643-4ff5-8364-32b6f1734878 tempest-TestInstancesWithCinderVolumes-733670174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:45:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-45d256ba-5643-4ff5-8364-32b6f1734878 tempest-TestInstancesWithCinderVolumes-733670174 None] Flow 'volume_create_manager' (473ed4f3-458d-405e-bdf0-09161ecc0b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:45:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-45d256ba-5643-4ff5-8364-32b6f1734878 tempest-TestInstancesWithCinderVolumes-733670174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fd820d0-1f4a-4a39-947a-b7af2f44cf46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:25 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c78c5a2-084f-4c5b-8543-323d3912be93]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:45:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1913197c-1eda-4cab-a631-9c8e6719924e tempest-VolumesExtendTest-712998724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:25 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-d8b121fa-0d27-4d18-9d99-e66c0272ce68 tempest-AttachVolumeNegativeTest-1916507259 None] Acquiring lock "cinder-quobyte-d17af338-d10c-4940-974b-60bcdd2139dd" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:45:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-45d256ba-5643-4ff5-8364-32b6f1734878 tempest-TestInstancesWithCinderVolumes-733670174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fd820d0-1f4a-4a39-947a-b7af2f44cf46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1989900745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df86a441-a123-41e8-9fd9-f062ec3b9905,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='683e91271a514ff893096f5bbe6a97e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:45:26Z,use_quota=True,user_id='1329b3f671f64821b6353dd1ee028c46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bdc4ac13-0439-440f-b30c-aeebb3714eea),volume_type_id=bdc4ac13-0439-440f-b30c-aeebb3714eea)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-45d256ba-5643-4ff5-8364-32b6f1734878 tempest-TestInstancesWithCinderVolumes-733670174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ba4ab90-4159-4be4-acea-ab97bf3b609a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-45d256ba-5643-4ff5-8364-32b6f1734878 tempest-TestInstancesWithCinderVolumes-733670174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ba4ab90-4159-4be4-acea-ab97bf3b609a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-45d256ba-5643-4ff5-8364-32b6f1734878 tempest-TestInstancesWithCinderVolumes-733670174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e8e6ff-0132-46e0-84a7-e26a5f17a48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-45d256ba-5643-4ff5-8364-32b6f1734878 tempest-TestInstancesWithCinderVolumes-733670174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e8e6ff-0132-46e0-84a7-e26a5f17a48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df86a441-a123-41e8-9fd9-f062ec3b9905', 'volume_name': 'volume-df86a441-a123-41e8-9fd9-f062ec3b9905', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-45d256ba-5643-4ff5-8364-32b6f1734878 tempest-TestInstancesWithCinderVolumes-733670174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b119e9c3-6377-40f5-8547-4fe425c08430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-45d256ba-5643-4ff5-8364-32b6f1734878 tempest-TestInstancesWithCinderVolumes-733670174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b119e9c3-6377-40f5-8547-4fe425c08430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-45d256ba-5643-4ff5-8364-32b6f1734878 tempest-TestInstancesWithCinderVolumes-733670174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (450ab1de-c78f-48a6-b324-ad064e216861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:25 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-45d256ba-5643-4ff5-8364-32b6f1734878 tempest-TestInstancesWithCinderVolumes-733670174 None] Volume df86a441-a123-41e8-9fd9-f062ec3b9905: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df86a441-a123-41e8-9fd9-f062ec3b9905', 'volume_size': 1} Jul 28 10:45:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-45d256ba-5643-4ff5-8364-32b6f1734878 tempest-TestInstancesWithCinderVolumes-733670174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:25 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-d8b121fa-0d27-4d18-9d99-e66c0272ce68 tempest-AttachVolumeNegativeTest-1916507259 None] Lock "cinder-quobyte-d17af338-d10c-4940-974b-60bcdd2139dd" acquired by "delete_volume" :: waited 0.086s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:45:25 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5a9332-fd8a-4e35-8677-d68708908f33]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:45:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d8b121fa-0d27-4d18-9d99-e66c0272ce68 tempest-AttachVolumeNegativeTest-1916507259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d17af338-d10c-4940-974b-60bcdd2139dd {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:25 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c Jul 28 10:45:26 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:26 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ebf0131-ebca-493a-b49e-d15b5210724d tempest-TestInstancesWithCinderVolumes-733670174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:45:26 devstack sudo[99421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d17af338-d10c-4940-974b-60bcdd2139dd Jul 28 10:45:26 devstack sudo[99421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:26 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2ebf0131-ebca-493a-b49e-d15b5210724d tempest-TestInstancesWithCinderVolumes-733670174 None] Flow 'volume_create_manager' (e72ed5ac-5754-42b9-ab38-ab98c46441c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:45:26 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2ebf0131-ebca-493a-b49e-d15b5210724d tempest-TestInstancesWithCinderVolumes-733670174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0680beb8-da18-4783-a74c-5bc4dc13470c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:26 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2ebf0131-ebca-493a-b49e-d15b5210724d tempest-TestInstancesWithCinderVolumes-733670174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0680beb8-da18-4783-a74c-5bc4dc13470c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-700589030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff137d9-a2cd-420a-bf49-143187d1d0de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='683e91271a514ff893096f5bbe6a97e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:45:26Z,use_quota=True,user_id='1329b3f671f64821b6353dd1ee028c46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22e5a862-a9fc-4ec0-9933-e31f6b76c372),volume_type_id=22e5a862-a9fc-4ec0-9933-e31f6b76c372)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:26 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2ebf0131-ebca-493a-b49e-d15b5210724d tempest-TestInstancesWithCinderVolumes-733670174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8da8064-d0c8-4b46-9265-3e88d2d8ae67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:26 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2ebf0131-ebca-493a-b49e-d15b5210724d tempest-TestInstancesWithCinderVolumes-733670174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8da8064-d0c8-4b46-9265-3e88d2d8ae67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:26 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2ebf0131-ebca-493a-b49e-d15b5210724d tempest-TestInstancesWithCinderVolumes-733670174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5359270c-f225-4678-bb36-9d4ee3aaa6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:26 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2ebf0131-ebca-493a-b49e-d15b5210724d tempest-TestInstancesWithCinderVolumes-733670174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5359270c-f225-4678-bb36-9d4ee3aaa6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cff137d9-a2cd-420a-bf49-143187d1d0de', 'volume_name': 'volume-cff137d9-a2cd-420a-bf49-143187d1d0de', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:26 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2ebf0131-ebca-493a-b49e-d15b5210724d tempest-TestInstancesWithCinderVolumes-733670174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f19676-2415-47a6-ab0f-3469036be97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:26 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2ebf0131-ebca-493a-b49e-d15b5210724d tempest-TestInstancesWithCinderVolumes-733670174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f19676-2415-47a6-ab0f-3469036be97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:26 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2ebf0131-ebca-493a-b49e-d15b5210724d tempest-TestInstancesWithCinderVolumes-733670174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8f38c64-7c73-419e-b270-3c4a7bd2b2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:26 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-2ebf0131-ebca-493a-b49e-d15b5210724d tempest-TestInstancesWithCinderVolumes-733670174 None] Volume cff137d9-a2cd-420a-bf49-143187d1d0de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cff137d9-a2cd-420a-bf49-143187d1d0de', 'volume_size': 1} Jul 28 10:45:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-2ebf0131-ebca-493a-b49e-d15b5210724d tempest-TestInstancesWithCinderVolumes-733670174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:26 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1913197c-1eda-4cab-a631-9c8e6719924e tempest-VolumesExtendTest-712998724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c" returned: 0 in 0.540s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1913197c-1eda-4cab-a631-9c8e6719924e tempest-VolumesExtendTest-712998724 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c.a5ee471a-833a-4035-a66a-d8933469e10a 2G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:26 devstack sudo[99387]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_i0qedbnsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9072c797-1c69-4f19-bb87-4c71ee032386" returned: 0 in 2.520s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:26 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_i0qedbnsdevstack@QuobyteHD, size 112.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9072c797-1c69-4f19-bb87-4c71ee032386 {{(pid=88413) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 10:45:26 devstack cinder-volume[88413]: INFO cinder.image.image_utils [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Converted 112.00 MB image at 44.41 MB/s Jul 28 10:45:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9072c797-1c69-4f19-bb87-4c71ee032386 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:26 devstack sudo[99431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9072c797-1c69-4f19-bb87-4c71ee032386 1G Jul 28 10:45:26 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:26 devstack sudo[99421]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d8b121fa-0d27-4d18-9d99-e66c0272ce68 tempest-AttachVolumeNegativeTest-1916507259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d17af338-d10c-4940-974b-60bcdd2139dd" returned: 0 in 0.499s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d8b121fa-0d27-4d18-9d99-e66c0272ce68 tempest-AttachVolumeNegativeTest-1916507259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d17af338-d10c-4940-974b-60bcdd2139dd {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:26 devstack sudo[99435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d17af338-d10c-4940-974b-60bcdd2139dd Jul 28 10:45:26 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1913197c-1eda-4cab-a631-9c8e6719924e tempest-VolumesExtendTest-712998724 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c.a5ee471a-833a-4035-a66a-d8933469e10a 2G" returned: 0 in 0.189s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1913197c-1eda-4cab-a631-9c8e6719924e tempest-VolumesExtendTest-712998724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.810s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-45d256ba-5643-4ff5-8364-32b6f1734878 tempest-TestInstancesWithCinderVolumes-733670174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.669s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:26 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-45d256ba-5643-4ff5-8364-32b6f1734878 tempest-TestInstancesWithCinderVolumes-733670174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1989900745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df86a441-a123-41e8-9fd9-f062ec3b9905,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='683e91271a514ff893096f5bbe6a97e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:45:26Z,use_quota=True,user_id='1329b3f671f64821b6353dd1ee028c46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bdc4ac13-0439-440f-b30c-aeebb3714eea),volume_type_id=bdc4ac13-0439-440f-b30c-aeebb3714eea)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:45:26 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-45d256ba-5643-4ff5-8364-32b6f1734878 tempest-TestInstancesWithCinderVolumes-733670174 None] Creating volume df86a441-a123-41e8-9fd9-f062ec3b9905 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:45:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-45d256ba-5643-4ff5-8364-32b6f1734878 tempest-TestInstancesWithCinderVolumes-733670174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-45d256ba-5643-4ff5-8364-32b6f1734878 tempest-TestInstancesWithCinderVolumes-733670174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:26 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-45d256ba-5643-4ff5-8364-32b6f1734878 tempest-TestInstancesWithCinderVolumes-733670174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:45:26 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-45d256ba-5643-4ff5-8364-32b6f1734878 tempest-TestInstancesWithCinderVolumes-733670174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:45:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-45d256ba-5643-4ff5-8364-32b6f1734878 tempest-TestInstancesWithCinderVolumes-733670174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:26 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-45d256ba-5643-4ff5-8364-32b6f1734878 tempest-TestInstancesWithCinderVolumes-733670174 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:45:26 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-45d256ba-5643-4ff5-8364-32b6f1734878 tempest-TestInstancesWithCinderVolumes-733670174 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:45:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-45d256ba-5643-4ff5-8364-32b6f1734878 tempest-TestInstancesWithCinderVolumes-733670174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-df86a441-a123-41e8-9fd9-f062ec3b9905 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:26 devstack sudo[99437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-df86a441-a123-41e8-9fd9-f062ec3b9905 1073741824 Jul 28 10:45:26 devstack sudo[99437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:26 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-1913197c-1eda-4cab-a631-9c8e6719924e tempest-VolumesExtendTest-712998724 None] Extend volume completed successfully. Jul 28 10:45:26 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d8b121fa-0d27-4d18-9d99-e66c0272ce68 tempest-AttachVolumeNegativeTest-1916507259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d17af338-d10c-4940-974b-60bcdd2139dd" returned: 0 in 0.354s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:26 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-d8b121fa-0d27-4d18-9d99-e66c0272ce68 tempest-AttachVolumeNegativeTest-1916507259 None] Lock "cinder-quobyte-d17af338-d10c-4940-974b-60bcdd2139dd" released by "delete_volume" :: held 0.932s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:45:26 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9072c797-1c69-4f19-bb87-4c71ee032386 1G" returned: 0 in 0.530s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:26 devstack cinder-volume[88413]: DEBUG cinder.volume.volume_utils [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Downloaded image 3c7ac9f7-f638-43c1-9c8d-41f36b0aec05 ((None, [{'url': 'file:///opt/stack/data/glance/images/3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'metadata': {}}])) to volume 9072c797-1c69-4f19-bb87-4c71ee032386 successfully. {{(pid=88413) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 28 10:45:26 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Temporary image 3c7ac9f7-f638-43c1-9c8d-41f36b0aec05 for user 251d566d420f41bfb4f44a0ce4b38506 is deleted. {{(pid=88413) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 28 10:45:26 devstack cinder-volume[88413]: DEBUG cinder.volume.volume_utils [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Marking volume 9072c797-1c69-4f19-bb87-4c71ee032386 as bootable. {{(pid=88413) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 28 10:45:26 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-d8b121fa-0d27-4d18-9d99-e66c0272ce68 tempest-AttachVolumeNegativeTest-1916507259 None] Created reservations ['297fa336-24d3-48c1-8f3f-ac923e6dbfbb', '49cc3920-7279-4626-9722-d64a4a0f8e5b', 'ea1d37d3-9726-43a8-93ae-aaf993b7e939', '9dca1850-a76b-4acd-86e2-bccfbcbec1ed'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:45:26 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Copying metadata from image 3c7ac9f7-f638-43c1-9c8d-41f36b0aec05 to 9072c797-1c69-4f19-bb87-4c71ee032386. {{(pid=88413) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 28 10:45:26 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Creating volume glance metadata for volume 9072c797-1c69-4f19-bb87-4c71ee032386 backed by image 3c7ac9f7-f638-43c1-9c8d-41f36b0aec05 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88413) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7d82a7d9-1bdf-453f-8895-3aa6efd50387 tempest-VolumesExtendTest-712998724 None] Acquiring lock "cinder-a5ee471a-833a-4035-a66a-d8933469e10a-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7d82a7d9-1bdf-453f-8895-3aa6efd50387 tempest-VolumesExtendTest-712998724 None] Lock "cinder-a5ee471a-833a-4035-a66a-d8933469e10a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7d82a7d9-1bdf-453f-8895-3aa6efd50387 tempest-VolumesExtendTest-712998724 None] Acquiring lock "cinder-quobyte-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Flow 'volume_create_manager' (7b53c245-b6a4-42f7-abe8-facc5eff90a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7282fe44-6f76-48f8-85a2-e2e84c806cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7d82a7d9-1bdf-453f-8895-3aa6efd50387 tempest-VolumesExtendTest-712998724 None] Lock "cinder-quobyte-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c" acquired by "delete_snapshot" :: waited 0.074s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7d82a7d9-1bdf-453f-8895-3aa6efd50387 tempest-VolumesExtendTest-712998724 None] Acquiring lock "cinder-quobyte-a5ee471a-833a-4035-a66a-d8933469e10a" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7282fe44-6f76-48f8-85a2-e2e84c806cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1643144905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d7abac5-60fa-4005-8237-8e02d2de135a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='683e91271a514ff893096f5bbe6a97e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:45:27Z,use_quota=True,user_id='1329b3f671f64821b6353dd1ee028c46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4ecee1-8c5a-47ee-8547-a217a5bc0fac),volume_type_id=3f4ecee1-8c5a-47ee-8547-a217a5bc0fac)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bdfe08e-467a-4557-9afd-e29d53af43d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bdfe08e-467a-4557-9afd-e29d53af43d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59d572e7-8b1d-42fa-9871-a7e415cfa05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG cinder.image.glance [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Creating Keystone auth plugin from conf {{(pid=88413) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7d82a7d9-1bdf-453f-8895-3aa6efd50387 tempest-VolumesExtendTest-712998724 None] Lock "cinder-quobyte-a5ee471a-833a-4035-a66a-d8933469e10a" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-7d82a7d9-1bdf-453f-8895-3aa6efd50387 tempest-VolumesExtendTest-712998724 None] Deleting offline snapshot a5ee471a-833a-4035-a66a-d8933469e10a of volume 59bd6fb5-66b6-43a8-8750-a2183ecd5d5c {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:45:27 devstack sudo[99437]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-7d82a7d9-1bdf-453f-8895-3aa6efd50387 tempest-VolumesExtendTest-712998724 None] snapshot_file for this snap is: volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c.a5ee471a-833a-4035-a66a-d8933469e10a {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d8b121fa-0d27-4d18-9d99-e66c0272ce68 tempest-AttachVolumeNegativeTest-1916507259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d8b121fa-0d27-4d18-9d99-e66c0272ce68 tempest-AttachVolumeNegativeTest-1916507259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-d8b121fa-0d27-4d18-9d99-e66c0272ce68 tempest-AttachVolumeNegativeTest-1916507259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-d8b121fa-0d27-4d18-9d99-e66c0272ce68 tempest-AttachVolumeNegativeTest-1916507259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d8b121fa-0d27-4d18-9d99-e66c0272ce68 tempest-AttachVolumeNegativeTest-1916507259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d8b121fa-0d27-4d18-9d99-e66c0272ce68 tempest-AttachVolumeNegativeTest-1916507259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[64594469-d4de-4a84-a8ad-2cd42f91c044]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7d82a7d9-1bdf-453f-8895-3aa6efd50387 tempest-VolumesExtendTest-712998724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c.a5ee471a-833a-4035-a66a-d8933469e10a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:27 devstack sudo[99448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:45:27 devstack sudo[99448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-45d256ba-5643-4ff5-8364-32b6f1734878 tempest-TestInstancesWithCinderVolumes-733670174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-df86a441-a123-41e8-9fd9-f062ec3b9905 1073741824" returned: 0 in 0.652s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82aa5f0f-3ee3-4f3c-a8ba-b0f81641e8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9072c797-1c69-4f19-bb87-4c71ee032386', 'volume_size': 1, 'image_id': '3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b606c34dd1dc45a6a010943235754dcb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'created_at': datetime.datetime(2026, 7, 28, 8, 30, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 8, 30, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c7ac9f7-f638-43c1-9c8d-41f36b0aec05/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fc14958-9590-4d71-9c79-ccf1820244fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-45d256ba-5643-4ff5-8364-32b6f1734878 tempest-TestInstancesWithCinderVolumes-733670174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-df86a441-a123-41e8-9fd9-f062ec3b9905 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:27 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Volume volume-9072c797-1c69-4f19-bb87-4c71ee032386 (9072c797-1c69-4f19-bb87-4c71ee032386): created successfully Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fc14958-9590-4d71-9c79-ccf1820244fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Flow 'volume_create_manager' (3018c0bb-f0f3-410f-9fc9-ffd7af91c48c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:45:27 devstack sudo[99451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-df86a441-a123-41e8-9fd9-f062ec3b9905 Jul 28 10:45:27 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-f8bb0e0a-19ab-4a80-99e8-248b74e3cd52 tempest-VolumesGetTest-1832246363 None] Created volume successfully. Jul 28 10:45:27 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:27 devstack sudo[99449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c.a5ee471a-833a-4035-a66a-d8933469e10a Jul 28 10:45:27 devstack sudo[99449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59d572e7-8b1d-42fa-9871-a7e415cfa05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2d7abac5-60fa-4005-8237-8e02d2de135a', 'volume_name': 'volume-2d7abac5-60fa-4005-8237-8e02d2de135a', 'volume_size': 1, 'image_id': '970fcc9b-ad8a-45d3-9566-5dd36cf4b367', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/970fcc9b-ad8a-45d3-9566-5dd36cf4b367', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--113966144', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '683e91271a514ff893096f5bbe6a97e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '970fcc9b-ad8a-45d3-9566-5dd36cf4b367', 'created_at': datetime.datetime(2026, 7, 28, 8, 45, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 8, 45, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/970fcc9b-ad8a-45d3-9566-5dd36cf4b367/file', 'properties': {}}, 'image_service': }' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (189fed91-12cb-4f15-8f3c-104da7677fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (189fed91-12cb-4f15-8f3c-104da7677fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (939dd487-6609-4661-8980-eae3fa8b9119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:27 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Volume 2d7abac5-60fa-4005-8237-8e02d2de135a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2d7abac5-60fa-4005-8237-8e02d2de135a', 'volume_size': 1, 'image_id': '970fcc9b-ad8a-45d3-9566-5dd36cf4b367', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/970fcc9b-ad8a-45d3-9566-5dd36cf4b367', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--113966144', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '683e91271a514ff893096f5bbe6a97e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '970fcc9b-ad8a-45d3-9566-5dd36cf4b367', 'created_at': datetime.datetime(2026, 7, 28, 8, 45, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 8, 45, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/970fcc9b-ad8a-45d3-9566-5dd36cf4b367/file', 'properties': {}}, 'image_service': } Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Trying to clone 2d7abac5-60fa-4005-8237-8e02d2de135a from image 970fcc9b-ad8a-45d3-9566-5dd36cf4b367 at location (None, [{'url': 'file:///opt/stack/data/glance/images/970fcc9b-ad8a-45d3-9566-5dd36cf4b367', 'metadata': {}}]). {{(pid=88413) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 28 10:45:27 devstack sudo[99448]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d8b121fa-0d27-4d18-9d99-e66c0272ce68 tempest-AttachVolumeNegativeTest-1916507259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.335s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-d8b121fa-0d27-4d18-9d99-e66c0272ce68 tempest-AttachVolumeNegativeTest-1916507259 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:45:27 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-d8b121fa-0d27-4d18-9d99-e66c0272ce68 tempest-AttachVolumeNegativeTest-1916507259 None] Deleted volume successfully. Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-d8b121fa-0d27-4d18-9d99-e66c0272ce68 tempest-AttachVolumeNegativeTest-1916507259 None] Lock "cinder-d17af338-d10c-4940-974b-60bcdd2139dd-delete_volume" released by "delete_volume" :: held 1.930s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:45:27 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-45d256ba-5643-4ff5-8364-32b6f1734878 tempest-TestInstancesWithCinderVolumes-733670174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-df86a441-a123-41e8-9fd9-f062ec3b9905" returned: 0 in 0.368s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-45d256ba-5643-4ff5-8364-32b6f1734878 tempest-TestInstancesWithCinderVolumes-733670174 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-45d256ba-5643-4ff5-8364-32b6f1734878 tempest-TestInstancesWithCinderVolumes-733670174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-2ebf0131-ebca-493a-b49e-d15b5210724d tempest-TestInstancesWithCinderVolumes-733670174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.430s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-2ebf0131-ebca-493a-b49e-d15b5210724d tempest-TestInstancesWithCinderVolumes-733670174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-700589030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff137d9-a2cd-420a-bf49-143187d1d0de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='683e91271a514ff893096f5bbe6a97e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:45:26Z,use_quota=True,user_id='1329b3f671f64821b6353dd1ee028c46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22e5a862-a9fc-4ec0-9933-e31f6b76c372),volume_type_id=22e5a862-a9fc-4ec0-9933-e31f6b76c372)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-2ebf0131-ebca-493a-b49e-d15b5210724d tempest-TestInstancesWithCinderVolumes-733670174 None] Creating volume cff137d9-a2cd-420a-bf49-143187d1d0de {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-2ebf0131-ebca-493a-b49e-d15b5210724d tempest-TestInstancesWithCinderVolumes-733670174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-2ebf0131-ebca-493a-b49e-d15b5210724d tempest-TestInstancesWithCinderVolumes-733670174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-2ebf0131-ebca-493a-b49e-d15b5210724d tempest-TestInstancesWithCinderVolumes-733670174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-2ebf0131-ebca-493a-b49e-d15b5210724d tempest-TestInstancesWithCinderVolumes-733670174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-2ebf0131-ebca-493a-b49e-d15b5210724d tempest-TestInstancesWithCinderVolumes-733670174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-2ebf0131-ebca-493a-b49e-d15b5210724d tempest-TestInstancesWithCinderVolumes-733670174 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:45:27 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-2ebf0131-ebca-493a-b49e-d15b5210724d tempest-TestInstancesWithCinderVolumes-733670174 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2ebf0131-ebca-493a-b49e-d15b5210724d tempest-TestInstancesWithCinderVolumes-733670174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-cff137d9-a2cd-420a-bf49-143187d1d0de 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-45d256ba-5643-4ff5-8364-32b6f1734878 tempest-TestInstancesWithCinderVolumes-733670174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (450ab1de-c78f-48a6-b324-ad064e216861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df86a441-a123-41e8-9fd9-f062ec3b9905', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:27 devstack sudo[99449]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-45d256ba-5643-4ff5-8364-32b6f1734878 tempest-TestInstancesWithCinderVolumes-733670174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcd34636-2ed4-4814-8c81-b03b104f297d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:27 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-cff137d9-a2cd-420a-bf49-143187d1d0de 1073741824 Jul 28 10:45:27 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7d82a7d9-1bdf-453f-8895-3aa6efd50387 tempest-VolumesExtendTest-712998724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c.a5ee471a-833a-4035-a66a-d8933469e10a" returned: 0 in 0.515s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-7d82a7d9-1bdf-453f-8895-3aa6efd50387 tempest-VolumesExtendTest-712998724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:45:27 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-45d256ba-5643-4ff5-8364-32b6f1734878 tempest-TestInstancesWithCinderVolumes-733670174 None] Volume volume-df86a441-a123-41e8-9fd9-f062ec3b9905 (df86a441-a123-41e8-9fd9-f062ec3b9905): created successfully Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-45d256ba-5643-4ff5-8364-32b6f1734878 tempest-TestInstancesWithCinderVolumes-733670174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcd34636-2ed4-4814-8c81-b03b104f297d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-45d256ba-5643-4ff5-8364-32b6f1734878 tempest-TestInstancesWithCinderVolumes-733670174 None] Flow 'volume_create_manager' (473ed4f3-458d-405e-bdf0-09161ecc0b52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d660ea-2983-41af-aa46-48b1201c17e1]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:45:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7d82a7d9-1bdf-453f-8895-3aa6efd50387 tempest-VolumesExtendTest-712998724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:27 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-45d256ba-5643-4ff5-8364-32b6f1734878 tempest-TestInstancesWithCinderVolumes-733670174 None] Created volume successfully. Jul 28 10:45:27 devstack sudo[99461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c Jul 28 10:45:27 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:28 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:45:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:45:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:45:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:28 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7d82a7d9-1bdf-453f-8895-3aa6efd50387 tempest-VolumesExtendTest-712998724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c" returned: 0 in 0.611s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7d82a7d9-1bdf-453f-8895-3aa6efd50387 tempest-VolumesExtendTest-712998724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c.a5ee471a-833a-4035-a66a-d8933469e10a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:28 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:28 devstack sudo[99470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:45:28 devstack sudo[99470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2ebf0131-ebca-493a-b49e-d15b5210724d tempest-TestInstancesWithCinderVolumes-733670174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-cff137d9-a2cd-420a-bf49-143187d1d0de 1073741824" returned: 0 in 0.731s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:28 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c.a5ee471a-833a-4035-a66a-d8933469e10a Jul 28 10:45:28 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2ebf0131-ebca-493a-b49e-d15b5210724d tempest-TestInstancesWithCinderVolumes-733670174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-cff137d9-a2cd-420a-bf49-143187d1d0de {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:28 devstack sudo[99474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-cff137d9-a2cd-420a-bf49-143187d1d0de Jul 28 10:45:28 devstack sudo[99474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:28 devstack sudo[99470]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.419s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:28 devstack sudo[99474]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:28 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:45:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2ebf0131-ebca-493a-b49e-d15b5210724d tempest-TestInstancesWithCinderVolumes-733670174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-cff137d9-a2cd-420a-bf49-143187d1d0de" returned: 0 in 0.319s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-2ebf0131-ebca-493a-b49e-d15b5210724d tempest-TestInstancesWithCinderVolumes-733670174 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:45:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-2ebf0131-ebca-493a-b49e-d15b5210724d tempest-TestInstancesWithCinderVolumes-733670174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:28 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager._thread_info {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:45:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread count: 29 {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 10:45:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread info: [<_MainThread(MainThread, started 137939890385024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 10:45:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2ebf0131-ebca-493a-b49e-d15b5210724d tempest-TestInstancesWithCinderVolumes-733670174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8f38c64-7c73-419e-b270-3c4a7bd2b2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cff137d9-a2cd-420a-bf49-143187d1d0de', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2ebf0131-ebca-493a-b49e-d15b5210724d tempest-TestInstancesWithCinderVolumes-733670174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39243bda-b905-4825-abcd-ab404cdf9e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:28 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-2ebf0131-ebca-493a-b49e-d15b5210724d tempest-TestInstancesWithCinderVolumes-733670174 None] Volume volume-cff137d9-a2cd-420a-bf49-143187d1d0de (cff137d9-a2cd-420a-bf49-143187d1d0de): created successfully Jul 28 10:45:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2ebf0131-ebca-493a-b49e-d15b5210724d tempest-TestInstancesWithCinderVolumes-733670174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39243bda-b905-4825-abcd-ab404cdf9e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2ebf0131-ebca-493a-b49e-d15b5210724d tempest-TestInstancesWithCinderVolumes-733670174 None] Flow 'volume_create_manager' (e72ed5ac-5754-42b9-ab38-ab98c46441c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:45:28 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-2ebf0131-ebca-493a-b49e-d15b5210724d tempest-TestInstancesWithCinderVolumes-733670174 None] Created volume successfully. Jul 28 10:45:28 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4a7a284-f602-4727-b72d-d76e01285cf1 tempest-VolumesGetTest-1832246363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:45:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f4a7a284-f602-4727-b72d-d76e01285cf1 tempest-VolumesGetTest-1832246363 None] Flow 'volume_create_manager' (bcc95a01-8106-45db-badd-038535d3b301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:45:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f4a7a284-f602-4727-b72d-d76e01285cf1 tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f58fc41a-9643-4600-a9ca-c4f819f48b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f4a7a284-f602-4727-b72d-d76e01285cf1 tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f58fc41a-9643-4600-a9ca-c4f819f48b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:45:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-435981290',display_name='tempest-VolumesGetTest-Volume-26950561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88ea7c00-7756-4062-89d3-90f025156b17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f444b5d8eb145c1a0d3a16c1a519eee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:45:29Z,use_quota=True,user_id='251d566d420f41bfb4f44a0ce4b38506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f4a7a284-f602-4727-b72d-d76e01285cf1 tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0282c90a-a349-4bc4-a131-ffb9ee86a438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f4a7a284-f602-4727-b72d-d76e01285cf1 tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0282c90a-a349-4bc4-a131-ffb9ee86a438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f4a7a284-f602-4727-b72d-d76e01285cf1 tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abaa8239-8598-487a-b9a9-8088a4fa985d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f4a7a284-f602-4727-b72d-d76e01285cf1 tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abaa8239-8598-487a-b9a9-8088a4fa985d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88ea7c00-7756-4062-89d3-90f025156b17', 'volume_name': 'volume-88ea7c00-7756-4062-89d3-90f025156b17', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f4a7a284-f602-4727-b72d-d76e01285cf1 tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b96ed539-ecf1-4367-b6e5-a9e56ca59c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f4a7a284-f602-4727-b72d-d76e01285cf1 tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b96ed539-ecf1-4367-b6e5-a9e56ca59c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f4a7a284-f602-4727-b72d-d76e01285cf1 tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3ff58ba-a37f-4a35-81f8-0983f288d1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:29 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-f4a7a284-f602-4727-b72d-d76e01285cf1 tempest-VolumesGetTest-1832246363 None] Volume 88ea7c00-7756-4062-89d3-90f025156b17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88ea7c00-7756-4062-89d3-90f025156b17', 'volume_size': 1} Jul 28 10:45:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f4a7a284-f602-4727-b72d-d76e01285cf1 tempest-VolumesGetTest-1832246363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f4a7a284-f602-4727-b72d-d76e01285cf1 tempest-VolumesGetTest-1832246363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:29 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f4a7a284-f602-4727-b72d-d76e01285cf1 tempest-VolumesGetTest-1832246363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:45:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-435981290',display_name='tempest-VolumesGetTest-Volume-26950561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88ea7c00-7756-4062-89d3-90f025156b17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f444b5d8eb145c1a0d3a16c1a519eee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:45:29Z,use_quota=True,user_id='251d566d420f41bfb4f44a0ce4b38506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:45:29 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-f4a7a284-f602-4727-b72d-d76e01285cf1 tempest-VolumesGetTest-1832246363 None] Creating volume 88ea7c00-7756-4062-89d3-90f025156b17 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:45:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f4a7a284-f602-4727-b72d-d76e01285cf1 tempest-VolumesGetTest-1832246363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f4a7a284-f602-4727-b72d-d76e01285cf1 tempest-VolumesGetTest-1832246363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:29 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f4a7a284-f602-4727-b72d-d76e01285cf1 tempest-VolumesGetTest-1832246363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:45:29 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f4a7a284-f602-4727-b72d-d76e01285cf1 tempest-VolumesGetTest-1832246363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:45:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f4a7a284-f602-4727-b72d-d76e01285cf1 tempest-VolumesGetTest-1832246363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:29 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f4a7a284-f602-4727-b72d-d76e01285cf1 tempest-VolumesGetTest-1832246363 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:45:29 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-f4a7a284-f602-4727-b72d-d76e01285cf1 tempest-VolumesGetTest-1832246363 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:45:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f4a7a284-f602-4727-b72d-d76e01285cf1 tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-88ea7c00-7756-4062-89d3-90f025156b17 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:29 devstack sudo[99482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-88ea7c00-7756-4062-89d3-90f025156b17 1073741824 Jul 28 10:45:29 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:29 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7d82a7d9-1bdf-453f-8895-3aa6efd50387 tempest-VolumesExtendTest-712998724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c.a5ee471a-833a-4035-a66a-d8933469e10a" returned: 0 in 0.735s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7d82a7d9-1bdf-453f-8895-3aa6efd50387 tempest-VolumesExtendTest-712998724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c.a5ee471a-833a-4035-a66a-d8933469e10a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:29 devstack sudo[99484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c.a5ee471a-833a-4035-a66a-d8933469e10a Jul 28 10:45:29 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:29 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7d82a7d9-1bdf-453f-8895-3aa6efd50387 tempest-VolumesExtendTest-712998724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c.a5ee471a-833a-4035-a66a-d8933469e10a" returned: 0 in 0.329s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:29 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7d82a7d9-1bdf-453f-8895-3aa6efd50387 tempest-VolumesExtendTest-712998724 None] Lock "cinder-quobyte-a5ee471a-833a-4035-a66a-d8933469e10a" released by "_delete_snapshot" :: held 2.344s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:45:29 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7d82a7d9-1bdf-453f-8895-3aa6efd50387 tempest-VolumesExtendTest-712998724 None] Lock "cinder-quobyte-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c" released by "delete_snapshot" :: held 2.412s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:45:29 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f4a7a284-f602-4727-b72d-d76e01285cf1 tempest-VolumesGetTest-1832246363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-88ea7c00-7756-4062-89d3-90f025156b17 1073741824" returned: 0 in 0.510s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:29 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-7d82a7d9-1bdf-453f-8895-3aa6efd50387 tempest-VolumesExtendTest-712998724 None] Created reservations ['ee8609de-f4d5-45f9-8dab-c0a170a1a93f', '523ec804-dcc6-4d7e-82b1-81c15cd70493', '29fee199-1d45-474a-a6b2-a5f340435587', '441c0df1-b0bf-4858-acb7-6b04373bd40b'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:45:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f4a7a284-f602-4727-b72d-d76e01285cf1 tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-88ea7c00-7756-4062-89d3-90f025156b17 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:29 devstack sudo[99492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-88ea7c00-7756-4062-89d3-90f025156b17 Jul 28 10:45:29 devstack sudo[99492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:29 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-7d82a7d9-1bdf-453f-8895-3aa6efd50387 tempest-VolumesExtendTest-712998724 None] Delete snapshot completed successfully. Jul 28 10:45:29 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7d82a7d9-1bdf-453f-8895-3aa6efd50387 tempest-VolumesExtendTest-712998724 None] Lock "cinder-a5ee471a-833a-4035-a66a-d8933469e10a-delete_snapshot" released by "delete_snapshot" :: held 2.678s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:45:29 devstack sudo[99492]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f4a7a284-f602-4727-b72d-d76e01285cf1 tempest-VolumesGetTest-1832246363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-88ea7c00-7756-4062-89d3-90f025156b17" returned: 0 in 0.274s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:29 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f4a7a284-f602-4727-b72d-d76e01285cf1 tempest-VolumesGetTest-1832246363 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:45:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f4a7a284-f602-4727-b72d-d76e01285cf1 tempest-VolumesGetTest-1832246363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f4a7a284-f602-4727-b72d-d76e01285cf1 tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3ff58ba-a37f-4a35-81f8-0983f288d1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88ea7c00-7756-4062-89d3-90f025156b17', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f4a7a284-f602-4727-b72d-d76e01285cf1 tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (437282b0-b1c3-4788-9739-9040e0c9318d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:29 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-f4a7a284-f602-4727-b72d-d76e01285cf1 tempest-VolumesGetTest-1832246363 None] Volume volume-88ea7c00-7756-4062-89d3-90f025156b17 (88ea7c00-7756-4062-89d3-90f025156b17): created successfully Jul 28 10:45:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f4a7a284-f602-4727-b72d-d76e01285cf1 tempest-VolumesGetTest-1832246363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (437282b0-b1c3-4788-9739-9040e0c9318d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f4a7a284-f602-4727-b72d-d76e01285cf1 tempest-VolumesGetTest-1832246363 None] Flow 'volume_create_manager' (bcc95a01-8106-45db-badd-038535d3b301) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:45:30 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-f4a7a284-f602-4727-b72d-d76e01285cf1 tempest-VolumesGetTest-1832246363 None] Created volume successfully. Jul 28 10:45:30 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-082442cb-6bcf-4d1a-8bc6-61e3b7711172 tempest-VolumesExtendTest-712998724 None] Acquiring lock "cinder-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:45:30 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-082442cb-6bcf-4d1a-8bc6-61e3b7711172 tempest-VolumesExtendTest-712998724 None] Lock "cinder-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:45:30 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-082442cb-6bcf-4d1a-8bc6-61e3b7711172 tempest-VolumesExtendTest-712998724 None] Acquiring lock "cinder-quobyte-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:45:30 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-082442cb-6bcf-4d1a-8bc6-61e3b7711172 tempest-VolumesExtendTest-712998724 None] Lock "cinder-quobyte-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c" acquired by "delete_volume" :: waited 0.017s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:45:30 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5af755e-4c10-4458-8bfc-4e4f5769768d]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:45:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-082442cb-6bcf-4d1a-8bc6-61e3b7711172 tempest-VolumesExtendTest-712998724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:30 devstack sudo[99496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c Jul 28 10:45:30 devstack sudo[99496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:30 devstack sudo[99496]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-082442cb-6bcf-4d1a-8bc6-61e3b7711172 tempest-VolumesExtendTest-712998724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c" returned: 0 in 0.390s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-082442cb-6bcf-4d1a-8bc6-61e3b7711172 tempest-VolumesExtendTest-712998724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:30 devstack sudo[99501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c Jul 28 10:45:30 devstack sudo[99501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:31 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f2c4ee37-d152-4a84-b118-e6d7ae8ae4eb tempest-VolumesGetTest-1832246363 None] Acquiring lock "cinder-88ea7c00-7756-4062-89d3-90f025156b17-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:45:31 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f2c4ee37-d152-4a84-b118-e6d7ae8ae4eb tempest-VolumesGetTest-1832246363 None] Lock "cinder-88ea7c00-7756-4062-89d3-90f025156b17-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:45:31 devstack sudo[99501]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-082442cb-6bcf-4d1a-8bc6-61e3b7711172 tempest-VolumesExtendTest-712998724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c" returned: 0 in 0.378s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:31 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-082442cb-6bcf-4d1a-8bc6-61e3b7711172 tempest-VolumesExtendTest-712998724 None] Lock "cinder-quobyte-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c" released by "delete_volume" :: held 0.848s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:45:31 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f2c4ee37-d152-4a84-b118-e6d7ae8ae4eb tempest-VolumesGetTest-1832246363 None] Acquiring lock "cinder-quobyte-88ea7c00-7756-4062-89d3-90f025156b17" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:45:31 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f2c4ee37-d152-4a84-b118-e6d7ae8ae4eb tempest-VolumesGetTest-1832246363 None] Lock "cinder-quobyte-88ea7c00-7756-4062-89d3-90f025156b17" acquired by "delete_volume" :: waited 0.019s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:45:31 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e438c0-090d-4251-a14d-f4bdfc55483d]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:45:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f2c4ee37-d152-4a84-b118-e6d7ae8ae4eb tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-88ea7c00-7756-4062-89d3-90f025156b17 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:31 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-082442cb-6bcf-4d1a-8bc6-61e3b7711172 tempest-VolumesExtendTest-712998724 None] Created reservations ['4d7df8d1-40b3-46c5-b5eb-c0e105d9c573', 'f51232b1-1600-4e86-8096-8b6e777e856f', '51630955-05ed-4344-a25d-ca87d6a4b609', '669bfbe7-d79d-4871-bc97-feab3fe6c967'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:45:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-082442cb-6bcf-4d1a-8bc6-61e3b7711172 tempest-VolumesExtendTest-712998724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-082442cb-6bcf-4d1a-8bc6-61e3b7711172 tempest-VolumesExtendTest-712998724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:31 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-082442cb-6bcf-4d1a-8bc6-61e3b7711172 tempest-VolumesExtendTest-712998724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:45:31 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-082442cb-6bcf-4d1a-8bc6-61e3b7711172 tempest-VolumesExtendTest-712998724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:45:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-082442cb-6bcf-4d1a-8bc6-61e3b7711172 tempest-VolumesExtendTest-712998724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-082442cb-6bcf-4d1a-8bc6-61e3b7711172 tempest-VolumesExtendTest-712998724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:31 devstack sudo[99504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-88ea7c00-7756-4062-89d3-90f025156b17 Jul 28 10:45:31 devstack sudo[99504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:31 devstack sudo[99506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:45:31 devstack sudo[99506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:31 devstack sudo[99506]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-082442cb-6bcf-4d1a-8bc6-61e3b7711172 tempest-VolumesExtendTest-712998724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.311s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:31 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-082442cb-6bcf-4d1a-8bc6-61e3b7711172 tempest-VolumesExtendTest-712998724 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:45:31 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-082442cb-6bcf-4d1a-8bc6-61e3b7711172 tempest-VolumesExtendTest-712998724 None] Deleted volume successfully. Jul 28 10:45:31 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-082442cb-6bcf-4d1a-8bc6-61e3b7711172 tempest-VolumesExtendTest-712998724 None] Lock "cinder-59bd6fb5-66b6-43a8-8750-a2183ecd5d5c-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:45:31 devstack sudo[99504]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f2c4ee37-d152-4a84-b118-e6d7ae8ae4eb tempest-VolumesGetTest-1832246363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-88ea7c00-7756-4062-89d3-90f025156b17" returned: 0 in 0.497s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f2c4ee37-d152-4a84-b118-e6d7ae8ae4eb tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-88ea7c00-7756-4062-89d3-90f025156b17 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:31 devstack sudo[99512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-88ea7c00-7756-4062-89d3-90f025156b17 Jul 28 10:45:31 devstack sudo[99512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:32 devstack sudo[99512]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f2c4ee37-d152-4a84-b118-e6d7ae8ae4eb tempest-VolumesGetTest-1832246363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-88ea7c00-7756-4062-89d3-90f025156b17" returned: 0 in 0.371s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:32 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f2c4ee37-d152-4a84-b118-e6d7ae8ae4eb tempest-VolumesGetTest-1832246363 None] Lock "cinder-quobyte-88ea7c00-7756-4062-89d3-90f025156b17" released by "delete_volume" :: held 0.922s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:45:32 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-f2c4ee37-d152-4a84-b118-e6d7ae8ae4eb tempest-VolumesGetTest-1832246363 None] Created reservations ['a49c5fd5-bbd5-436f-ac30-d2e367546ae2', '755a5cd5-cbe0-4a71-9bea-de1972d31a9d', '5234f917-3ea0-4db3-aea0-3ca54599c591', 'f042b40e-11ed-4447-bd30-0dde5c7040ad'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:45:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f2c4ee37-d152-4a84-b118-e6d7ae8ae4eb tempest-VolumesGetTest-1832246363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f2c4ee37-d152-4a84-b118-e6d7ae8ae4eb tempest-VolumesGetTest-1832246363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:32 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f2c4ee37-d152-4a84-b118-e6d7ae8ae4eb tempest-VolumesGetTest-1832246363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:45:32 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f2c4ee37-d152-4a84-b118-e6d7ae8ae4eb tempest-VolumesGetTest-1832246363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:45:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f2c4ee37-d152-4a84-b118-e6d7ae8ae4eb tempest-VolumesGetTest-1832246363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f2c4ee37-d152-4a84-b118-e6d7ae8ae4eb tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:32 devstack sudo[99515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:45:32 devstack sudo[99515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:32 devstack sudo[99515]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f2c4ee37-d152-4a84-b118-e6d7ae8ae4eb tempest-VolumesGetTest-1832246363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.316s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:32 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-f2c4ee37-d152-4a84-b118-e6d7ae8ae4eb tempest-VolumesGetTest-1832246363 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:45:32 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-f2c4ee37-d152-4a84-b118-e6d7ae8ae4eb tempest-VolumesGetTest-1832246363 None] Deleted volume successfully. Jul 28 10:45:32 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f2c4ee37-d152-4a84-b118-e6d7ae8ae4eb tempest-VolumesGetTest-1832246363 None] Lock "cinder-88ea7c00-7756-4062-89d3-90f025156b17-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:45:32 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_970fcc9b-ad8a-45d3-9566-5dd36cf4b367_j689iv9idevstack@QuobyteHD, size 20.69 MB, duration 5.38 sec {{(pid=88413) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 28 10:45:32 devstack cinder-volume[88413]: INFO cinder.image.image_utils [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Image download 20.69 MB at 3.84 MB/s Jul 28 10:45:33 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b7c6eb-6945-4ab7-af63-8bf5e663a1ff]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:45:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_970fcc9b-ad8a-45d3-9566-5dd36cf4b367_j689iv9idevstack@QuobyteHD {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:33 devstack sudo[99522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_970fcc9b-ad8a-45d3-9566-5dd36cf4b367_j689iv9idevstack@QuobyteHD Jul 28 10:45:33 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:33 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_970fcc9b-ad8a-45d3-9566-5dd36cf4b367_j689iv9idevstack@QuobyteHD" returned: 0 in 0.445s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:33 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Temporary image 970fcc9b-ad8a-45d3-9566-5dd36cf4b367 is fetched for user 1329b3f671f64821b6353dd1ee028c46. {{(pid=88413) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 28 10:45:33 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0aead8ef-1cba-4f17-8b8b-d36d632c24b7 tempest-VolumesGetTest-1832246363 None] Acquiring lock "cinder-9072c797-1c69-4f19-bb87-4c71ee032386-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:45:33 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e14152-dce1-4584-951e-96d2a56a36f8]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:45:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_970fcc9b-ad8a-45d3-9566-5dd36cf4b367_j689iv9idevstack@QuobyteHD {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:33 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0aead8ef-1cba-4f17-8b8b-d36d632c24b7 tempest-VolumesGetTest-1832246363 None] Lock "cinder-9072c797-1c69-4f19-bb87-4c71ee032386-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:45:33 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0aead8ef-1cba-4f17-8b8b-d36d632c24b7 tempest-VolumesGetTest-1832246363 None] Acquiring lock "cinder-quobyte-9072c797-1c69-4f19-bb87-4c71ee032386" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:45:33 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0aead8ef-1cba-4f17-8b8b-d36d632c24b7 tempest-VolumesGetTest-1832246363 None] Lock "cinder-quobyte-9072c797-1c69-4f19-bb87-4c71ee032386" acquired by "delete_volume" :: waited 0.015s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:45:33 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74f6920-1d0f-40cb-b191-454a10e21a6e]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:45:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0aead8ef-1cba-4f17-8b8b-d36d632c24b7 tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9072c797-1c69-4f19-bb87-4c71ee032386 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:33 devstack sudo[99530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_970fcc9b-ad8a-45d3-9566-5dd36cf4b367_j689iv9idevstack@QuobyteHD Jul 28 10:45:33 devstack sudo[99530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:33 devstack sudo[99531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9072c797-1c69-4f19-bb87-4c71ee032386 Jul 28 10:45:33 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:33 devstack sudo[99530]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_970fcc9b-ad8a-45d3-9566-5dd36cf4b367_j689iv9idevstack@QuobyteHD" returned: 0 in 0.458s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:33 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1643144905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d7abac5-60fa-4005-8237-8e02d2de135a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='683e91271a514ff893096f5bbe6a97e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:45:27Z,use_quota=True,user_id='1329b3f671f64821b6353dd1ee028c46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4ecee1-8c5a-47ee-8547-a217a5bc0fac),volume_type_id=3f4ecee1-8c5a-47ee-8547-a217a5bc0fac)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:45:33 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Creating volume 2d7abac5-60fa-4005-8237-8e02d2de135a {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:45:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:33 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:45:34 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:45:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:34 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:45:34 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:45:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2d7abac5-60fa-4005-8237-8e02d2de135a 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:34 devstack sudo[99539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2d7abac5-60fa-4005-8237-8e02d2de135a 1073741824 Jul 28 10:45:34 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:34 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0aead8ef-1cba-4f17-8b8b-d36d632c24b7 tempest-VolumesGetTest-1832246363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9072c797-1c69-4f19-bb87-4c71ee032386" returned: 0 in 0.472s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0aead8ef-1cba-4f17-8b8b-d36d632c24b7 tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9072c797-1c69-4f19-bb87-4c71ee032386 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:34 devstack sudo[99542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9072c797-1c69-4f19-bb87-4c71ee032386 Jul 28 10:45:34 devstack sudo[99542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:34 devstack sudo[99542]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0aead8ef-1cba-4f17-8b8b-d36d632c24b7 tempest-VolumesGetTest-1832246363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9072c797-1c69-4f19-bb87-4c71ee032386" returned: 0 in 0.309s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:34 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0aead8ef-1cba-4f17-8b8b-d36d632c24b7 tempest-VolumesGetTest-1832246363 None] Lock "cinder-quobyte-9072c797-1c69-4f19-bb87-4c71ee032386" released by "delete_volume" :: held 0.848s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:45:34 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-0aead8ef-1cba-4f17-8b8b-d36d632c24b7 tempest-VolumesGetTest-1832246363 None] Created reservations ['eb5ac50e-9c5c-4572-9c3c-a3a475096af7', '82e15602-f318-45a6-b1a1-96b7e769892a', '6b6a2766-c45f-45a9-8bd1-1aec7941d990', '82c5e6f2-f7c1-4d8b-b977-53262998b58d'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:45:34 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2d7abac5-60fa-4005-8237-8e02d2de135a 1073741824" returned: 0 in 0.620s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0aead8ef-1cba-4f17-8b8b-d36d632c24b7 tempest-VolumesGetTest-1832246363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0aead8ef-1cba-4f17-8b8b-d36d632c24b7 tempest-VolumesGetTest-1832246363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:34 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0aead8ef-1cba-4f17-8b8b-d36d632c24b7 tempest-VolumesGetTest-1832246363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:45:34 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0aead8ef-1cba-4f17-8b8b-d36d632c24b7 tempest-VolumesGetTest-1832246363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:45:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0aead8ef-1cba-4f17-8b8b-d36d632c24b7 tempest-VolumesGetTest-1832246363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0aead8ef-1cba-4f17-8b8b-d36d632c24b7 tempest-VolumesGetTest-1832246363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2d7abac5-60fa-4005-8237-8e02d2de135a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:34 devstack sudo[99549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:45:34 devstack sudo[99549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:34 devstack sudo[99550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2d7abac5-60fa-4005-8237-8e02d2de135a Jul 28 10:45:34 devstack sudo[99550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:34 devstack sudo[99550]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2d7abac5-60fa-4005-8237-8e02d2de135a" returned: 0 in 0.264s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:34 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:45:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:35 devstack cinder-volume[88413]: DEBUG cinder.volume.volume_utils [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Attempting download of 970fcc9b-ad8a-45d3-9566-5dd36cf4b367 ((None, [{'url': 'file:///opt/stack/data/glance/images/970fcc9b-ad8a-45d3-9566-5dd36cf4b367', 'metadata': {}}])) to volume 2d7abac5-60fa-4005-8237-8e02d2de135a. {{(pid=88413) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 28 10:45:35 devstack sudo[99549]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0aead8ef-1cba-4f17-8b8b-d36d632c24b7 tempest-VolumesGetTest-1832246363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.361s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:35 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-0aead8ef-1cba-4f17-8b8b-d36d632c24b7 tempest-VolumesGetTest-1832246363 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:45:35 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-0aead8ef-1cba-4f17-8b8b-d36d632c24b7 tempest-VolumesGetTest-1832246363 None] Deleted volume successfully. Jul 28 10:45:35 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0aead8ef-1cba-4f17-8b8b-d36d632c24b7 tempest-VolumesGetTest-1832246363 None] Lock "cinder-9072c797-1c69-4f19-bb87-4c71ee032386-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:45:35 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f197d8-fba6-49b2-9924-8391cf07de56]: (4, 'raw') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:45:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_970fcc9b-ad8a-45d3-9566-5dd36cf4b367_8wi0d84g {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:35 devstack sudo[99556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_970fcc9b-ad8a-45d3-9566-5dd36cf4b367_8wi0d84g Jul 28 10:45:35 devstack sudo[99556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:35 devstack sudo[99556]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_970fcc9b-ad8a-45d3-9566-5dd36cf4b367_8wi0d84g" returned: 0 in 0.365s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_970fcc9b-ad8a-45d3-9566-5dd36cf4b367_8wi0d84g {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:35 devstack sudo[99560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_970fcc9b-ad8a-45d3-9566-5dd36cf4b367_8wi0d84g Jul 28 10:45:35 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:35 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-afdf4c13-16a1-45c1-a57c-d995e2dbe13c tempest-VolumesListTestJSON-997281456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:45:35 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-afdf4c13-16a1-45c1-a57c-d995e2dbe13c tempest-VolumesListTestJSON-997281456 None] Flow 'volume_create_manager' (fa04fd3f-31ba-41e5-ab3c-9fece95fa257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:45:35 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-afdf4c13-16a1-45c1-a57c-d995e2dbe13c tempest-VolumesListTestJSON-997281456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91622ac0-6327-4560-8ccd-c9b876e76b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:35 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-afdf4c13-16a1-45c1-a57c-d995e2dbe13c tempest-VolumesListTestJSON-997281456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91622ac0-6327-4560-8ccd-c9b876e76b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:45:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-404958505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=154adc0b-49df-496b-932a-1e2d168ad93b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9f124a34f1d94395afbf9b37ffe45547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:45:36Z,use_quota=True,user_id='2ee322bec82742f09c7f92a406b33ae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:35 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-afdf4c13-16a1-45c1-a57c-d995e2dbe13c tempest-VolumesListTestJSON-997281456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcbbf618-d175-42c7-b615-6634d078f617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:35 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-afdf4c13-16a1-45c1-a57c-d995e2dbe13c tempest-VolumesListTestJSON-997281456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcbbf618-d175-42c7-b615-6634d078f617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:35 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-afdf4c13-16a1-45c1-a57c-d995e2dbe13c tempest-VolumesListTestJSON-997281456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b7b0ca5-ae6c-4441-92ba-edd589a1bff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:35 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-afdf4c13-16a1-45c1-a57c-d995e2dbe13c tempest-VolumesListTestJSON-997281456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b7b0ca5-ae6c-4441-92ba-edd589a1bff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '154adc0b-49df-496b-932a-1e2d168ad93b', 'volume_name': 'volume-154adc0b-49df-496b-932a-1e2d168ad93b', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:35 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-afdf4c13-16a1-45c1-a57c-d995e2dbe13c tempest-VolumesListTestJSON-997281456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10ce56a1-a5ce-4470-be4c-bd278ca4b521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:35 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-afdf4c13-16a1-45c1-a57c-d995e2dbe13c tempest-VolumesListTestJSON-997281456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10ce56a1-a5ce-4470-be4c-bd278ca4b521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:35 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-afdf4c13-16a1-45c1-a57c-d995e2dbe13c tempest-VolumesListTestJSON-997281456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b46d2816-48ce-40a2-9a68-0799a147da2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:35 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-afdf4c13-16a1-45c1-a57c-d995e2dbe13c tempest-VolumesListTestJSON-997281456 None] Volume 154adc0b-49df-496b-932a-1e2d168ad93b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-154adc0b-49df-496b-932a-1e2d168ad93b', 'volume_size': 1} Jul 28 10:45:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-afdf4c13-16a1-45c1-a57c-d995e2dbe13c tempest-VolumesListTestJSON-997281456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-afdf4c13-16a1-45c1-a57c-d995e2dbe13c tempest-VolumesListTestJSON-997281456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:35 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-afdf4c13-16a1-45c1-a57c-d995e2dbe13c tempest-VolumesListTestJSON-997281456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:45:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-404958505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=154adc0b-49df-496b-932a-1e2d168ad93b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9f124a34f1d94395afbf9b37ffe45547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:45:36Z,use_quota=True,user_id='2ee322bec82742f09c7f92a406b33ae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:45:35 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-afdf4c13-16a1-45c1-a57c-d995e2dbe13c tempest-VolumesListTestJSON-997281456 None] Creating volume 154adc0b-49df-496b-932a-1e2d168ad93b {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:45:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-afdf4c13-16a1-45c1-a57c-d995e2dbe13c tempest-VolumesListTestJSON-997281456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-afdf4c13-16a1-45c1-a57c-d995e2dbe13c tempest-VolumesListTestJSON-997281456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:35 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-afdf4c13-16a1-45c1-a57c-d995e2dbe13c tempest-VolumesListTestJSON-997281456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:45:35 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-afdf4c13-16a1-45c1-a57c-d995e2dbe13c tempest-VolumesListTestJSON-997281456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:45:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-afdf4c13-16a1-45c1-a57c-d995e2dbe13c tempest-VolumesListTestJSON-997281456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:35 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-afdf4c13-16a1-45c1-a57c-d995e2dbe13c tempest-VolumesListTestJSON-997281456 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:45:35 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-afdf4c13-16a1-45c1-a57c-d995e2dbe13c tempest-VolumesListTestJSON-997281456 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:45:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-afdf4c13-16a1-45c1-a57c-d995e2dbe13c tempest-VolumesListTestJSON-997281456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-154adc0b-49df-496b-932a-1e2d168ad93b 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:35 devstack sudo[99562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-154adc0b-49df-496b-932a-1e2d168ad93b 1073741824 Jul 28 10:45:35 devstack sudo[99562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:35 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_970fcc9b-ad8a-45d3-9566-5dd36cf4b367_8wi0d84g" returned: 1 in 0.485s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_970fcc9b-ad8a-45d3-9566-5dd36cf4b367_8wi0d84g' failed. Not Retrying. {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 10:45:35 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4b0ae9-ee7b-4783-bf36-fbb30f54949b]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:45:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_970fcc9b-ad8a-45d3-9566-5dd36cf4b367_j689iv9idevstack@QuobyteHD {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:36 devstack sudo[99566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_970fcc9b-ad8a-45d3-9566-5dd36cf4b367_j689iv9idevstack@QuobyteHD Jul 28 10:45:36 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:36 devstack sudo[99562]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-afdf4c13-16a1-45c1-a57c-d995e2dbe13c tempest-VolumesListTestJSON-997281456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-154adc0b-49df-496b-932a-1e2d168ad93b 1073741824" returned: 0 in 0.563s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-afdf4c13-16a1-45c1-a57c-d995e2dbe13c tempest-VolumesListTestJSON-997281456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-154adc0b-49df-496b-932a-1e2d168ad93b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:36 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_970fcc9b-ad8a-45d3-9566-5dd36cf4b367_j689iv9idevstack@QuobyteHD" returned: 0 in 0.446s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:36 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] 970fcc9b-ad8a-45d3-9566-5dd36cf4b367 was qcow2, converting to qcow2 {{(pid=88413) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 28 10:45:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_970fcc9b-ad8a-45d3-9566-5dd36cf4b367_j689iv9idevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2d7abac5-60fa-4005-8237-8e02d2de135a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:36 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-154adc0b-49df-496b-932a-1e2d168ad93b Jul 28 10:45:36 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:36 devstack sudo[99577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_970fcc9b-ad8a-45d3-9566-5dd36cf4b367_j689iv9idevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2d7abac5-60fa-4005-8237-8e02d2de135a Jul 28 10:45:36 devstack sudo[99577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:36 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-afdf4c13-16a1-45c1-a57c-d995e2dbe13c tempest-VolumesListTestJSON-997281456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-154adc0b-49df-496b-932a-1e2d168ad93b" returned: 0 in 0.280s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:36 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-afdf4c13-16a1-45c1-a57c-d995e2dbe13c tempest-VolumesListTestJSON-997281456 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:45:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-afdf4c13-16a1-45c1-a57c-d995e2dbe13c tempest-VolumesListTestJSON-997281456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-afdf4c13-16a1-45c1-a57c-d995e2dbe13c tempest-VolumesListTestJSON-997281456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b46d2816-48ce-40a2-9a68-0799a147da2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-154adc0b-49df-496b-932a-1e2d168ad93b', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-afdf4c13-16a1-45c1-a57c-d995e2dbe13c tempest-VolumesListTestJSON-997281456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc9fe804-8c29-408c-8d5a-c6cb7bcbd9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:36 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-afdf4c13-16a1-45c1-a57c-d995e2dbe13c tempest-VolumesListTestJSON-997281456 None] Volume volume-154adc0b-49df-496b-932a-1e2d168ad93b (154adc0b-49df-496b-932a-1e2d168ad93b): created successfully Jul 28 10:45:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-afdf4c13-16a1-45c1-a57c-d995e2dbe13c tempest-VolumesListTestJSON-997281456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc9fe804-8c29-408c-8d5a-c6cb7bcbd9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-afdf4c13-16a1-45c1-a57c-d995e2dbe13c tempest-VolumesListTestJSON-997281456 None] Flow 'volume_create_manager' (fa04fd3f-31ba-41e5-ab3c-9fece95fa257) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:45:36 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-afdf4c13-16a1-45c1-a57c-d995e2dbe13c tempest-VolumesListTestJSON-997281456 None] Created volume successfully. Jul 28 10:45:37 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [req-7887dd07-ff9a-44cf-a293-b7e0702109be req-cb6c8026-ed74-4eb8-ae11-d5785facf8a8 tempest-VolumesSnapshotsTestJSON-1887860676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:45:37 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-7887dd07-ff9a-44cf-a293-b7e0702109be req-cb6c8026-ed74-4eb8-ae11-d5785facf8a8 tempest-VolumesSnapshotsTestJSON-1887860676 None] Flow 'volume_create_manager' (385d5ae0-60e4-4aff-8c01-6c4ac8636f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:45:37 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-7887dd07-ff9a-44cf-a293-b7e0702109be req-cb6c8026-ed74-4eb8-ae11-d5785facf8a8 tempest-VolumesSnapshotsTestJSON-1887860676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece3041c-5bfa-4b63-8fef-752fc067fafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:37 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-7887dd07-ff9a-44cf-a293-b7e0702109be req-cb6c8026-ed74-4eb8-ae11-d5785facf8a8 tempest-VolumesSnapshotsTestJSON-1887860676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece3041c-5bfa-4b63-8fef-752fc067fafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-177132310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0b9e525-9657-4897-8d60-be3c4417595b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50429ba7fe2f4439af1b49c10e4d3f63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:45:37Z,use_quota=True,user_id='8d2560d464534d2aacfd52fe8db0a499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:37 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-7887dd07-ff9a-44cf-a293-b7e0702109be req-cb6c8026-ed74-4eb8-ae11-d5785facf8a8 tempest-VolumesSnapshotsTestJSON-1887860676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7200ab54-6a21-4c16-bdee-c01c6f28e44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:37 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-7887dd07-ff9a-44cf-a293-b7e0702109be req-cb6c8026-ed74-4eb8-ae11-d5785facf8a8 tempest-VolumesSnapshotsTestJSON-1887860676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7200ab54-6a21-4c16-bdee-c01c6f28e44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:37 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-7887dd07-ff9a-44cf-a293-b7e0702109be req-cb6c8026-ed74-4eb8-ae11-d5785facf8a8 tempest-VolumesSnapshotsTestJSON-1887860676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85fd2807-fece-4850-a49e-9b5b25449ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:37 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-7887dd07-ff9a-44cf-a293-b7e0702109be req-cb6c8026-ed74-4eb8-ae11-d5785facf8a8 tempest-VolumesSnapshotsTestJSON-1887860676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85fd2807-fece-4850-a49e-9b5b25449ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0b9e525-9657-4897-8d60-be3c4417595b', 'volume_name': 'volume-f0b9e525-9657-4897-8d60-be3c4417595b', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:37 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-7887dd07-ff9a-44cf-a293-b7e0702109be req-cb6c8026-ed74-4eb8-ae11-d5785facf8a8 tempest-VolumesSnapshotsTestJSON-1887860676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0768b69d-5344-416b-a8b5-19d5d82aff47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:37 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-7887dd07-ff9a-44cf-a293-b7e0702109be req-cb6c8026-ed74-4eb8-ae11-d5785facf8a8 tempest-VolumesSnapshotsTestJSON-1887860676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0768b69d-5344-416b-a8b5-19d5d82aff47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:37 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-7887dd07-ff9a-44cf-a293-b7e0702109be req-cb6c8026-ed74-4eb8-ae11-d5785facf8a8 tempest-VolumesSnapshotsTestJSON-1887860676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eec53b84-cce0-4034-9c17-3051e41dd8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:37 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [req-7887dd07-ff9a-44cf-a293-b7e0702109be req-cb6c8026-ed74-4eb8-ae11-d5785facf8a8 tempest-VolumesSnapshotsTestJSON-1887860676 None] Volume f0b9e525-9657-4897-8d60-be3c4417595b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0b9e525-9657-4897-8d60-be3c4417595b', 'volume_size': 1} Jul 28 10:45:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-7887dd07-ff9a-44cf-a293-b7e0702109be req-cb6c8026-ed74-4eb8-ae11-d5785facf8a8 tempest-VolumesSnapshotsTestJSON-1887860676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-7887dd07-ff9a-44cf-a293-b7e0702109be req-cb6c8026-ed74-4eb8-ae11-d5785facf8a8 tempest-VolumesSnapshotsTestJSON-1887860676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:37 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [req-7887dd07-ff9a-44cf-a293-b7e0702109be req-cb6c8026-ed74-4eb8-ae11-d5785facf8a8 tempest-VolumesSnapshotsTestJSON-1887860676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-177132310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0b9e525-9657-4897-8d60-be3c4417595b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50429ba7fe2f4439af1b49c10e4d3f63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:45:37Z,use_quota=True,user_id='8d2560d464534d2aacfd52fe8db0a499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:45:37 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [req-7887dd07-ff9a-44cf-a293-b7e0702109be req-cb6c8026-ed74-4eb8-ae11-d5785facf8a8 tempest-VolumesSnapshotsTestJSON-1887860676 None] Creating volume f0b9e525-9657-4897-8d60-be3c4417595b {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:45:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-7887dd07-ff9a-44cf-a293-b7e0702109be req-cb6c8026-ed74-4eb8-ae11-d5785facf8a8 tempest-VolumesSnapshotsTestJSON-1887860676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-7887dd07-ff9a-44cf-a293-b7e0702109be req-cb6c8026-ed74-4eb8-ae11-d5785facf8a8 tempest-VolumesSnapshotsTestJSON-1887860676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:37 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [req-7887dd07-ff9a-44cf-a293-b7e0702109be req-cb6c8026-ed74-4eb8-ae11-d5785facf8a8 tempest-VolumesSnapshotsTestJSON-1887860676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:45:37 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [req-7887dd07-ff9a-44cf-a293-b7e0702109be req-cb6c8026-ed74-4eb8-ae11-d5785facf8a8 tempest-VolumesSnapshotsTestJSON-1887860676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:45:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-7887dd07-ff9a-44cf-a293-b7e0702109be req-cb6c8026-ed74-4eb8-ae11-d5785facf8a8 tempest-VolumesSnapshotsTestJSON-1887860676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:37 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [req-7887dd07-ff9a-44cf-a293-b7e0702109be req-cb6c8026-ed74-4eb8-ae11-d5785facf8a8 tempest-VolumesSnapshotsTestJSON-1887860676 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:45:37 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [req-7887dd07-ff9a-44cf-a293-b7e0702109be req-cb6c8026-ed74-4eb8-ae11-d5785facf8a8 tempest-VolumesSnapshotsTestJSON-1887860676 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:45:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-7887dd07-ff9a-44cf-a293-b7e0702109be req-cb6c8026-ed74-4eb8-ae11-d5785facf8a8 tempest-VolumesSnapshotsTestJSON-1887860676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:37 devstack sudo[99585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b 1073741824 Jul 28 10:45:37 devstack sudo[99585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:38 devstack sudo[99585]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-7887dd07-ff9a-44cf-a293-b7e0702109be req-cb6c8026-ed74-4eb8-ae11-d5785facf8a8 tempest-VolumesSnapshotsTestJSON-1887860676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b 1073741824" returned: 0 in 0.700s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-7887dd07-ff9a-44cf-a293-b7e0702109be req-cb6c8026-ed74-4eb8-ae11-d5785facf8a8 tempest-VolumesSnapshotsTestJSON-1887860676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:38 devstack sudo[99593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b Jul 28 10:45:38 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:38 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fbe9a9f-db8f-4046-b71c-9ca83c8b33f5 tempest-VolumesListTestJSON-997281456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:45:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1fbe9a9f-db8f-4046-b71c-9ca83c8b33f5 tempest-VolumesListTestJSON-997281456 None] Flow 'volume_create_manager' (c6ff40b0-4577-463b-af5a-35a13dafe1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:45:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1fbe9a9f-db8f-4046-b71c-9ca83c8b33f5 tempest-VolumesListTestJSON-997281456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (550a4bb6-3bd8-42be-be7d-3b5ef4e73939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1fbe9a9f-db8f-4046-b71c-9ca83c8b33f5 tempest-VolumesListTestJSON-997281456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (550a4bb6-3bd8-42be-be7d-3b5ef4e73939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-198105112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4554a388-e778-471c-bd58-51a3e8ddc979,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9f124a34f1d94395afbf9b37ffe45547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:45:38Z,use_quota=True,user_id='2ee322bec82742f09c7f92a406b33ae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1fbe9a9f-db8f-4046-b71c-9ca83c8b33f5 tempest-VolumesListTestJSON-997281456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29b2bb09-e587-4104-a0b1-34eaf570d627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1fbe9a9f-db8f-4046-b71c-9ca83c8b33f5 tempest-VolumesListTestJSON-997281456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29b2bb09-e587-4104-a0b1-34eaf570d627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1fbe9a9f-db8f-4046-b71c-9ca83c8b33f5 tempest-VolumesListTestJSON-997281456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (320adb16-612b-4b6e-971f-562be222c4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1fbe9a9f-db8f-4046-b71c-9ca83c8b33f5 tempest-VolumesListTestJSON-997281456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (320adb16-612b-4b6e-971f-562be222c4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4554a388-e778-471c-bd58-51a3e8ddc979', 'volume_name': 'volume-4554a388-e778-471c-bd58-51a3e8ddc979', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1fbe9a9f-db8f-4046-b71c-9ca83c8b33f5 tempest-VolumesListTestJSON-997281456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (819f15cd-acd5-47fb-939a-ab1aaa3c7832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1fbe9a9f-db8f-4046-b71c-9ca83c8b33f5 tempest-VolumesListTestJSON-997281456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (819f15cd-acd5-47fb-939a-ab1aaa3c7832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1fbe9a9f-db8f-4046-b71c-9ca83c8b33f5 tempest-VolumesListTestJSON-997281456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74a03352-0b8b-40a3-a847-01fbc6b782a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:38 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-1fbe9a9f-db8f-4046-b71c-9ca83c8b33f5 tempest-VolumesListTestJSON-997281456 None] Volume 4554a388-e778-471c-bd58-51a3e8ddc979: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4554a388-e778-471c-bd58-51a3e8ddc979', 'volume_size': 1} Jul 28 10:45:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1fbe9a9f-db8f-4046-b71c-9ca83c8b33f5 tempest-VolumesListTestJSON-997281456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:38 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-7887dd07-ff9a-44cf-a293-b7e0702109be req-cb6c8026-ed74-4eb8-ae11-d5785facf8a8 tempest-VolumesSnapshotsTestJSON-1887860676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b" returned: 0 in 0.310s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:38 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [req-7887dd07-ff9a-44cf-a293-b7e0702109be req-cb6c8026-ed74-4eb8-ae11-d5785facf8a8 tempest-VolumesSnapshotsTestJSON-1887860676 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:45:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-7887dd07-ff9a-44cf-a293-b7e0702109be req-cb6c8026-ed74-4eb8-ae11-d5785facf8a8 tempest-VolumesSnapshotsTestJSON-1887860676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1fbe9a9f-db8f-4046-b71c-9ca83c8b33f5 tempest-VolumesListTestJSON-997281456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.014s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:38 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-1fbe9a9f-db8f-4046-b71c-9ca83c8b33f5 tempest-VolumesListTestJSON-997281456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-198105112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4554a388-e778-471c-bd58-51a3e8ddc979,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9f124a34f1d94395afbf9b37ffe45547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:45:38Z,use_quota=True,user_id='2ee322bec82742f09c7f92a406b33ae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:45:38 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-1fbe9a9f-db8f-4046-b71c-9ca83c8b33f5 tempest-VolumesListTestJSON-997281456 None] Creating volume 4554a388-e778-471c-bd58-51a3e8ddc979 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:45:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1fbe9a9f-db8f-4046-b71c-9ca83c8b33f5 tempest-VolumesListTestJSON-997281456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1fbe9a9f-db8f-4046-b71c-9ca83c8b33f5 tempest-VolumesListTestJSON-997281456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:38 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-1fbe9a9f-db8f-4046-b71c-9ca83c8b33f5 tempest-VolumesListTestJSON-997281456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:45:38 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-1fbe9a9f-db8f-4046-b71c-9ca83c8b33f5 tempest-VolumesListTestJSON-997281456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:45:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1fbe9a9f-db8f-4046-b71c-9ca83c8b33f5 tempest-VolumesListTestJSON-997281456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:38 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-1fbe9a9f-db8f-4046-b71c-9ca83c8b33f5 tempest-VolumesListTestJSON-997281456 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:45:38 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-1fbe9a9f-db8f-4046-b71c-9ca83c8b33f5 tempest-VolumesListTestJSON-997281456 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:45:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1fbe9a9f-db8f-4046-b71c-9ca83c8b33f5 tempest-VolumesListTestJSON-997281456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4554a388-e778-471c-bd58-51a3e8ddc979 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-7887dd07-ff9a-44cf-a293-b7e0702109be req-cb6c8026-ed74-4eb8-ae11-d5785facf8a8 tempest-VolumesSnapshotsTestJSON-1887860676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eec53b84-cce0-4034-9c17-3051e41dd8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0b9e525-9657-4897-8d60-be3c4417595b', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:38 devstack sudo[99596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4554a388-e778-471c-bd58-51a3e8ddc979 1073741824 Jul 28 10:45:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-7887dd07-ff9a-44cf-a293-b7e0702109be req-cb6c8026-ed74-4eb8-ae11-d5785facf8a8 tempest-VolumesSnapshotsTestJSON-1887860676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b6e284b-ffcd-4972-bc1c-a9781026ddcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:38 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:38 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [req-7887dd07-ff9a-44cf-a293-b7e0702109be req-cb6c8026-ed74-4eb8-ae11-d5785facf8a8 tempest-VolumesSnapshotsTestJSON-1887860676 None] Volume volume-f0b9e525-9657-4897-8d60-be3c4417595b (f0b9e525-9657-4897-8d60-be3c4417595b): created successfully Jul 28 10:45:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-7887dd07-ff9a-44cf-a293-b7e0702109be req-cb6c8026-ed74-4eb8-ae11-d5785facf8a8 tempest-VolumesSnapshotsTestJSON-1887860676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b6e284b-ffcd-4972-bc1c-a9781026ddcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-7887dd07-ff9a-44cf-a293-b7e0702109be req-cb6c8026-ed74-4eb8-ae11-d5785facf8a8 tempest-VolumesSnapshotsTestJSON-1887860676 None] Flow 'volume_create_manager' (385d5ae0-60e4-4aff-8c01-6c4ac8636f3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:45:38 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-7887dd07-ff9a-44cf-a293-b7e0702109be req-cb6c8026-ed74-4eb8-ae11-d5785facf8a8 tempest-VolumesSnapshotsTestJSON-1887860676 None] Created volume successfully. Jul 28 10:45:38 devstack sudo[99577]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_970fcc9b-ad8a-45d3-9566-5dd36cf4b367_j689iv9idevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2d7abac5-60fa-4005-8237-8e02d2de135a" returned: 0 in 2.352s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:38 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_970fcc9b-ad8a-45d3-9566-5dd36cf4b367_j689iv9idevstack@QuobyteHD, size 112.00 MB, duration 2.35 sec, destination /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2d7abac5-60fa-4005-8237-8e02d2de135a {{(pid=88413) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 10:45:38 devstack cinder-volume[88413]: INFO cinder.image.image_utils [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Converted 112.00 MB image at 47.60 MB/s Jul 28 10:45:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2d7abac5-60fa-4005-8237-8e02d2de135a 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:38 devstack sudo[99598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2d7abac5-60fa-4005-8237-8e02d2de135a 1G Jul 28 10:45:38 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:39 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2d7abac5-60fa-4005-8237-8e02d2de135a 1G" returned: 0 in 0.349s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:39 devstack cinder-volume[88413]: DEBUG cinder.volume.volume_utils [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Downloaded image 970fcc9b-ad8a-45d3-9566-5dd36cf4b367 ((None, [{'url': 'file:///opt/stack/data/glance/images/970fcc9b-ad8a-45d3-9566-5dd36cf4b367', 'metadata': {}}])) to volume 2d7abac5-60fa-4005-8237-8e02d2de135a successfully. {{(pid=88413) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 28 10:45:39 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Temporary image 970fcc9b-ad8a-45d3-9566-5dd36cf4b367 for user 1329b3f671f64821b6353dd1ee028c46 is deleted. {{(pid=88413) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 28 10:45:39 devstack cinder-volume[88413]: DEBUG cinder.volume.volume_utils [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Marking volume 2d7abac5-60fa-4005-8237-8e02d2de135a as bootable. {{(pid=88413) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 28 10:45:39 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Copying metadata from image 970fcc9b-ad8a-45d3-9566-5dd36cf4b367 to 2d7abac5-60fa-4005-8237-8e02d2de135a. {{(pid=88413) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 28 10:45:39 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Creating volume glance metadata for volume 2d7abac5-60fa-4005-8237-8e02d2de135a backed by image 970fcc9b-ad8a-45d3-9566-5dd36cf4b367 with: {'image_id': '970fcc9b-ad8a-45d3-9566-5dd36cf4b367', 'image_name': 'tempest-scenario-img--113966144', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88413) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 28 10:45:39 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1fbe9a9f-db8f-4046-b71c-9ca83c8b33f5 tempest-VolumesListTestJSON-997281456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4554a388-e778-471c-bd58-51a3e8ddc979 1073741824" returned: 0 in 0.543s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1fbe9a9f-db8f-4046-b71c-9ca83c8b33f5 tempest-VolumesListTestJSON-997281456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4554a388-e778-471c-bd58-51a3e8ddc979 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (939dd487-6609-4661-8980-eae3fa8b9119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d7abac5-60fa-4005-8237-8e02d2de135a', 'volume_size': 1, 'image_id': '970fcc9b-ad8a-45d3-9566-5dd36cf4b367', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/970fcc9b-ad8a-45d3-9566-5dd36cf4b367', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--113966144', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '683e91271a514ff893096f5bbe6a97e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '970fcc9b-ad8a-45d3-9566-5dd36cf4b367', 'created_at': datetime.datetime(2026, 7, 28, 8, 45, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 8, 45, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/970fcc9b-ad8a-45d3-9566-5dd36cf4b367/file', 'properties': {}}, 'image_service': }' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3697ac3b-695c-4417-a87b-5a94a08dea4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:39 devstack sudo[99607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4554a388-e778-471c-bd58-51a3e8ddc979 Jul 28 10:45:39 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:39 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Volume volume-2d7abac5-60fa-4005-8237-8e02d2de135a (2d7abac5-60fa-4005-8237-8e02d2de135a): created successfully Jul 28 10:45:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3697ac3b-695c-4417-a87b-5a94a08dea4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Flow 'volume_create_manager' (7b53c245-b6a4-42f7-abe8-facc5eff90a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:45:39 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-dca13083-7476-463c-8f5a-62682bc82bcf tempest-TestInstancesWithCinderVolumes-733670174 None] Created volume successfully. Jul 28 10:45:39 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1fbe9a9f-db8f-4046-b71c-9ca83c8b33f5 tempest-VolumesListTestJSON-997281456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4554a388-e778-471c-bd58-51a3e8ddc979" returned: 0 in 0.287s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:39 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-1fbe9a9f-db8f-4046-b71c-9ca83c8b33f5 tempest-VolumesListTestJSON-997281456 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:45:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1fbe9a9f-db8f-4046-b71c-9ca83c8b33f5 tempest-VolumesListTestJSON-997281456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1fbe9a9f-db8f-4046-b71c-9ca83c8b33f5 tempest-VolumesListTestJSON-997281456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74a03352-0b8b-40a3-a847-01fbc6b782a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4554a388-e778-471c-bd58-51a3e8ddc979', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1fbe9a9f-db8f-4046-b71c-9ca83c8b33f5 tempest-VolumesListTestJSON-997281456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04b2f9ff-49d1-4de6-91e1-7bf091f134a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:39 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-1fbe9a9f-db8f-4046-b71c-9ca83c8b33f5 tempest-VolumesListTestJSON-997281456 None] Volume volume-4554a388-e778-471c-bd58-51a3e8ddc979 (4554a388-e778-471c-bd58-51a3e8ddc979): created successfully Jul 28 10:45:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1fbe9a9f-db8f-4046-b71c-9ca83c8b33f5 tempest-VolumesListTestJSON-997281456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04b2f9ff-49d1-4de6-91e1-7bf091f134a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1fbe9a9f-db8f-4046-b71c-9ca83c8b33f5 tempest-VolumesListTestJSON-997281456 None] Flow 'volume_create_manager' (c6ff40b0-4577-463b-af5a-35a13dafe1fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:45:39 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-1fbe9a9f-db8f-4046-b71c-9ca83c8b33f5 tempest-VolumesListTestJSON-997281456 None] Created volume successfully. Jul 28 10:45:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-f3a47eca-f5b8-43a4-9b20-16385f589a39 req-3686f85b-c73a-45e4-8334-b3f462d33ec7 tempest-VolumesSnapshotsTestJSON-1887860676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-f3a47eca-f5b8-43a4-9b20-16385f589a39 req-3686f85b-c73a-45e4-8334-b3f462d33ec7 tempest-VolumesSnapshotsTestJSON-1887860676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:39 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [req-f3a47eca-f5b8-43a4-9b20-16385f589a39 req-3686f85b-c73a-45e4-8334-b3f462d33ec7 tempest-VolumesSnapshotsTestJSON-1887860676 None] Creating offline snapshot fc7953ea-731d-4d94-b01a-a31ef9e7a8b3 of volume f0b9e525-9657-4897-8d60-be3c4417595b {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:45:40 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[5087e588-5bae-4dc3-86d4-20e37fd49ae7]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:45:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-f3a47eca-f5b8-43a4-9b20-16385f589a39 req-3686f85b-c73a-45e4-8334-b3f462d33ec7 tempest-VolumesSnapshotsTestJSON-1887860676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:40 devstack sudo[99611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b Jul 28 10:45:40 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:40 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-f3a47eca-f5b8-43a4-9b20-16385f589a39 req-3686f85b-c73a-45e4-8334-b3f462d33ec7 tempest-VolumesSnapshotsTestJSON-1887860676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b" returned: 0 in 0.487s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-f3a47eca-f5b8-43a4-9b20-16385f589a39 req-3686f85b-c73a-45e4-8334-b3f462d33ec7 tempest-VolumesSnapshotsTestJSON-1887860676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b.fc7953ea-731d-4d94-b01a-a31ef9e7a8b3 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:40 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b.fc7953ea-731d-4d94-b01a-a31ef9e7a8b3 1G Jul 28 10:45:40 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:41 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-f3a47eca-f5b8-43a4-9b20-16385f589a39 req-3686f85b-c73a-45e4-8334-b3f462d33ec7 tempest-VolumesSnapshotsTestJSON-1887860676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b.fc7953ea-731d-4d94-b01a-a31ef9e7a8b3 1G" returned: 0 in 0.639s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-f3a47eca-f5b8-43a4-9b20-16385f589a39 req-3686f85b-c73a-45e4-8334-b3f462d33ec7 tempest-VolumesSnapshotsTestJSON-1887860676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0b9e525-9657-4897-8d60-be3c4417595b -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b.fc7953ea-731d-4d94-b01a-a31ef9e7a8b3 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:41 devstack sudo[99622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0b9e525-9657-4897-8d60-be3c4417595b -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b.fc7953ea-731d-4d94-b01a-a31ef9e7a8b3 Jul 28 10:45:41 devstack sudo[99622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:41 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-80e25a67-0d2a-4589-b62c-4d79a599143b tempest-VolumesListTestJSON-997281456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:45:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-80e25a67-0d2a-4589-b62c-4d79a599143b tempest-VolumesListTestJSON-997281456 None] Flow 'volume_create_manager' (47c34c71-93ff-43f6-8936-d1c2eef66955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:45:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-80e25a67-0d2a-4589-b62c-4d79a599143b tempest-VolumesListTestJSON-997281456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ee0a8e-f57d-4e67-a0f5-be99f9182c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-80e25a67-0d2a-4589-b62c-4d79a599143b tempest-VolumesListTestJSON-997281456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ee0a8e-f57d-4e67-a0f5-be99f9182c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1426153367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=850b1737-9350-4acb-b6a4-fdb86472f9f8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9f124a34f1d94395afbf9b37ffe45547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:45:41Z,use_quota=True,user_id='2ee322bec82742f09c7f92a406b33ae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-80e25a67-0d2a-4589-b62c-4d79a599143b tempest-VolumesListTestJSON-997281456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f8ea4be-46b4-48c1-a513-2e3a1c5132c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-80e25a67-0d2a-4589-b62c-4d79a599143b tempest-VolumesListTestJSON-997281456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f8ea4be-46b4-48c1-a513-2e3a1c5132c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-80e25a67-0d2a-4589-b62c-4d79a599143b tempest-VolumesListTestJSON-997281456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ebce3f7-b7d3-4d37-8c1e-13bf00cab408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-80e25a67-0d2a-4589-b62c-4d79a599143b tempest-VolumesListTestJSON-997281456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ebce3f7-b7d3-4d37-8c1e-13bf00cab408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '850b1737-9350-4acb-b6a4-fdb86472f9f8', 'volume_name': 'volume-850b1737-9350-4acb-b6a4-fdb86472f9f8', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-80e25a67-0d2a-4589-b62c-4d79a599143b tempest-VolumesListTestJSON-997281456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cec353a-91e4-42a5-a7e1-612c9af0f50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-80e25a67-0d2a-4589-b62c-4d79a599143b tempest-VolumesListTestJSON-997281456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cec353a-91e4-42a5-a7e1-612c9af0f50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-80e25a67-0d2a-4589-b62c-4d79a599143b tempest-VolumesListTestJSON-997281456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4b9ba70-7fcc-4c01-8c23-bd809e15e25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:41 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-80e25a67-0d2a-4589-b62c-4d79a599143b tempest-VolumesListTestJSON-997281456 None] Volume 850b1737-9350-4acb-b6a4-fdb86472f9f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-850b1737-9350-4acb-b6a4-fdb86472f9f8', 'volume_size': 1} Jul 28 10:45:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-80e25a67-0d2a-4589-b62c-4d79a599143b tempest-VolumesListTestJSON-997281456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:41 devstack sudo[99622]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-f3a47eca-f5b8-43a4-9b20-16385f589a39 req-3686f85b-c73a-45e4-8334-b3f462d33ec7 tempest-VolumesSnapshotsTestJSON-1887860676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0b9e525-9657-4897-8d60-be3c4417595b -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b.fc7953ea-731d-4d94-b01a-a31ef9e7a8b3" returned: 0 in 0.440s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:41 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [req-f3a47eca-f5b8-43a4-9b20-16385f589a39 req-3686f85b-c73a-45e4-8334-b3f462d33ec7 tempest-VolumesSnapshotsTestJSON-1887860676 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b.fc7953ea-731d-4d94-b01a-a31ef9e7a8b3 is being set with open permissions: ugo+rw Jul 28 10:45:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-f3a47eca-f5b8-43a4-9b20-16385f589a39 req-3686f85b-c73a-45e4-8334-b3f462d33ec7 tempest-VolumesSnapshotsTestJSON-1887860676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b.fc7953ea-731d-4d94-b01a-a31ef9e7a8b3 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:41 devstack sudo[99630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b.fc7953ea-731d-4d94-b01a-a31ef9e7a8b3 Jul 28 10:45:41 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:41 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-f3a47eca-f5b8-43a4-9b20-16385f589a39 req-3686f85b-c73a-45e4-8334-b3f462d33ec7 tempest-VolumesSnapshotsTestJSON-1887860676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b.fc7953ea-731d-4d94-b01a-a31ef9e7a8b3" returned: 0 in 0.287s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-f3a47eca-f5b8-43a4-9b20-16385f589a39 req-3686f85b-c73a-45e4-8334-b3f462d33ec7 tempest-VolumesSnapshotsTestJSON-1887860676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:41 devstack sudo[99633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b.info Jul 28 10:45:41 devstack sudo[99633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:42 devstack sudo[99633]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-f3a47eca-f5b8-43a4-9b20-16385f589a39 req-3686f85b-c73a-45e4-8334-b3f462d33ec7 tempest-VolumesSnapshotsTestJSON-1887860676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b.info" returned: 0 in 0.284s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:42 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [req-f3a47eca-f5b8-43a4-9b20-16385f589a39 req-3686f85b-c73a-45e4-8334-b3f462d33ec7 tempest-VolumesSnapshotsTestJSON-1887860676 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b.info is being set with open permissions: ugo+rw Jul 28 10:45:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-f3a47eca-f5b8-43a4-9b20-16385f589a39 req-3686f85b-c73a-45e4-8334-b3f462d33ec7 tempest-VolumesSnapshotsTestJSON-1887860676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:42 devstack sudo[99636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b.info Jul 28 10:45:42 devstack sudo[99636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:42 devstack sudo[99636]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-f3a47eca-f5b8-43a4-9b20-16385f589a39 req-3686f85b-c73a-45e4-8334-b3f462d33ec7 tempest-VolumesSnapshotsTestJSON-1887860676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b.info" returned: 0 in 0.254s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-f3a47eca-f5b8-43a4-9b20-16385f589a39 req-3686f85b-c73a-45e4-8334-b3f462d33ec7 tempest-VolumesSnapshotsTestJSON-1887860676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.524s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-80e25a67-0d2a-4589-b62c-4d79a599143b tempest-VolumesListTestJSON-997281456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.030s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:42 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-80e25a67-0d2a-4589-b62c-4d79a599143b tempest-VolumesListTestJSON-997281456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1426153367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=850b1737-9350-4acb-b6a4-fdb86472f9f8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9f124a34f1d94395afbf9b37ffe45547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:45:41Z,use_quota=True,user_id='2ee322bec82742f09c7f92a406b33ae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:45:42 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-80e25a67-0d2a-4589-b62c-4d79a599143b tempest-VolumesListTestJSON-997281456 None] Creating volume 850b1737-9350-4acb-b6a4-fdb86472f9f8 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:45:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-80e25a67-0d2a-4589-b62c-4d79a599143b tempest-VolumesListTestJSON-997281456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-80e25a67-0d2a-4589-b62c-4d79a599143b tempest-VolumesListTestJSON-997281456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:42 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-80e25a67-0d2a-4589-b62c-4d79a599143b tempest-VolumesListTestJSON-997281456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:45:42 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-80e25a67-0d2a-4589-b62c-4d79a599143b tempest-VolumesListTestJSON-997281456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:45:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-80e25a67-0d2a-4589-b62c-4d79a599143b tempest-VolumesListTestJSON-997281456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:42 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-80e25a67-0d2a-4589-b62c-4d79a599143b tempest-VolumesListTestJSON-997281456 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:45:42 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-80e25a67-0d2a-4589-b62c-4d79a599143b tempest-VolumesListTestJSON-997281456 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:45:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-80e25a67-0d2a-4589-b62c-4d79a599143b tempest-VolumesListTestJSON-997281456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-850b1737-9350-4acb-b6a4-fdb86472f9f8 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:42 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-850b1737-9350-4acb-b6a4-fdb86472f9f8 1073741824 Jul 28 10:45:42 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:42 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-f3a47eca-f5b8-43a4-9b20-16385f589a39 req-3686f85b-c73a-45e4-8334-b3f462d33ec7 tempest-VolumesSnapshotsTestJSON-1887860676 None] Create snapshot completed successfully Jul 28 10:45:43 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-80e25a67-0d2a-4589-b62c-4d79a599143b tempest-VolumesListTestJSON-997281456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-850b1737-9350-4acb-b6a4-fdb86472f9f8 1073741824" returned: 0 in 0.577s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-80e25a67-0d2a-4589-b62c-4d79a599143b tempest-VolumesListTestJSON-997281456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-850b1737-9350-4acb-b6a4-fdb86472f9f8 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:43 devstack sudo[99654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-850b1737-9350-4acb-b6a4-fdb86472f9f8 Jul 28 10:45:43 devstack sudo[99654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-2f1abb74-1ee4-40a0-96e2-a2f41d5b22ee req-eb5b4d70-84ef-4f32-874f-91b44243dc66 tempest-TestInstancesWithCinderVolumes-733670174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:43 devstack sudo[99654]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-80e25a67-0d2a-4589-b62c-4d79a599143b tempest-VolumesListTestJSON-997281456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-850b1737-9350-4acb-b6a4-fdb86472f9f8" returned: 0 in 0.436s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:43 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-80e25a67-0d2a-4589-b62c-4d79a599143b tempest-VolumesListTestJSON-997281456 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:45:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-80e25a67-0d2a-4589-b62c-4d79a599143b tempest-VolumesListTestJSON-997281456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-2f1abb74-1ee4-40a0-96e2-a2f41d5b22ee req-eb5b4d70-84ef-4f32-874f-91b44243dc66 tempest-TestInstancesWithCinderVolumes-733670174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.194s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-2f1abb74-1ee4-40a0-96e2-a2f41d5b22ee req-eb5b4d70-84ef-4f32-874f-91b44243dc66 tempest-TestInstancesWithCinderVolumes-733670174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-80e25a67-0d2a-4589-b62c-4d79a599143b tempest-VolumesListTestJSON-997281456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4b9ba70-7fcc-4c01-8c23-bd809e15e25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-850b1737-9350-4acb-b6a4-fdb86472f9f8', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-80e25a67-0d2a-4589-b62c-4d79a599143b tempest-VolumesListTestJSON-997281456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ee38f79-edb2-46bf-a070-8eee82e81439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:43 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-80e25a67-0d2a-4589-b62c-4d79a599143b tempest-VolumesListTestJSON-997281456 None] Volume volume-850b1737-9350-4acb-b6a4-fdb86472f9f8 (850b1737-9350-4acb-b6a4-fdb86472f9f8): created successfully Jul 28 10:45:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-80e25a67-0d2a-4589-b62c-4d79a599143b tempest-VolumesListTestJSON-997281456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ee38f79-edb2-46bf-a070-8eee82e81439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-80e25a67-0d2a-4589-b62c-4d79a599143b tempest-VolumesListTestJSON-997281456 None] Flow 'volume_create_manager' (47c34c71-93ff-43f6-8936-d1c2eef66955) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:45:43 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-80e25a67-0d2a-4589-b62c-4d79a599143b tempest-VolumesListTestJSON-997281456 None] Created volume successfully. Jul 28 10:45:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-2f1abb74-1ee4-40a0-96e2-a2f41d5b22ee req-eb5b4d70-84ef-4f32-874f-91b44243dc66 tempest-TestInstancesWithCinderVolumes-733670174 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7', 'name': 'volume-2d7abac5-60fa-4005-8237-8e02d2de135a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8eaa7e08-ed1a-47b1-a69b-3319ac737a90', 'enforce_multipath': True} {{(pid=88413) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 10:45:43 devstack cinder-volume[88413]: DEBUG cinder.coordination [req-e19df05b-6a26-4b90-9323-d695179eb8f0 req-a654dd24-8a01-45ab-9283-fe7f18a97064 tempest-VolumesSnapshotsTestJSON-1887860676 None] Acquiring lock "cinder-fc7953ea-731d-4d94-b01a-a31ef9e7a8b3-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:45:43 devstack cinder-volume[88413]: DEBUG cinder.coordination [req-e19df05b-6a26-4b90-9323-d695179eb8f0 req-a654dd24-8a01-45ab-9283-fe7f18a97064 tempest-VolumesSnapshotsTestJSON-1887860676 None] Lock "cinder-fc7953ea-731d-4d94-b01a-a31ef9e7a8b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:45:43 devstack cinder-volume[88413]: DEBUG cinder.coordination [req-e19df05b-6a26-4b90-9323-d695179eb8f0 req-a654dd24-8a01-45ab-9283-fe7f18a97064 tempest-VolumesSnapshotsTestJSON-1887860676 None] Acquiring lock "cinder-quobyte-f0b9e525-9657-4897-8d60-be3c4417595b" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:45:43 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-2f1abb74-1ee4-40a0-96e2-a2f41d5b22ee req-eb5b4d70-84ef-4f32-874f-91b44243dc66 tempest-TestInstancesWithCinderVolumes-733670174 None] attachment_update completed successfully. Jul 28 10:45:43 devstack cinder-volume[88413]: DEBUG cinder.coordination [req-e19df05b-6a26-4b90-9323-d695179eb8f0 req-a654dd24-8a01-45ab-9283-fe7f18a97064 tempest-VolumesSnapshotsTestJSON-1887860676 None] Lock "cinder-quobyte-f0b9e525-9657-4897-8d60-be3c4417595b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:45:43 devstack cinder-volume[88413]: DEBUG cinder.coordination [req-e19df05b-6a26-4b90-9323-d695179eb8f0 req-a654dd24-8a01-45ab-9283-fe7f18a97064 tempest-VolumesSnapshotsTestJSON-1887860676 None] Acquiring lock "cinder-quobyte-fc7953ea-731d-4d94-b01a-a31ef9e7a8b3" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:45:43 devstack cinder-volume[88413]: DEBUG cinder.coordination [req-e19df05b-6a26-4b90-9323-d695179eb8f0 req-a654dd24-8a01-45ab-9283-fe7f18a97064 tempest-VolumesSnapshotsTestJSON-1887860676 None] Lock "cinder-quobyte-fc7953ea-731d-4d94-b01a-a31ef9e7a8b3" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:45:43 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [req-e19df05b-6a26-4b90-9323-d695179eb8f0 req-a654dd24-8a01-45ab-9283-fe7f18a97064 tempest-VolumesSnapshotsTestJSON-1887860676 None] Deleting offline snapshot fc7953ea-731d-4d94-b01a-a31ef9e7a8b3 of volume f0b9e525-9657-4897-8d60-be3c4417595b {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:45:43 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [req-e19df05b-6a26-4b90-9323-d695179eb8f0 req-a654dd24-8a01-45ab-9283-fe7f18a97064 tempest-VolumesSnapshotsTestJSON-1887860676 None] snapshot_file for this snap is: volume-f0b9e525-9657-4897-8d60-be3c4417595b.fc7953ea-731d-4d94-b01a-a31ef9e7a8b3 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:45:43 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d05ab4-f9fb-406a-8592-44359d7af80e]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:45:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-e19df05b-6a26-4b90-9323-d695179eb8f0 req-a654dd24-8a01-45ab-9283-fe7f18a97064 tempest-VolumesSnapshotsTestJSON-1887860676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b.fc7953ea-731d-4d94-b01a-a31ef9e7a8b3 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:44 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b.fc7953ea-731d-4d94-b01a-a31ef9e7a8b3 Jul 28 10:45:44 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:44 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-e19df05b-6a26-4b90-9323-d695179eb8f0 req-a654dd24-8a01-45ab-9283-fe7f18a97064 tempest-VolumesSnapshotsTestJSON-1887860676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b.fc7953ea-731d-4d94-b01a-a31ef9e7a8b3" returned: 0 in 0.608s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:44 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [req-e19df05b-6a26-4b90-9323-d695179eb8f0 req-a654dd24-8a01-45ab-9283-fe7f18a97064 tempest-VolumesSnapshotsTestJSON-1887860676 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0b9e525-9657-4897-8d60-be3c4417595b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:45:44 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[086eb81b-d0d4-444c-ad01-47ccfb017eb1]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:45:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-e19df05b-6a26-4b90-9323-d695179eb8f0 req-a654dd24-8a01-45ab-9283-fe7f18a97064 tempest-VolumesSnapshotsTestJSON-1887860676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:44 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b Jul 28 10:45:44 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:45 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-e19df05b-6a26-4b90-9323-d695179eb8f0 req-a654dd24-8a01-45ab-9283-fe7f18a97064 tempest-VolumesSnapshotsTestJSON-1887860676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b" returned: 0 in 0.661s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-e19df05b-6a26-4b90-9323-d695179eb8f0 req-a654dd24-8a01-45ab-9283-fe7f18a97064 tempest-VolumesSnapshotsTestJSON-1887860676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b.fc7953ea-731d-4d94-b01a-a31ef9e7a8b3 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:45 devstack sudo[99670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b.fc7953ea-731d-4d94-b01a-a31ef9e7a8b3 Jul 28 10:45:45 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:45 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-e19df05b-6a26-4b90-9323-d695179eb8f0 req-a654dd24-8a01-45ab-9283-fe7f18a97064 tempest-VolumesSnapshotsTestJSON-1887860676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b.fc7953ea-731d-4d94-b01a-a31ef9e7a8b3" returned: 0 in 0.438s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-e19df05b-6a26-4b90-9323-d695179eb8f0 req-a654dd24-8a01-45ab-9283-fe7f18a97064 tempest-VolumesSnapshotsTestJSON-1887860676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b.fc7953ea-731d-4d94-b01a-a31ef9e7a8b3 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:45 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b.fc7953ea-731d-4d94-b01a-a31ef9e7a8b3 Jul 28 10:45:45 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:46 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-e19df05b-6a26-4b90-9323-d695179eb8f0 req-a654dd24-8a01-45ab-9283-fe7f18a97064 tempest-VolumesSnapshotsTestJSON-1887860676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b.fc7953ea-731d-4d94-b01a-a31ef9e7a8b3" returned: 0 in 0.396s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:46 devstack cinder-volume[88413]: DEBUG cinder.coordination [req-e19df05b-6a26-4b90-9323-d695179eb8f0 req-a654dd24-8a01-45ab-9283-fe7f18a97064 tempest-VolumesSnapshotsTestJSON-1887860676 None] Lock "cinder-quobyte-fc7953ea-731d-4d94-b01a-a31ef9e7a8b3" released by "_delete_snapshot" :: held 2.318s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:45:46 devstack cinder-volume[88413]: DEBUG cinder.coordination [req-e19df05b-6a26-4b90-9323-d695179eb8f0 req-a654dd24-8a01-45ab-9283-fe7f18a97064 tempest-VolumesSnapshotsTestJSON-1887860676 None] Lock "cinder-quobyte-f0b9e525-9657-4897-8d60-be3c4417595b" released by "delete_snapshot" :: held 2.366s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:45:46 devstack cinder-volume[88413]: DEBUG cinder.quota [req-e19df05b-6a26-4b90-9323-d695179eb8f0 req-a654dd24-8a01-45ab-9283-fe7f18a97064 tempest-VolumesSnapshotsTestJSON-1887860676 None] Created reservations ['77a153e3-464a-4a3d-a3bd-b9d295c3b3af', '41d281c2-ccf5-4511-804f-75c9bd956c34', '86da0188-5fd6-47ef-8eaa-62507ce79fdc', '2c747477-7903-47bc-98cb-32022aefb7cf'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:45:46 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-e19df05b-6a26-4b90-9323-d695179eb8f0 req-a654dd24-8a01-45ab-9283-fe7f18a97064 tempest-VolumesSnapshotsTestJSON-1887860676 None] Delete snapshot completed successfully. Jul 28 10:45:46 devstack cinder-volume[88413]: DEBUG cinder.coordination [req-e19df05b-6a26-4b90-9323-d695179eb8f0 req-a654dd24-8a01-45ab-9283-fe7f18a97064 tempest-VolumesSnapshotsTestJSON-1887860676 None] Lock "cinder-fc7953ea-731d-4d94-b01a-a31ef9e7a8b3-delete_snapshot" released by "delete_snapshot" :: held 2.664s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:45:47 devstack cinder-volume[88413]: DEBUG cinder.coordination [req-cf239e5a-7703-45fb-b60d-4720c68f9768 req-be13e9b6-f779-4ab8-be36-c67ab56346f5 tempest-VolumesSnapshotsTestJSON-1887860676 None] Acquiring lock "cinder-f0b9e525-9657-4897-8d60-be3c4417595b-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:45:47 devstack cinder-volume[88413]: DEBUG cinder.coordination [req-cf239e5a-7703-45fb-b60d-4720c68f9768 req-be13e9b6-f779-4ab8-be36-c67ab56346f5 tempest-VolumesSnapshotsTestJSON-1887860676 None] Lock "cinder-f0b9e525-9657-4897-8d60-be3c4417595b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:45:47 devstack cinder-volume[88413]: DEBUG cinder.coordination [req-cf239e5a-7703-45fb-b60d-4720c68f9768 req-be13e9b6-f779-4ab8-be36-c67ab56346f5 tempest-VolumesSnapshotsTestJSON-1887860676 None] Acquiring lock "cinder-quobyte-f0b9e525-9657-4897-8d60-be3c4417595b" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:45:47 devstack cinder-volume[88413]: DEBUG cinder.coordination [req-cf239e5a-7703-45fb-b60d-4720c68f9768 req-be13e9b6-f779-4ab8-be36-c67ab56346f5 tempest-VolumesSnapshotsTestJSON-1887860676 None] Lock "cinder-quobyte-f0b9e525-9657-4897-8d60-be3c4417595b" acquired by "delete_volume" :: waited 0.026s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:45:47 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee71a2e4-ce6a-45e2-815f-fbe99864eeaa]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:45:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-cf239e5a-7703-45fb-b60d-4720c68f9768 req-be13e9b6-f779-4ab8-be36-c67ab56346f5 tempest-VolumesSnapshotsTestJSON-1887860676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:47 devstack sudo[100112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b Jul 28 10:45:47 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:47 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-cf239e5a-7703-45fb-b60d-4720c68f9768 req-be13e9b6-f779-4ab8-be36-c67ab56346f5 tempest-VolumesSnapshotsTestJSON-1887860676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b" returned: 0 in 0.453s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-cf239e5a-7703-45fb-b60d-4720c68f9768 req-be13e9b6-f779-4ab8-be36-c67ab56346f5 tempest-VolumesSnapshotsTestJSON-1887860676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:47 devstack sudo[100126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b Jul 28 10:45:47 devstack sudo[100126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:48 devstack sudo[100126]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-cf239e5a-7703-45fb-b60d-4720c68f9768 req-be13e9b6-f779-4ab8-be36-c67ab56346f5 tempest-VolumesSnapshotsTestJSON-1887860676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f0b9e525-9657-4897-8d60-be3c4417595b" returned: 0 in 0.356s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-64933476-f139-4672-92da-e6ceedd37865 tempest-VolumesListTestJSON-997281456 None] Acquiring lock "cinder-850b1737-9350-4acb-b6a4-fdb86472f9f8-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:45:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [req-cf239e5a-7703-45fb-b60d-4720c68f9768 req-be13e9b6-f779-4ab8-be36-c67ab56346f5 tempest-VolumesSnapshotsTestJSON-1887860676 None] Lock "cinder-quobyte-f0b9e525-9657-4897-8d60-be3c4417595b" released by "delete_volume" :: held 0.960s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:45:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-64933476-f139-4672-92da-e6ceedd37865 tempest-VolumesListTestJSON-997281456 None] Lock "cinder-850b1737-9350-4acb-b6a4-fdb86472f9f8-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:45:48 devstack cinder-volume[88413]: DEBUG cinder.quota [req-cf239e5a-7703-45fb-b60d-4720c68f9768 req-be13e9b6-f779-4ab8-be36-c67ab56346f5 tempest-VolumesSnapshotsTestJSON-1887860676 None] Created reservations ['1878d89e-69eb-4c86-87cc-f2b3cadc6e82', '61dbb12e-220e-4fb8-a8e8-0344aa5dfc25', '891b41d7-d54e-4b85-9589-6db409809273', '3d649f32-504d-43ff-93d6-c29aa7c59f88'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:45:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-64933476-f139-4672-92da-e6ceedd37865 tempest-VolumesListTestJSON-997281456 None] Acquiring lock "cinder-quobyte-850b1737-9350-4acb-b6a4-fdb86472f9f8" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:45:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-64933476-f139-4672-92da-e6ceedd37865 tempest-VolumesListTestJSON-997281456 None] Lock "cinder-quobyte-850b1737-9350-4acb-b6a4-fdb86472f9f8" acquired by "delete_volume" :: waited 0.029s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:45:48 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c3e3de-1d46-4833-ba0f-5dc4cccb2177]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:45:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-64933476-f139-4672-92da-e6ceedd37865 tempest-VolumesListTestJSON-997281456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-850b1737-9350-4acb-b6a4-fdb86472f9f8 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-cf239e5a-7703-45fb-b60d-4720c68f9768 req-be13e9b6-f779-4ab8-be36-c67ab56346f5 tempest-VolumesSnapshotsTestJSON-1887860676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-cf239e5a-7703-45fb-b60d-4720c68f9768 req-be13e9b6-f779-4ab8-be36-c67ab56346f5 tempest-VolumesSnapshotsTestJSON-1887860676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:48 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [req-cf239e5a-7703-45fb-b60d-4720c68f9768 req-be13e9b6-f779-4ab8-be36-c67ab56346f5 tempest-VolumesSnapshotsTestJSON-1887860676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:45:48 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [req-cf239e5a-7703-45fb-b60d-4720c68f9768 req-be13e9b6-f779-4ab8-be36-c67ab56346f5 tempest-VolumesSnapshotsTestJSON-1887860676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:45:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-cf239e5a-7703-45fb-b60d-4720c68f9768 req-be13e9b6-f779-4ab8-be36-c67ab56346f5 tempest-VolumesSnapshotsTestJSON-1887860676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-cf239e5a-7703-45fb-b60d-4720c68f9768 req-be13e9b6-f779-4ab8-be36-c67ab56346f5 tempest-VolumesSnapshotsTestJSON-1887860676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:48 devstack sudo[100145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:45:48 devstack sudo[100145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:48 devstack sudo[100144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-850b1737-9350-4acb-b6a4-fdb86472f9f8 Jul 28 10:45:48 devstack sudo[100144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:48 devstack sudo[100145]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-cf239e5a-7703-45fb-b60d-4720c68f9768 req-be13e9b6-f779-4ab8-be36-c67ab56346f5 tempest-VolumesSnapshotsTestJSON-1887860676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.282s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:48 devstack cinder-volume[88413]: DEBUG cinder.manager [req-cf239e5a-7703-45fb-b60d-4720c68f9768 req-be13e9b6-f779-4ab8-be36-c67ab56346f5 tempest-VolumesSnapshotsTestJSON-1887860676 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:45:48 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-cf239e5a-7703-45fb-b60d-4720c68f9768 req-be13e9b6-f779-4ab8-be36-c67ab56346f5 tempest-VolumesSnapshotsTestJSON-1887860676 None] Deleted volume successfully. Jul 28 10:45:49 devstack cinder-volume[88413]: DEBUG cinder.coordination [req-cf239e5a-7703-45fb-b60d-4720c68f9768 req-be13e9b6-f779-4ab8-be36-c67ab56346f5 tempest-VolumesSnapshotsTestJSON-1887860676 None] Lock "cinder-f0b9e525-9657-4897-8d60-be3c4417595b-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:45:49 devstack sudo[100144]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-64933476-f139-4672-92da-e6ceedd37865 tempest-VolumesListTestJSON-997281456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-850b1737-9350-4acb-b6a4-fdb86472f9f8" returned: 0 in 0.489s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-64933476-f139-4672-92da-e6ceedd37865 tempest-VolumesListTestJSON-997281456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-850b1737-9350-4acb-b6a4-fdb86472f9f8 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:49 devstack sudo[100153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-850b1737-9350-4acb-b6a4-fdb86472f9f8 Jul 28 10:45:49 devstack sudo[100153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:49 devstack sudo[100153]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-64933476-f139-4672-92da-e6ceedd37865 tempest-VolumesListTestJSON-997281456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-850b1737-9350-4acb-b6a4-fdb86472f9f8" returned: 0 in 0.273s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:49 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-64933476-f139-4672-92da-e6ceedd37865 tempest-VolumesListTestJSON-997281456 None] Lock "cinder-quobyte-850b1737-9350-4acb-b6a4-fdb86472f9f8" released by "delete_volume" :: held 0.832s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:45:49 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-64933476-f139-4672-92da-e6ceedd37865 tempest-VolumesListTestJSON-997281456 None] Created reservations ['b888a469-02ab-4404-ba45-b1a14a30ca0f', '1b885e60-06f4-45e8-bc47-4dcdddf7dbc2', '72a182bd-b91d-4346-8563-15392e97d38e', 'b4da8dd9-4575-46f7-a3eb-90e88e5b2692'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:45:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-64933476-f139-4672-92da-e6ceedd37865 tempest-VolumesListTestJSON-997281456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-64933476-f139-4672-92da-e6ceedd37865 tempest-VolumesListTestJSON-997281456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:49 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-64933476-f139-4672-92da-e6ceedd37865 tempest-VolumesListTestJSON-997281456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:45:49 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-64933476-f139-4672-92da-e6ceedd37865 tempest-VolumesListTestJSON-997281456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:45:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-64933476-f139-4672-92da-e6ceedd37865 tempest-VolumesListTestJSON-997281456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-64933476-f139-4672-92da-e6ceedd37865 tempest-VolumesListTestJSON-997281456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:49 devstack sudo[100156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:45:49 devstack sudo[100156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:49 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-593c18ba-3e2d-413e-8864-1c59b4df6029 tempest-VolumesListTestJSON-997281456 None] Acquiring lock "cinder-4554a388-e778-471c-bd58-51a3e8ddc979-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:45:49 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-593c18ba-3e2d-413e-8864-1c59b4df6029 tempest-VolumesListTestJSON-997281456 None] Lock "cinder-4554a388-e778-471c-bd58-51a3e8ddc979-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:45:49 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-593c18ba-3e2d-413e-8864-1c59b4df6029 tempest-VolumesListTestJSON-997281456 None] Acquiring lock "cinder-quobyte-4554a388-e778-471c-bd58-51a3e8ddc979" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:45:49 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-593c18ba-3e2d-413e-8864-1c59b4df6029 tempest-VolumesListTestJSON-997281456 None] Lock "cinder-quobyte-4554a388-e778-471c-bd58-51a3e8ddc979" acquired by "delete_volume" :: waited 0.025s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:45:49 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78f785a-dac8-45c0-b5b5-280b58094256]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:45:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-593c18ba-3e2d-413e-8864-1c59b4df6029 tempest-VolumesListTestJSON-997281456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4554a388-e778-471c-bd58-51a3e8ddc979 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:50 devstack sudo[100156]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-64933476-f139-4672-92da-e6ceedd37865 tempest-VolumesListTestJSON-997281456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.487s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:50 devstack sudo[100159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4554a388-e778-471c-bd58-51a3e8ddc979 Jul 28 10:45:50 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-64933476-f139-4672-92da-e6ceedd37865 tempest-VolumesListTestJSON-997281456 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:45:50 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:50 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-64933476-f139-4672-92da-e6ceedd37865 tempest-VolumesListTestJSON-997281456 None] Deleted volume successfully. Jul 28 10:45:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-64933476-f139-4672-92da-e6ceedd37865 tempest-VolumesListTestJSON-997281456 None] Lock "cinder-850b1737-9350-4acb-b6a4-fdb86472f9f8-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:45:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-593c18ba-3e2d-413e-8864-1c59b4df6029 tempest-VolumesListTestJSON-997281456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4554a388-e778-471c-bd58-51a3e8ddc979" returned: 0 in 0.541s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:50 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-593c18ba-3e2d-413e-8864-1c59b4df6029 tempest-VolumesListTestJSON-997281456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4554a388-e778-471c-bd58-51a3e8ddc979 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:50 devstack sudo[100168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4554a388-e778-471c-bd58-51a3e8ddc979 Jul 28 10:45:50 devstack sudo[100168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:50 devstack sudo[100168]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-593c18ba-3e2d-413e-8864-1c59b4df6029 tempest-VolumesListTestJSON-997281456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4554a388-e778-471c-bd58-51a3e8ddc979" returned: 0 in 0.496s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-593c18ba-3e2d-413e-8864-1c59b4df6029 tempest-VolumesListTestJSON-997281456 None] Lock "cinder-quobyte-4554a388-e778-471c-bd58-51a3e8ddc979" released by "delete_volume" :: held 1.127s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:45:51 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-593c18ba-3e2d-413e-8864-1c59b4df6029 tempest-VolumesListTestJSON-997281456 None] Created reservations ['b2504b86-90a5-4c49-85c5-fe1a9b08eb2f', '1d2a19e9-79cd-4525-b178-55f28a1846f3', 'f5b1d77c-c69c-4e8c-83b7-89fec80f87fc', 'c4308d6e-a50e-4054-835b-83e6b4ab557b'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:45:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-593c18ba-3e2d-413e-8864-1c59b4df6029 tempest-VolumesListTestJSON-997281456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-593c18ba-3e2d-413e-8864-1c59b4df6029 tempest-VolumesListTestJSON-997281456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:51 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-593c18ba-3e2d-413e-8864-1c59b4df6029 tempest-VolumesListTestJSON-997281456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:45:51 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-593c18ba-3e2d-413e-8864-1c59b4df6029 tempest-VolumesListTestJSON-997281456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:45:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-593c18ba-3e2d-413e-8864-1c59b4df6029 tempest-VolumesListTestJSON-997281456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-593c18ba-3e2d-413e-8864-1c59b4df6029 tempest-VolumesListTestJSON-997281456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:51 devstack sudo[100171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:45:51 devstack sudo[100171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:51 devstack sudo[100171]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-593c18ba-3e2d-413e-8864-1c59b4df6029 tempest-VolumesListTestJSON-997281456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.317s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:51 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-593c18ba-3e2d-413e-8864-1c59b4df6029 tempest-VolumesListTestJSON-997281456 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:45:51 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-593c18ba-3e2d-413e-8864-1c59b4df6029 tempest-VolumesListTestJSON-997281456 None] Deleted volume successfully. Jul 28 10:45:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-593c18ba-3e2d-413e-8864-1c59b4df6029 tempest-VolumesListTestJSON-997281456 None] Lock "cinder-4554a388-e778-471c-bd58-51a3e8ddc979-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:45:52 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1c2af70e-b7cd-4681-af2e-b6dcbbfdfbf4 tempest-VolumesListTestJSON-997281456 None] Acquiring lock "cinder-154adc0b-49df-496b-932a-1e2d168ad93b-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:45:52 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1c2af70e-b7cd-4681-af2e-b6dcbbfdfbf4 tempest-VolumesListTestJSON-997281456 None] Lock "cinder-154adc0b-49df-496b-932a-1e2d168ad93b-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:45:52 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1c2af70e-b7cd-4681-af2e-b6dcbbfdfbf4 tempest-VolumesListTestJSON-997281456 None] Acquiring lock "cinder-quobyte-154adc0b-49df-496b-932a-1e2d168ad93b" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:45:52 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1c2af70e-b7cd-4681-af2e-b6dcbbfdfbf4 tempest-VolumesListTestJSON-997281456 None] Lock "cinder-quobyte-154adc0b-49df-496b-932a-1e2d168ad93b" acquired by "delete_volume" :: waited 0.018s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:45:52 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb2f84a-4586-4846-aa29-a1bb1efbfa00]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:45:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1c2af70e-b7cd-4681-af2e-b6dcbbfdfbf4 tempest-VolumesListTestJSON-997281456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-154adc0b-49df-496b-932a-1e2d168ad93b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:52 devstack sudo[100175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-154adc0b-49df-496b-932a-1e2d168ad93b Jul 28 10:45:52 devstack sudo[100175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:53 devstack sudo[100175]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1c2af70e-b7cd-4681-af2e-b6dcbbfdfbf4 tempest-VolumesListTestJSON-997281456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-154adc0b-49df-496b-932a-1e2d168ad93b" returned: 0 in 0.760s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1c2af70e-b7cd-4681-af2e-b6dcbbfdfbf4 tempest-VolumesListTestJSON-997281456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-154adc0b-49df-496b-932a-1e2d168ad93b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:53 devstack sudo[100180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-154adc0b-49df-496b-932a-1e2d168ad93b Jul 28 10:45:53 devstack sudo[100180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:54 devstack sudo[100180]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1c2af70e-b7cd-4681-af2e-b6dcbbfdfbf4 tempest-VolumesListTestJSON-997281456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-154adc0b-49df-496b-932a-1e2d168ad93b" returned: 0 in 0.684s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:54 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1c2af70e-b7cd-4681-af2e-b6dcbbfdfbf4 tempest-VolumesListTestJSON-997281456 None] Lock "cinder-quobyte-154adc0b-49df-496b-932a-1e2d168ad93b" released by "delete_volume" :: held 1.543s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:45:54 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-1c2af70e-b7cd-4681-af2e-b6dcbbfdfbf4 tempest-VolumesListTestJSON-997281456 None] Created reservations ['ba3c4578-6a21-4a29-bd78-31f325b7cf66', 'd0be2c78-92f8-4a6a-bc2a-9015fa325692', '7b22547f-3a7d-4077-9fde-0c948442782e', '482a8a69-8475-44bf-be8b-bfdf7579a6f2'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:45:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1c2af70e-b7cd-4681-af2e-b6dcbbfdfbf4 tempest-VolumesListTestJSON-997281456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1c2af70e-b7cd-4681-af2e-b6dcbbfdfbf4 tempest-VolumesListTestJSON-997281456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:54 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-1c2af70e-b7cd-4681-af2e-b6dcbbfdfbf4 tempest-VolumesListTestJSON-997281456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:45:54 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-1c2af70e-b7cd-4681-af2e-b6dcbbfdfbf4 tempest-VolumesListTestJSON-997281456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:45:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1c2af70e-b7cd-4681-af2e-b6dcbbfdfbf4 tempest-VolumesListTestJSON-997281456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1c2af70e-b7cd-4681-af2e-b6dcbbfdfbf4 tempest-VolumesListTestJSON-997281456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:54 devstack sudo[100183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:45:54 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:54 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1c2af70e-b7cd-4681-af2e-b6dcbbfdfbf4 tempest-VolumesListTestJSON-997281456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.591s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:54 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-1c2af70e-b7cd-4681-af2e-b6dcbbfdfbf4 tempest-VolumesListTestJSON-997281456 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:45:55 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-1c2af70e-b7cd-4681-af2e-b6dcbbfdfbf4 tempest-VolumesListTestJSON-997281456 None] Deleted volume successfully. Jul 28 10:45:55 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1c2af70e-b7cd-4681-af2e-b6dcbbfdfbf4 tempest-VolumesListTestJSON-997281456 None] Lock "cinder-154adc0b-49df-496b-932a-1e2d168ad93b-delete_volume" released by "delete_volume" :: held 2.641s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:45:56 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-604550f3-922d-4bce-8652-0708f2fe8cb3 tempest-VolumesSnapshotTestJSON-50191109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:45:56 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-604550f3-922d-4bce-8652-0708f2fe8cb3 tempest-VolumesSnapshotTestJSON-50191109 None] Flow 'volume_create_manager' (c2a68924-a75e-49a4-8880-a4c5a70e6168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:45:56 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-604550f3-922d-4bce-8652-0708f2fe8cb3 tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f75e7bd-ff48-4cee-ad69-11b369a876da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:56 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-604550f3-922d-4bce-8652-0708f2fe8cb3 tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f75e7bd-ff48-4cee-ad69-11b369a876da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:45:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-426264575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeef515e-ee70-42e3-ad35-7b8edc9b2d6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db4b40b8f5c4400d8bd937bc704b3be4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:45:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:45:56Z,use_quota=True,user_id='cfa42265cd99411b822baac6abab4ea7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:56 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-604550f3-922d-4bce-8652-0708f2fe8cb3 tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cf6f32b-5df5-49f3-82d3-7d48ef57d774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:56 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-604550f3-922d-4bce-8652-0708f2fe8cb3 tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cf6f32b-5df5-49f3-82d3-7d48ef57d774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:56 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-604550f3-922d-4bce-8652-0708f2fe8cb3 tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57e5d739-f905-4c23-9e9e-97eaf681db86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:56 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-604550f3-922d-4bce-8652-0708f2fe8cb3 tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57e5d739-f905-4c23-9e9e-97eaf681db86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeef515e-ee70-42e3-ad35-7b8edc9b2d6e', 'volume_name': 'volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:56 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-604550f3-922d-4bce-8652-0708f2fe8cb3 tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c378333-8ebd-47f9-a163-ed7534eb2a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:56 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-604550f3-922d-4bce-8652-0708f2fe8cb3 tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c378333-8ebd-47f9-a163-ed7534eb2a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:56 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-604550f3-922d-4bce-8652-0708f2fe8cb3 tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44417f77-d55d-4cd8-957f-7cb272d537e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:56 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-604550f3-922d-4bce-8652-0708f2fe8cb3 tempest-VolumesSnapshotTestJSON-50191109 None] Volume aeef515e-ee70-42e3-ad35-7b8edc9b2d6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e', 'volume_size': 1} Jul 28 10:45:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-604550f3-922d-4bce-8652-0708f2fe8cb3 tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-604550f3-922d-4bce-8652-0708f2fe8cb3 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:56 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-604550f3-922d-4bce-8652-0708f2fe8cb3 tempest-VolumesSnapshotTestJSON-50191109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:45:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-426264575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeef515e-ee70-42e3-ad35-7b8edc9b2d6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db4b40b8f5c4400d8bd937bc704b3be4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:45:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:45:56Z,use_quota=True,user_id='cfa42265cd99411b822baac6abab4ea7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:45:56 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-604550f3-922d-4bce-8652-0708f2fe8cb3 tempest-VolumesSnapshotTestJSON-50191109 None] Creating volume aeef515e-ee70-42e3-ad35-7b8edc9b2d6e {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:45:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-604550f3-922d-4bce-8652-0708f2fe8cb3 tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-604550f3-922d-4bce-8652-0708f2fe8cb3 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:56 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-604550f3-922d-4bce-8652-0708f2fe8cb3 tempest-VolumesSnapshotTestJSON-50191109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:45:56 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-604550f3-922d-4bce-8652-0708f2fe8cb3 tempest-VolumesSnapshotTestJSON-50191109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:45:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-604550f3-922d-4bce-8652-0708f2fe8cb3 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:56 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-604550f3-922d-4bce-8652-0708f2fe8cb3 tempest-VolumesSnapshotTestJSON-50191109 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:45:56 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-604550f3-922d-4bce-8652-0708f2fe8cb3 tempest-VolumesSnapshotTestJSON-50191109 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:45:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-604550f3-922d-4bce-8652-0708f2fe8cb3 tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:56 devstack sudo[100186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e 1073741824 Jul 28 10:45:56 devstack sudo[100186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:56 devstack sudo[100186]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:56 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-13430334-c90a-4fc6-a1d7-1da52f1225d6 tempest-BackendsCapabilitiesAdminTestsJSON-571806727 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577056884766, 'free_capacity_gb': 1775.7577056884766, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88413) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 28 10:45:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-604550f3-922d-4bce-8652-0708f2fe8cb3 tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e 1073741824" returned: 0 in 0.751s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-604550f3-922d-4bce-8652-0708f2fe8cb3 tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8547d621-c6c8-47c8-a5c6-487cdc3b8573 tempest-BackendsCapabilitiesAdminTestsJSON-571806727 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577056884766, 'free_capacity_gb': 1775.7577056884766, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88413) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 28 10:45:57 devstack sudo[100194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e Jul 28 10:45:57 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:57 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-604550f3-922d-4bce-8652-0708f2fe8cb3 tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e" returned: 0 in 0.356s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:57 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-604550f3-922d-4bce-8652-0708f2fe8cb3 tempest-VolumesSnapshotTestJSON-50191109 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:45:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-604550f3-922d-4bce-8652-0708f2fe8cb3 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:45:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-604550f3-922d-4bce-8652-0708f2fe8cb3 tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44417f77-d55d-4cd8-957f-7cb272d537e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-604550f3-922d-4bce-8652-0708f2fe8cb3 tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62282eee-bc6b-49a8-8dfe-6409e44f497a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:45:57 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-604550f3-922d-4bce-8652-0708f2fe8cb3 tempest-VolumesSnapshotTestJSON-50191109 None] Volume volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e (aeef515e-ee70-42e3-ad35-7b8edc9b2d6e): created successfully Jul 28 10:45:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-604550f3-922d-4bce-8652-0708f2fe8cb3 tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62282eee-bc6b-49a8-8dfe-6409e44f497a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:45:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-604550f3-922d-4bce-8652-0708f2fe8cb3 tempest-VolumesSnapshotTestJSON-50191109 None] Flow 'volume_create_manager' (c2a68924-a75e-49a4-8880-a4c5a70e6168) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:45:57 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-604550f3-922d-4bce-8652-0708f2fe8cb3 tempest-VolumesSnapshotTestJSON-50191109 None] Created volume successfully. Jul 28 10:45:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-46f9c8b8-c587-490e-ac05-c7bcc31023d3 tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:45:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-46f9c8b8-c587-490e-ac05-c7bcc31023d3 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:45:58 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-46f9c8b8-c587-490e-ac05-c7bcc31023d3 tempest-VolumesSnapshotTestJSON-50191109 None] Creating offline snapshot bfc44713-97cd-4834-92bc-9a9d77b9c57a of volume aeef515e-ee70-42e3-ad35-7b8edc9b2d6e {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:45:58 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e44e84e-6709-4a8d-b38a-f4eb088cabda]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:45:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-46f9c8b8-c587-490e-ac05-c7bcc31023d3 tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:59 devstack sudo[100198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e Jul 28 10:45:59 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:45:59 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root Jul 28 10:45:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-46f9c8b8-c587-490e-ac05-c7bcc31023d3 tempest-VolumesSnapshotTestJSON-50191109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e" returned: 0 in 0.745s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:45:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-46f9c8b8-c587-490e-ac05-c7bcc31023d3 tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e.bfc44713-97cd-4834-92bc-9a9d77b9c57a 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:45:59 devstack sudo[100204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e.bfc44713-97cd-4834-92bc-9a9d77b9c57a 1G Jul 28 10:45:59 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:00 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-46f9c8b8-c587-490e-ac05-c7bcc31023d3 tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e.bfc44713-97cd-4834-92bc-9a9d77b9c57a 1G" returned: 0 in 0.866s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-46f9c8b8-c587-490e-ac05-c7bcc31023d3 tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e.bfc44713-97cd-4834-92bc-9a9d77b9c57a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:00 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e.bfc44713-97cd-4834-92bc-9a9d77b9c57a Jul 28 10:46:00 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:01 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-46f9c8b8-c587-490e-ac05-c7bcc31023d3 tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e.bfc44713-97cd-4834-92bc-9a9d77b9c57a" returned: 0 in 0.763s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:01 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-46f9c8b8-c587-490e-ac05-c7bcc31023d3 tempest-VolumesSnapshotTestJSON-50191109 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e.bfc44713-97cd-4834-92bc-9a9d77b9c57a is being set with open permissions: ugo+rw Jul 28 10:46:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-46f9c8b8-c587-490e-ac05-c7bcc31023d3 tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e.bfc44713-97cd-4834-92bc-9a9d77b9c57a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:01 devstack sudo[100216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e.bfc44713-97cd-4834-92bc-9a9d77b9c57a Jul 28 10:46:01 devstack sudo[100216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:01 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-00bd7cca-2751-46c2-bd1b-c11d426f83c6 tempest-CreateVolumesFromImageTest-1219366183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:46:01 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-00bd7cca-2751-46c2-bd1b-c11d426f83c6 tempest-CreateVolumesFromImageTest-1219366183 None] Flow 'volume_create_manager' (9fac023c-d3a4-453b-85c3-70c813650309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:46:01 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-00bd7cca-2751-46c2-bd1b-c11d426f83c6 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a352bf-157f-49c6-8cb2-230cbf91e7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:01 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-00bd7cca-2751-46c2-bd1b-c11d426f83c6 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a352bf-157f-49c6-8cb2-230cbf91e7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1628649006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01661c99-fc9d-41d3-af7a-ed32ceba0a07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d622e6f232a42e08e15184de9dcdaac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:46:01Z,use_quota=True,user_id='36cf7e3492734ba69f56af4ac5626520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:01 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-00bd7cca-2751-46c2-bd1b-c11d426f83c6 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f88d0a-c1c8-4053-b45d-bf46d6d751cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:01 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-00bd7cca-2751-46c2-bd1b-c11d426f83c6 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f88d0a-c1c8-4053-b45d-bf46d6d751cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:01 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-00bd7cca-2751-46c2-bd1b-c11d426f83c6 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ee09cad-38cc-4bbd-9103-6577193ad617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:01 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-00bd7cca-2751-46c2-bd1b-c11d426f83c6 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ee09cad-38cc-4bbd-9103-6577193ad617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01661c99-fc9d-41d3-af7a-ed32ceba0a07', 'volume_name': 'volume-01661c99-fc9d-41d3-af7a-ed32ceba0a07', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:01 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-00bd7cca-2751-46c2-bd1b-c11d426f83c6 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18969597-7176-4f7d-b726-4327ee93f14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:01 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-00bd7cca-2751-46c2-bd1b-c11d426f83c6 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18969597-7176-4f7d-b726-4327ee93f14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:01 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-00bd7cca-2751-46c2-bd1b-c11d426f83c6 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91dbf003-c773-48ad-9346-d7ed9a8111d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:01 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-00bd7cca-2751-46c2-bd1b-c11d426f83c6 tempest-CreateVolumesFromImageTest-1219366183 None] Volume 01661c99-fc9d-41d3-af7a-ed32ceba0a07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01661c99-fc9d-41d3-af7a-ed32ceba0a07', 'volume_size': 1} Jul 28 10:46:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-00bd7cca-2751-46c2-bd1b-c11d426f83c6 tempest-CreateVolumesFromImageTest-1219366183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:01 devstack sudo[100216]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-46f9c8b8-c587-490e-ac05-c7bcc31023d3 tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e.bfc44713-97cd-4834-92bc-9a9d77b9c57a" returned: 0 in 0.544s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-46f9c8b8-c587-490e-ac05-c7bcc31023d3 tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:01 devstack sudo[100219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e.info Jul 28 10:46:01 devstack sudo[100219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:02 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d3fb3df-84ed-4fb6-a110-99513e345516 tempest-CreateVolumesFromImageTest-1219366183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:46:02 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5d3fb3df-84ed-4fb6-a110-99513e345516 tempest-CreateVolumesFromImageTest-1219366183 None] Flow 'volume_create_manager' (43fdcb68-0a89-4322-9131-a5af1a200670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:46:02 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5d3fb3df-84ed-4fb6-a110-99513e345516 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f46f865e-cfdd-412b-9ee9-404d6e7f8bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:02 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5d3fb3df-84ed-4fb6-a110-99513e345516 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f46f865e-cfdd-412b-9ee9-404d6e7f8bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-573741728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0a927d4-0df4-449a-a804-9732782e62b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d622e6f232a42e08e15184de9dcdaac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:46:02Z,use_quota=True,user_id='36cf7e3492734ba69f56af4ac5626520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:02 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5d3fb3df-84ed-4fb6-a110-99513e345516 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092c000b-cff7-4bf0-b2ac-c5f93136de7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:02 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5d3fb3df-84ed-4fb6-a110-99513e345516 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092c000b-cff7-4bf0-b2ac-c5f93136de7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:02 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5d3fb3df-84ed-4fb6-a110-99513e345516 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d3bef79-1749-473e-b08c-d9e0e9b85458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:02 devstack sudo[100219]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:02 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5d3fb3df-84ed-4fb6-a110-99513e345516 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d3bef79-1749-473e-b08c-d9e0e9b85458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0a927d4-0df4-449a-a804-9732782e62b8', 'volume_name': 'volume-e0a927d4-0df4-449a-a804-9732782e62b8', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:02 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5d3fb3df-84ed-4fb6-a110-99513e345516 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db25098e-984f-41b6-8dcf-392d4b1262df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:02 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5d3fb3df-84ed-4fb6-a110-99513e345516 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db25098e-984f-41b6-8dcf-392d4b1262df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:02 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5d3fb3df-84ed-4fb6-a110-99513e345516 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf4d58e-fe41-44cc-a485-5ee6c233103c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:02 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-5d3fb3df-84ed-4fb6-a110-99513e345516 tempest-CreateVolumesFromImageTest-1219366183 None] Volume e0a927d4-0df4-449a-a804-9732782e62b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0a927d4-0df4-449a-a804-9732782e62b8', 'volume_size': 1} Jul 28 10:46:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5d3fb3df-84ed-4fb6-a110-99513e345516 tempest-CreateVolumesFromImageTest-1219366183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-46f9c8b8-c587-490e-ac05-c7bcc31023d3 tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e.info" returned: 0 in 0.697s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:02 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-46f9c8b8-c587-490e-ac05-c7bcc31023d3 tempest-VolumesSnapshotTestJSON-50191109 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e.info is being set with open permissions: ugo+rw Jul 28 10:46:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-46f9c8b8-c587-490e-ac05-c7bcc31023d3 tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:02 devstack sudo[100223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e.info Jul 28 10:46:02 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:03 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-46f9c8b8-c587-490e-ac05-c7bcc31023d3 tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e.info" returned: 0 in 0.453s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-46f9c8b8-c587-490e-ac05-c7bcc31023d3 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.252s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-00bd7cca-2751-46c2-bd1b-c11d426f83c6 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.508s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:03 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-00bd7cca-2751-46c2-bd1b-c11d426f83c6 tempest-CreateVolumesFromImageTest-1219366183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1628649006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01661c99-fc9d-41d3-af7a-ed32ceba0a07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d622e6f232a42e08e15184de9dcdaac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:46:01Z,use_quota=True,user_id='36cf7e3492734ba69f56af4ac5626520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:46:03 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-00bd7cca-2751-46c2-bd1b-c11d426f83c6 tempest-CreateVolumesFromImageTest-1219366183 None] Creating volume 01661c99-fc9d-41d3-af7a-ed32ceba0a07 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:46:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-00bd7cca-2751-46c2-bd1b-c11d426f83c6 tempest-CreateVolumesFromImageTest-1219366183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-00bd7cca-2751-46c2-bd1b-c11d426f83c6 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:03 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-00bd7cca-2751-46c2-bd1b-c11d426f83c6 tempest-CreateVolumesFromImageTest-1219366183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:46:03 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-00bd7cca-2751-46c2-bd1b-c11d426f83c6 tempest-CreateVolumesFromImageTest-1219366183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:46:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-00bd7cca-2751-46c2-bd1b-c11d426f83c6 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:03 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-00bd7cca-2751-46c2-bd1b-c11d426f83c6 tempest-CreateVolumesFromImageTest-1219366183 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:46:03 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-00bd7cca-2751-46c2-bd1b-c11d426f83c6 tempest-CreateVolumesFromImageTest-1219366183 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:46:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-00bd7cca-2751-46c2-bd1b-c11d426f83c6 tempest-CreateVolumesFromImageTest-1219366183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-01661c99-fc9d-41d3-af7a-ed32ceba0a07 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:03 devstack sudo[100226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-01661c99-fc9d-41d3-af7a-ed32ceba0a07 1073741824 Jul 28 10:46:03 devstack sudo[100226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:03 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b749488-910c-4e13-8208-9036860bfa50 tempest-CreateVolumesFromImageTest-1219366183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:46:03 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2b749488-910c-4e13-8208-9036860bfa50 tempest-CreateVolumesFromImageTest-1219366183 None] Flow 'volume_create_manager' (e0d0dd44-3f29-4c4e-a1e2-ec21c087f1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:46:03 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2b749488-910c-4e13-8208-9036860bfa50 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11706b8b-dabb-4156-9255-b2628821a645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:03 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2b749488-910c-4e13-8208-9036860bfa50 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11706b8b-dabb-4156-9255-b2628821a645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-901597169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39fd455b-068b-463b-9545-27f3014178d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d622e6f232a42e08e15184de9dcdaac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:46:03Z,use_quota=True,user_id='36cf7e3492734ba69f56af4ac5626520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:03 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2b749488-910c-4e13-8208-9036860bfa50 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1926f43-e845-413f-b8b0-ca1addfb00ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:03 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2b749488-910c-4e13-8208-9036860bfa50 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1926f43-e845-413f-b8b0-ca1addfb00ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:03 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2b749488-910c-4e13-8208-9036860bfa50 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53bb964c-db67-4398-adb1-4bc2dc22d091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:03 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2b749488-910c-4e13-8208-9036860bfa50 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53bb964c-db67-4398-adb1-4bc2dc22d091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39fd455b-068b-463b-9545-27f3014178d4', 'volume_name': 'volume-39fd455b-068b-463b-9545-27f3014178d4', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:03 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2b749488-910c-4e13-8208-9036860bfa50 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54c9d04a-f452-45d2-a29a-d07d743fff6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:03 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2b749488-910c-4e13-8208-9036860bfa50 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54c9d04a-f452-45d2-a29a-d07d743fff6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:03 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2b749488-910c-4e13-8208-9036860bfa50 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e570e77-e562-4713-b639-7627e457353d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:03 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-2b749488-910c-4e13-8208-9036860bfa50 tempest-CreateVolumesFromImageTest-1219366183 None] Volume 39fd455b-068b-463b-9545-27f3014178d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39fd455b-068b-463b-9545-27f3014178d4', 'volume_size': 1} Jul 28 10:46:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-2b749488-910c-4e13-8208-9036860bfa50 tempest-CreateVolumesFromImageTest-1219366183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:03 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-46f9c8b8-c587-490e-ac05-c7bcc31023d3 tempest-VolumesSnapshotTestJSON-50191109 None] Create snapshot completed successfully Jul 28 10:46:03 devstack sudo[100226]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-00bd7cca-2751-46c2-bd1b-c11d426f83c6 tempest-CreateVolumesFromImageTest-1219366183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-01661c99-fc9d-41d3-af7a-ed32ceba0a07 1073741824" returned: 0 in 0.697s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-00bd7cca-2751-46c2-bd1b-c11d426f83c6 tempest-CreateVolumesFromImageTest-1219366183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-01661c99-fc9d-41d3-af7a-ed32ceba0a07 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:03 devstack sudo[100232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-01661c99-fc9d-41d3-af7a-ed32ceba0a07 Jul 28 10:46:03 devstack sudo[100232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:03 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2e23485-e89d-460b-a1dd-46aeed3e2e81 tempest-CreateVolumesFromImageTest-1219366183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b2e23485-e89d-460b-a1dd-46aeed3e2e81 tempest-CreateVolumesFromImageTest-1219366183 None] Flow 'volume_create_manager' (1f6e9cd2-6c64-41e7-98a3-cba3d56c1414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b2e23485-e89d-460b-a1dd-46aeed3e2e81 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7ccce1a-abd9-4396-a220-859fdab11859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b2e23485-e89d-460b-a1dd-46aeed3e2e81 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7ccce1a-abd9-4396-a220-859fdab11859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1506915597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a9b21b7-fb11-4003-b153-3b5c9710a07b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d622e6f232a42e08e15184de9dcdaac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:46:04Z,use_quota=True,user_id='36cf7e3492734ba69f56af4ac5626520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b2e23485-e89d-460b-a1dd-46aeed3e2e81 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b66d56aa-2053-4b7a-b190-a51f7920447f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b2e23485-e89d-460b-a1dd-46aeed3e2e81 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b66d56aa-2053-4b7a-b190-a51f7920447f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b2e23485-e89d-460b-a1dd-46aeed3e2e81 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71bf9f85-7673-43b6-a821-34a32199b6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b2e23485-e89d-460b-a1dd-46aeed3e2e81 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71bf9f85-7673-43b6-a821-34a32199b6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a9b21b7-fb11-4003-b153-3b5c9710a07b', 'volume_name': 'volume-3a9b21b7-fb11-4003-b153-3b5c9710a07b', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b2e23485-e89d-460b-a1dd-46aeed3e2e81 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42b16a70-4b47-48dc-9096-b28a510ce5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b2e23485-e89d-460b-a1dd-46aeed3e2e81 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42b16a70-4b47-48dc-9096-b28a510ce5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b2e23485-e89d-460b-a1dd-46aeed3e2e81 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (210e5f1a-3d26-46db-b4da-a431f4ce13ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:04 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-b2e23485-e89d-460b-a1dd-46aeed3e2e81 tempest-CreateVolumesFromImageTest-1219366183 None] Volume 3a9b21b7-fb11-4003-b153-3b5c9710a07b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a9b21b7-fb11-4003-b153-3b5c9710a07b', 'volume_size': 1} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b2e23485-e89d-460b-a1dd-46aeed3e2e81 tempest-CreateVolumesFromImageTest-1219366183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:04 devstack sudo[100232]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-00bd7cca-2751-46c2-bd1b-c11d426f83c6 tempest-CreateVolumesFromImageTest-1219366183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-01661c99-fc9d-41d3-af7a-ed32ceba0a07" returned: 0 in 0.512s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-00bd7cca-2751-46c2-bd1b-c11d426f83c6 tempest-CreateVolumesFromImageTest-1219366183 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-00bd7cca-2751-46c2-bd1b-c11d426f83c6 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5d3fb3df-84ed-4fb6-a110-99513e345516 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.840s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5d3fb3df-84ed-4fb6-a110-99513e345516 tempest-CreateVolumesFromImageTest-1219366183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-573741728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0a927d4-0df4-449a-a804-9732782e62b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d622e6f232a42e08e15184de9dcdaac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:46:02Z,use_quota=True,user_id='36cf7e3492734ba69f56af4ac5626520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-5d3fb3df-84ed-4fb6-a110-99513e345516 tempest-CreateVolumesFromImageTest-1219366183 None] Creating volume e0a927d4-0df4-449a-a804-9732782e62b8 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5d3fb3df-84ed-4fb6-a110-99513e345516 tempest-CreateVolumesFromImageTest-1219366183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5d3fb3df-84ed-4fb6-a110-99513e345516 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5d3fb3df-84ed-4fb6-a110-99513e345516 tempest-CreateVolumesFromImageTest-1219366183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5d3fb3df-84ed-4fb6-a110-99513e345516 tempest-CreateVolumesFromImageTest-1219366183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5d3fb3df-84ed-4fb6-a110-99513e345516 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5d3fb3df-84ed-4fb6-a110-99513e345516 tempest-CreateVolumesFromImageTest-1219366183 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:46:04 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-5d3fb3df-84ed-4fb6-a110-99513e345516 tempest-CreateVolumesFromImageTest-1219366183 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5d3fb3df-84ed-4fb6-a110-99513e345516 tempest-CreateVolumesFromImageTest-1219366183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e0a927d4-0df4-449a-a804-9732782e62b8 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-00bd7cca-2751-46c2-bd1b-c11d426f83c6 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91dbf003-c773-48ad-9346-d7ed9a8111d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01661c99-fc9d-41d3-af7a-ed32ceba0a07', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:04 devstack sudo[100235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e0a927d4-0df4-449a-a804-9732782e62b8 1073741824 Jul 28 10:46:04 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-00bd7cca-2751-46c2-bd1b-c11d426f83c6 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b68fef0e-02a6-4e6d-aef2-3dd0ab478079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:04 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-00bd7cca-2751-46c2-bd1b-c11d426f83c6 tempest-CreateVolumesFromImageTest-1219366183 None] Volume volume-01661c99-fc9d-41d3-af7a-ed32ceba0a07 (01661c99-fc9d-41d3-af7a-ed32ceba0a07): created successfully Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-00bd7cca-2751-46c2-bd1b-c11d426f83c6 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b68fef0e-02a6-4e6d-aef2-3dd0ab478079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-00bd7cca-2751-46c2-bd1b-c11d426f83c6 tempest-CreateVolumesFromImageTest-1219366183 None] Flow 'volume_create_manager' (9fac023c-d3a4-453b-85c3-70c813650309) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:46:04 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-00bd7cca-2751-46c2-bd1b-c11d426f83c6 tempest-CreateVolumesFromImageTest-1219366183 None] Created volume successfully. Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0f7cc657-91df-4ebd-93e8-f0e0994f0b6f tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "cinder-bfc44713-97cd-4834-92bc-9a9d77b9c57a-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0f7cc657-91df-4ebd-93e8-f0e0994f0b6f tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-bfc44713-97cd-4834-92bc-9a9d77b9c57a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-00ed9339-1114-4537-a3c1-78d1261bb211 tempest-CreateVolumesFromImageTest-1219366183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-00ed9339-1114-4537-a3c1-78d1261bb211 tempest-CreateVolumesFromImageTest-1219366183 None] Flow 'volume_create_manager' (c3dedd27-aee7-44b6-846b-945ffd59473f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-00ed9339-1114-4537-a3c1-78d1261bb211 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d62bee7-7e7d-46a2-826d-66aa542d6106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-00ed9339-1114-4537-a3c1-78d1261bb211 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d62bee7-7e7d-46a2-826d-66aa542d6106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1347845386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dddc48d2-8eb1-486f-981f-63e002cd0f0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d622e6f232a42e08e15184de9dcdaac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:46:05Z,use_quota=True,user_id='36cf7e3492734ba69f56af4ac5626520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-00ed9339-1114-4537-a3c1-78d1261bb211 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (931ca31e-f085-4481-adad-8ce5064fa435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-00ed9339-1114-4537-a3c1-78d1261bb211 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (931ca31e-f085-4481-adad-8ce5064fa435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-00ed9339-1114-4537-a3c1-78d1261bb211 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ba1c44c-3a75-4430-b803-12aebd4e65ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-00ed9339-1114-4537-a3c1-78d1261bb211 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ba1c44c-3a75-4430-b803-12aebd4e65ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dddc48d2-8eb1-486f-981f-63e002cd0f0b', 'volume_name': 'volume-dddc48d2-8eb1-486f-981f-63e002cd0f0b', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-00ed9339-1114-4537-a3c1-78d1261bb211 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d26574aa-7bd9-4d90-8fdf-9e65f7644691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-00ed9339-1114-4537-a3c1-78d1261bb211 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d26574aa-7bd9-4d90-8fdf-9e65f7644691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-00ed9339-1114-4537-a3c1-78d1261bb211 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64a8714e-bd35-4749-a3b2-509f13d774be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:04 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-00ed9339-1114-4537-a3c1-78d1261bb211 tempest-CreateVolumesFromImageTest-1219366183 None] Volume dddc48d2-8eb1-486f-981f-63e002cd0f0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dddc48d2-8eb1-486f-981f-63e002cd0f0b', 'volume_size': 1} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-00ed9339-1114-4537-a3c1-78d1261bb211 tempest-CreateVolumesFromImageTest-1219366183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=169,cinder:UPDATE=180,cinder:INSERT=55,cinder:DELETE=19 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0f7cc657-91df-4ebd-93e8-f0e0994f0b6f tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "cinder-quobyte-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0f7cc657-91df-4ebd-93e8-f0e0994f0b6f tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-quobyte-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0f7cc657-91df-4ebd-93e8-f0e0994f0b6f tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "cinder-quobyte-bfc44713-97cd-4834-92bc-9a9d77b9c57a" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0f7cc657-91df-4ebd-93e8-f0e0994f0b6f tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-quobyte-bfc44713-97cd-4834-92bc-9a9d77b9c57a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-0f7cc657-91df-4ebd-93e8-f0e0994f0b6f tempest-VolumesSnapshotTestJSON-50191109 None] Deleting offline snapshot bfc44713-97cd-4834-92bc-9a9d77b9c57a of volume aeef515e-ee70-42e3-ad35-7b8edc9b2d6e {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-0f7cc657-91df-4ebd-93e8-f0e0994f0b6f tempest-VolumesSnapshotTestJSON-50191109 None] snapshot_file for this snap is: volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e.bfc44713-97cd-4834-92bc-9a9d77b9c57a {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61543a3-3539-48e0-819b-ef1bd542ee06]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0f7cc657-91df-4ebd-93e8-f0e0994f0b6f tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e.bfc44713-97cd-4834-92bc-9a9d77b9c57a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:04 devstack sudo[100240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e.bfc44713-97cd-4834-92bc-9a9d77b9c57a Jul 28 10:46:04 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:05 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5d3fb3df-84ed-4fb6-a110-99513e345516 tempest-CreateVolumesFromImageTest-1219366183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e0a927d4-0df4-449a-a804-9732782e62b8 1073741824" returned: 0 in 0.632s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:05 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=171,cinder:UPDATE=203,cinder:INSERT=63,cinder:DELETE=14 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:46:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5d3fb3df-84ed-4fb6-a110-99513e345516 tempest-CreateVolumesFromImageTest-1219366183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e0a927d4-0df4-449a-a804-9732782e62b8 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:05 devstack sudo[100243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e0a927d4-0df4-449a-a804-9732782e62b8 Jul 28 10:46:05 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:05 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0f7cc657-91df-4ebd-93e8-f0e0994f0b6f tempest-VolumesSnapshotTestJSON-50191109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e.bfc44713-97cd-4834-92bc-9a9d77b9c57a" returned: 0 in 0.454s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:05 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-0f7cc657-91df-4ebd-93e8-f0e0994f0b6f tempest-VolumesSnapshotTestJSON-50191109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:46:05 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db61281-e98b-4233-9f83-3e4a0c650413]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0f7cc657-91df-4ebd-93e8-f0e0994f0b6f tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:05 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5d3fb3df-84ed-4fb6-a110-99513e345516 tempest-CreateVolumesFromImageTest-1219366183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e0a927d4-0df4-449a-a804-9732782e62b8" returned: 0 in 0.355s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:05 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5d3fb3df-84ed-4fb6-a110-99513e345516 tempest-CreateVolumesFromImageTest-1219366183 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:46:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5d3fb3df-84ed-4fb6-a110-99513e345516 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-2b749488-910c-4e13-8208-9036860bfa50 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.032s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:05 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-2b749488-910c-4e13-8208-9036860bfa50 tempest-CreateVolumesFromImageTest-1219366183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-901597169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39fd455b-068b-463b-9545-27f3014178d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d622e6f232a42e08e15184de9dcdaac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:46:03Z,use_quota=True,user_id='36cf7e3492734ba69f56af4ac5626520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:46:05 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-2b749488-910c-4e13-8208-9036860bfa50 tempest-CreateVolumesFromImageTest-1219366183 None] Creating volume 39fd455b-068b-463b-9545-27f3014178d4 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:46:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-2b749488-910c-4e13-8208-9036860bfa50 tempest-CreateVolumesFromImageTest-1219366183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-2b749488-910c-4e13-8208-9036860bfa50 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:05 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-2b749488-910c-4e13-8208-9036860bfa50 tempest-CreateVolumesFromImageTest-1219366183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:46:05 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-2b749488-910c-4e13-8208-9036860bfa50 tempest-CreateVolumesFromImageTest-1219366183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:46:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-2b749488-910c-4e13-8208-9036860bfa50 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:05 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-2b749488-910c-4e13-8208-9036860bfa50 tempest-CreateVolumesFromImageTest-1219366183 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:46:05 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-2b749488-910c-4e13-8208-9036860bfa50 tempest-CreateVolumesFromImageTest-1219366183 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:46:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2b749488-910c-4e13-8208-9036860bfa50 tempest-CreateVolumesFromImageTest-1219366183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-39fd455b-068b-463b-9545-27f3014178d4 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:05 devstack sudo[100248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e Jul 28 10:46:05 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5d3fb3df-84ed-4fb6-a110-99513e345516 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf4d58e-fe41-44cc-a485-5ee6c233103c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0a927d4-0df4-449a-a804-9732782e62b8', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:05 devstack sudo[100251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-39fd455b-068b-463b-9545-27f3014178d4 1073741824 Jul 28 10:46:05 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5d3fb3df-84ed-4fb6-a110-99513e345516 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39009460-48a5-47b3-b739-3edc38eb0b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:05 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-5d3fb3df-84ed-4fb6-a110-99513e345516 tempest-CreateVolumesFromImageTest-1219366183 None] Volume volume-e0a927d4-0df4-449a-a804-9732782e62b8 (e0a927d4-0df4-449a-a804-9732782e62b8): created successfully Jul 28 10:46:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5d3fb3df-84ed-4fb6-a110-99513e345516 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39009460-48a5-47b3-b739-3edc38eb0b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5d3fb3df-84ed-4fb6-a110-99513e345516 tempest-CreateVolumesFromImageTest-1219366183 None] Flow 'volume_create_manager' (43fdcb68-0a89-4322-9131-a5af1a200670) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:46:05 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-5d3fb3df-84ed-4fb6-a110-99513e345516 tempest-CreateVolumesFromImageTest-1219366183 None] Created volume successfully. Jul 28 10:46:05 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0f7cc657-91df-4ebd-93e8-f0e0994f0b6f tempest-VolumesSnapshotTestJSON-50191109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e" returned: 0 in 0.499s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0f7cc657-91df-4ebd-93e8-f0e0994f0b6f tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e.bfc44713-97cd-4834-92bc-9a9d77b9c57a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:05 devstack sudo[100259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e.bfc44713-97cd-4834-92bc-9a9d77b9c57a Jul 28 10:46:05 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:06 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2b749488-910c-4e13-8208-9036860bfa50 tempest-CreateVolumesFromImageTest-1219366183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-39fd455b-068b-463b-9545-27f3014178d4 1073741824" returned: 0 in 0.621s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2b749488-910c-4e13-8208-9036860bfa50 tempest-CreateVolumesFromImageTest-1219366183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-39fd455b-068b-463b-9545-27f3014178d4 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:06 devstack sudo[100291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-39fd455b-068b-463b-9545-27f3014178d4 Jul 28 10:46:06 devstack sudo[100291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:06 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0f7cc657-91df-4ebd-93e8-f0e0994f0b6f tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e.bfc44713-97cd-4834-92bc-9a9d77b9c57a" returned: 0 in 0.549s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0f7cc657-91df-4ebd-93e8-f0e0994f0b6f tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e.bfc44713-97cd-4834-92bc-9a9d77b9c57a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:06 devstack sudo[100295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e.bfc44713-97cd-4834-92bc-9a9d77b9c57a Jul 28 10:46:06 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:06 devstack sudo[100291]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2b749488-910c-4e13-8208-9036860bfa50 tempest-CreateVolumesFromImageTest-1219366183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-39fd455b-068b-463b-9545-27f3014178d4" returned: 0 in 0.310s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:06 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-2b749488-910c-4e13-8208-9036860bfa50 tempest-CreateVolumesFromImageTest-1219366183 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:46:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-2b749488-910c-4e13-8208-9036860bfa50 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b2e23485-e89d-460b-a1dd-46aeed3e2e81 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.385s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:06 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b2e23485-e89d-460b-a1dd-46aeed3e2e81 tempest-CreateVolumesFromImageTest-1219366183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1506915597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a9b21b7-fb11-4003-b153-3b5c9710a07b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d622e6f232a42e08e15184de9dcdaac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:46:04Z,use_quota=True,user_id='36cf7e3492734ba69f56af4ac5626520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:46:06 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-b2e23485-e89d-460b-a1dd-46aeed3e2e81 tempest-CreateVolumesFromImageTest-1219366183 None] Creating volume 3a9b21b7-fb11-4003-b153-3b5c9710a07b {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:46:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b2e23485-e89d-460b-a1dd-46aeed3e2e81 tempest-CreateVolumesFromImageTest-1219366183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b2e23485-e89d-460b-a1dd-46aeed3e2e81 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:06 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b2e23485-e89d-460b-a1dd-46aeed3e2e81 tempest-CreateVolumesFromImageTest-1219366183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:46:06 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b2e23485-e89d-460b-a1dd-46aeed3e2e81 tempest-CreateVolumesFromImageTest-1219366183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:46:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b2e23485-e89d-460b-a1dd-46aeed3e2e81 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:06 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b2e23485-e89d-460b-a1dd-46aeed3e2e81 tempest-CreateVolumesFromImageTest-1219366183 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:46:06 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-b2e23485-e89d-460b-a1dd-46aeed3e2e81 tempest-CreateVolumesFromImageTest-1219366183 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:46:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b2e23485-e89d-460b-a1dd-46aeed3e2e81 tempest-CreateVolumesFromImageTest-1219366183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3a9b21b7-fb11-4003-b153-3b5c9710a07b 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2b749488-910c-4e13-8208-9036860bfa50 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e570e77-e562-4713-b639-7627e457353d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39fd455b-068b-463b-9545-27f3014178d4', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:06 devstack sudo[100298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3a9b21b7-fb11-4003-b153-3b5c9710a07b 1073741824 Jul 28 10:46:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2b749488-910c-4e13-8208-9036860bfa50 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e6f50a-97ba-4530-b6d8-5ea26e0ffbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:06 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:06 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-2b749488-910c-4e13-8208-9036860bfa50 tempest-CreateVolumesFromImageTest-1219366183 None] Volume volume-39fd455b-068b-463b-9545-27f3014178d4 (39fd455b-068b-463b-9545-27f3014178d4): created successfully Jul 28 10:46:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2b749488-910c-4e13-8208-9036860bfa50 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e6f50a-97ba-4530-b6d8-5ea26e0ffbdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2b749488-910c-4e13-8208-9036860bfa50 tempest-CreateVolumesFromImageTest-1219366183 None] Flow 'volume_create_manager' (e0d0dd44-3f29-4c4e-a1e2-ec21c087f1c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:46:06 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-2b749488-910c-4e13-8208-9036860bfa50 tempest-CreateVolumesFromImageTest-1219366183 None] Created volume successfully. Jul 28 10:46:06 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0f7cc657-91df-4ebd-93e8-f0e0994f0b6f tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e.bfc44713-97cd-4834-92bc-9a9d77b9c57a" returned: 0 in 0.468s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:06 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0f7cc657-91df-4ebd-93e8-f0e0994f0b6f tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-quobyte-bfc44713-97cd-4834-92bc-9a9d77b9c57a" released by "_delete_snapshot" :: held 2.113s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:06 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0f7cc657-91df-4ebd-93e8-f0e0994f0b6f tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-quobyte-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e" released by "delete_snapshot" :: held 2.143s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:07 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-0f7cc657-91df-4ebd-93e8-f0e0994f0b6f tempest-VolumesSnapshotTestJSON-50191109 None] Created reservations ['bdaccc27-d47c-4d88-b2c3-535f1d23ec11', 'c269a5ad-f9ef-47d9-b5cf-f525a0da7ae2', '36aa30e7-3d8d-4b08-8ee4-50dcc870c4b7', '81f3e516-131d-4151-b427-2b5e763e7623'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:46:07 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-0f7cc657-91df-4ebd-93e8-f0e0994f0b6f tempest-VolumesSnapshotTestJSON-50191109 None] Delete snapshot completed successfully. Jul 28 10:46:07 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0f7cc657-91df-4ebd-93e8-f0e0994f0b6f tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-bfc44713-97cd-4834-92bc-9a9d77b9c57a-delete_snapshot" released by "delete_snapshot" :: held 2.491s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:07 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b2e23485-e89d-460b-a1dd-46aeed3e2e81 tempest-CreateVolumesFromImageTest-1219366183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3a9b21b7-fb11-4003-b153-3b5c9710a07b 1073741824" returned: 0 in 0.630s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b2e23485-e89d-460b-a1dd-46aeed3e2e81 tempest-CreateVolumesFromImageTest-1219366183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3a9b21b7-fb11-4003-b153-3b5c9710a07b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:07 devstack sudo[100305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3a9b21b7-fb11-4003-b153-3b5c9710a07b Jul 28 10:46:07 devstack sudo[100305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:07 devstack sudo[100305]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b2e23485-e89d-460b-a1dd-46aeed3e2e81 tempest-CreateVolumesFromImageTest-1219366183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3a9b21b7-fb11-4003-b153-3b5c9710a07b" returned: 0 in 0.264s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:07 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b2e23485-e89d-460b-a1dd-46aeed3e2e81 tempest-CreateVolumesFromImageTest-1219366183 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:46:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b2e23485-e89d-460b-a1dd-46aeed3e2e81 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-00ed9339-1114-4537-a3c1-78d1261bb211 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.705s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:07 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-00ed9339-1114-4537-a3c1-78d1261bb211 tempest-CreateVolumesFromImageTest-1219366183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1347845386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dddc48d2-8eb1-486f-981f-63e002cd0f0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d622e6f232a42e08e15184de9dcdaac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:46:05Z,use_quota=True,user_id='36cf7e3492734ba69f56af4ac5626520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:46:07 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-00ed9339-1114-4537-a3c1-78d1261bb211 tempest-CreateVolumesFromImageTest-1219366183 None] Creating volume dddc48d2-8eb1-486f-981f-63e002cd0f0b {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:46:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-00ed9339-1114-4537-a3c1-78d1261bb211 tempest-CreateVolumesFromImageTest-1219366183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-00ed9339-1114-4537-a3c1-78d1261bb211 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:07 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-00ed9339-1114-4537-a3c1-78d1261bb211 tempest-CreateVolumesFromImageTest-1219366183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:46:07 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-00ed9339-1114-4537-a3c1-78d1261bb211 tempest-CreateVolumesFromImageTest-1219366183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:46:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-00ed9339-1114-4537-a3c1-78d1261bb211 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:07 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-00ed9339-1114-4537-a3c1-78d1261bb211 tempest-CreateVolumesFromImageTest-1219366183 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:46:07 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-00ed9339-1114-4537-a3c1-78d1261bb211 tempest-CreateVolumesFromImageTest-1219366183 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:46:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-00ed9339-1114-4537-a3c1-78d1261bb211 tempest-CreateVolumesFromImageTest-1219366183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-dddc48d2-8eb1-486f-981f-63e002cd0f0b 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b2e23485-e89d-460b-a1dd-46aeed3e2e81 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (210e5f1a-3d26-46db-b4da-a431f4ce13ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a9b21b7-fb11-4003-b153-3b5c9710a07b', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b2e23485-e89d-460b-a1dd-46aeed3e2e81 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6b7f1e1-d95e-414d-a984-652263050a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:07 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-dddc48d2-8eb1-486f-981f-63e002cd0f0b 1073741824 Jul 28 10:46:07 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:07 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-b2e23485-e89d-460b-a1dd-46aeed3e2e81 tempest-CreateVolumesFromImageTest-1219366183 None] Volume volume-3a9b21b7-fb11-4003-b153-3b5c9710a07b (3a9b21b7-fb11-4003-b153-3b5c9710a07b): created successfully Jul 28 10:46:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b2e23485-e89d-460b-a1dd-46aeed3e2e81 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6b7f1e1-d95e-414d-a984-652263050a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b2e23485-e89d-460b-a1dd-46aeed3e2e81 tempest-CreateVolumesFromImageTest-1219366183 None] Flow 'volume_create_manager' (1f6e9cd2-6c64-41e7-98a3-cba3d56c1414) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:46:07 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-b2e23485-e89d-460b-a1dd-46aeed3e2e81 tempest-CreateVolumesFromImageTest-1219366183 None] Created volume successfully. Jul 28 10:46:08 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-00ed9339-1114-4537-a3c1-78d1261bb211 tempest-CreateVolumesFromImageTest-1219366183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-dddc48d2-8eb1-486f-981f-63e002cd0f0b 1073741824" returned: 0 in 0.582s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-00ed9339-1114-4537-a3c1-78d1261bb211 tempest-CreateVolumesFromImageTest-1219366183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-dddc48d2-8eb1-486f-981f-63e002cd0f0b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:08 devstack sudo[100325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-dddc48d2-8eb1-486f-981f-63e002cd0f0b Jul 28 10:46:08 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:08 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-00ed9339-1114-4537-a3c1-78d1261bb211 tempest-CreateVolumesFromImageTest-1219366183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-dddc48d2-8eb1-486f-981f-63e002cd0f0b" returned: 0 in 0.333s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:08 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-00ed9339-1114-4537-a3c1-78d1261bb211 tempest-CreateVolumesFromImageTest-1219366183 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:46:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-00ed9339-1114-4537-a3c1-78d1261bb211 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-00ed9339-1114-4537-a3c1-78d1261bb211 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64a8714e-bd35-4749-a3b2-509f13d774be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dddc48d2-8eb1-486f-981f-63e002cd0f0b', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-00ed9339-1114-4537-a3c1-78d1261bb211 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (853d07b4-62ce-45eb-b862-09dbe5980666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:08 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-00ed9339-1114-4537-a3c1-78d1261bb211 tempest-CreateVolumesFromImageTest-1219366183 None] Volume volume-dddc48d2-8eb1-486f-981f-63e002cd0f0b (dddc48d2-8eb1-486f-981f-63e002cd0f0b): created successfully Jul 28 10:46:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-00ed9339-1114-4537-a3c1-78d1261bb211 tempest-CreateVolumesFromImageTest-1219366183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (853d07b4-62ce-45eb-b862-09dbe5980666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-00ed9339-1114-4537-a3c1-78d1261bb211 tempest-CreateVolumesFromImageTest-1219366183 None] Flow 'volume_create_manager' (c3dedd27-aee7-44b6-846b-945ffd59473f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:46:08 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-00ed9339-1114-4537-a3c1-78d1261bb211 tempest-CreateVolumesFromImageTest-1219366183 None] Created volume successfully. Jul 28 10:46:08 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc3cfc66-4702-4279-86e2-fb560e378d30 tempest-VolumesSnapshotTestJSON-50191109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:46:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fc3cfc66-4702-4279-86e2-fb560e378d30 tempest-VolumesSnapshotTestJSON-50191109 None] Flow 'volume_create_manager' (e4d88c41-7b19-443d-9990-deaa35b46fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:46:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fc3cfc66-4702-4279-86e2-fb560e378d30 tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4019def-b78f-49f6-a162-cee68ac170b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fc3cfc66-4702-4279-86e2-fb560e378d30 tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4019def-b78f-49f6-a162-cee68ac170b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-862576358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db4b40b8f5c4400d8bd937bc704b3be4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:46:08Z,use_quota=True,user_id='cfa42265cd99411b822baac6abab4ea7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fc3cfc66-4702-4279-86e2-fb560e378d30 tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcc48c1f-dcf3-473d-982b-41bd4424f2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fc3cfc66-4702-4279-86e2-fb560e378d30 tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcc48c1f-dcf3-473d-982b-41bd4424f2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fc3cfc66-4702-4279-86e2-fb560e378d30 tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a355afd5-59f7-4456-b5a5-741810f3f63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fc3cfc66-4702-4279-86e2-fb560e378d30 tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a355afd5-59f7-4456-b5a5-741810f3f63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c', 'volume_name': 'volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fc3cfc66-4702-4279-86e2-fb560e378d30 tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b730e3f-4a71-4d10-a98e-1443f3730571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fc3cfc66-4702-4279-86e2-fb560e378d30 tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b730e3f-4a71-4d10-a98e-1443f3730571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fc3cfc66-4702-4279-86e2-fb560e378d30 tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e317837c-5512-4220-9725-17083c0b435a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:08 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-fc3cfc66-4702-4279-86e2-fb560e378d30 tempest-VolumesSnapshotTestJSON-50191109 None] Volume 0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c', 'volume_size': 1} Jul 28 10:46:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fc3cfc66-4702-4279-86e2-fb560e378d30 tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fc3cfc66-4702-4279-86e2-fb560e378d30 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:08 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-fc3cfc66-4702-4279-86e2-fb560e378d30 tempest-VolumesSnapshotTestJSON-50191109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-862576358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db4b40b8f5c4400d8bd937bc704b3be4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:46:08Z,use_quota=True,user_id='cfa42265cd99411b822baac6abab4ea7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:46:08 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-fc3cfc66-4702-4279-86e2-fb560e378d30 tempest-VolumesSnapshotTestJSON-50191109 None] Creating volume 0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:46:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fc3cfc66-4702-4279-86e2-fb560e378d30 tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fc3cfc66-4702-4279-86e2-fb560e378d30 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:08 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-fc3cfc66-4702-4279-86e2-fb560e378d30 tempest-VolumesSnapshotTestJSON-50191109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:46:08 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-fc3cfc66-4702-4279-86e2-fb560e378d30 tempest-VolumesSnapshotTestJSON-50191109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:46:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fc3cfc66-4702-4279-86e2-fb560e378d30 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:08 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-fc3cfc66-4702-4279-86e2-fb560e378d30 tempest-VolumesSnapshotTestJSON-50191109 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:46:08 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-fc3cfc66-4702-4279-86e2-fb560e378d30 tempest-VolumesSnapshotTestJSON-50191109 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:46:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fc3cfc66-4702-4279-86e2-fb560e378d30 tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:08 devstack sudo[100328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c 1073741824 Jul 28 10:46:08 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:09 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fc3cfc66-4702-4279-86e2-fb560e378d30 tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c 1073741824" returned: 0 in 0.521s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fc3cfc66-4702-4279-86e2-fb560e378d30 tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:09 devstack sudo[100334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c Jul 28 10:46:09 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:09 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-34dcfab3-a061-41fc-8557-66b02a8788e5 tempest-CreateVolumesFromImageTest-1219366183 None] Acquiring lock "cinder-dddc48d2-8eb1-486f-981f-63e002cd0f0b-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:09 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-34dcfab3-a061-41fc-8557-66b02a8788e5 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "cinder-dddc48d2-8eb1-486f-981f-63e002cd0f0b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:09 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-34dcfab3-a061-41fc-8557-66b02a8788e5 tempest-CreateVolumesFromImageTest-1219366183 None] Acquiring lock "cinder-quobyte-dddc48d2-8eb1-486f-981f-63e002cd0f0b" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:09 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-34dcfab3-a061-41fc-8557-66b02a8788e5 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "cinder-quobyte-dddc48d2-8eb1-486f-981f-63e002cd0f0b" acquired by "delete_volume" :: waited 0.016s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:09 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[9398fd53-db01-4abd-801f-21ebcec8337f]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-34dcfab3-a061-41fc-8557-66b02a8788e5 tempest-CreateVolumesFromImageTest-1219366183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-dddc48d2-8eb1-486f-981f-63e002cd0f0b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:09 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fc3cfc66-4702-4279-86e2-fb560e378d30 tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c" returned: 0 in 0.289s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:09 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-fc3cfc66-4702-4279-86e2-fb560e378d30 tempest-VolumesSnapshotTestJSON-50191109 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:46:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fc3cfc66-4702-4279-86e2-fb560e378d30 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fc3cfc66-4702-4279-86e2-fb560e378d30 tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e317837c-5512-4220-9725-17083c0b435a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fc3cfc66-4702-4279-86e2-fb560e378d30 tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eea83bec-5123-4393-bc0e-521e4cf15b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:09 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-fc3cfc66-4702-4279-86e2-fb560e378d30 tempest-VolumesSnapshotTestJSON-50191109 None] Volume volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c (0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c): created successfully Jul 28 10:46:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fc3cfc66-4702-4279-86e2-fb560e378d30 tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eea83bec-5123-4393-bc0e-521e4cf15b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fc3cfc66-4702-4279-86e2-fb560e378d30 tempest-VolumesSnapshotTestJSON-50191109 None] Flow 'volume_create_manager' (e4d88c41-7b19-443d-9990-deaa35b46fef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:46:09 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-fc3cfc66-4702-4279-86e2-fb560e378d30 tempest-VolumesSnapshotTestJSON-50191109 None] Created volume successfully. Jul 28 10:46:09 devstack sudo[100337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-dddc48d2-8eb1-486f-981f-63e002cd0f0b Jul 28 10:46:09 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:09 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-34dcfab3-a061-41fc-8557-66b02a8788e5 tempest-CreateVolumesFromImageTest-1219366183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-dddc48d2-8eb1-486f-981f-63e002cd0f0b" returned: 0 in 0.359s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-34dcfab3-a061-41fc-8557-66b02a8788e5 tempest-CreateVolumesFromImageTest-1219366183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-dddc48d2-8eb1-486f-981f-63e002cd0f0b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:09 devstack sudo[100343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-dddc48d2-8eb1-486f-981f-63e002cd0f0b Jul 28 10:46:09 devstack sudo[100343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:10 devstack sudo[100343]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-34dcfab3-a061-41fc-8557-66b02a8788e5 tempest-CreateVolumesFromImageTest-1219366183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-dddc48d2-8eb1-486f-981f-63e002cd0f0b" returned: 0 in 0.247s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:10 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-34dcfab3-a061-41fc-8557-66b02a8788e5 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "cinder-quobyte-dddc48d2-8eb1-486f-981f-63e002cd0f0b" released by "delete_volume" :: held 0.659s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:10 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-34dcfab3-a061-41fc-8557-66b02a8788e5 tempest-CreateVolumesFromImageTest-1219366183 None] Created reservations ['50fd4e2b-189c-4dab-ad35-e68f4b11558d', 'efdfccf5-fc29-4d60-90cc-188d96da9927', '10414aa7-5680-43df-b427-7faf8cdcb1e3', '031abdb4-9ff2-43d7-a609-bfc979bc16c3'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:46:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-34dcfab3-a061-41fc-8557-66b02a8788e5 tempest-CreateVolumesFromImageTest-1219366183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-34dcfab3-a061-41fc-8557-66b02a8788e5 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:10 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-34dcfab3-a061-41fc-8557-66b02a8788e5 tempest-CreateVolumesFromImageTest-1219366183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:46:10 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-34dcfab3-a061-41fc-8557-66b02a8788e5 tempest-CreateVolumesFromImageTest-1219366183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:46:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-34dcfab3-a061-41fc-8557-66b02a8788e5 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-34dcfab3-a061-41fc-8557-66b02a8788e5 tempest-CreateVolumesFromImageTest-1219366183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:10 devstack sudo[100346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:46:10 devstack sudo[100346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:10 devstack sudo[100346]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-34dcfab3-a061-41fc-8557-66b02a8788e5 tempest-CreateVolumesFromImageTest-1219366183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.262s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:10 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-34dcfab3-a061-41fc-8557-66b02a8788e5 tempest-CreateVolumesFromImageTest-1219366183 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:46:10 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-34dcfab3-a061-41fc-8557-66b02a8788e5 tempest-CreateVolumesFromImageTest-1219366183 None] Deleted volume successfully. Jul 28 10:46:10 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-34dcfab3-a061-41fc-8557-66b02a8788e5 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "cinder-dddc48d2-8eb1-486f-981f-63e002cd0f0b-delete_volume" released by "delete_volume" :: held 1.142s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:10 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7ae0e691-3d36-42a0-98e8-1e052bfc7f1a tempest-CreateVolumesFromImageTest-1219366183 None] Acquiring lock "cinder-3a9b21b7-fb11-4003-b153-3b5c9710a07b-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:10 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7ae0e691-3d36-42a0-98e8-1e052bfc7f1a tempest-CreateVolumesFromImageTest-1219366183 None] Lock "cinder-3a9b21b7-fb11-4003-b153-3b5c9710a07b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:10 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7ae0e691-3d36-42a0-98e8-1e052bfc7f1a tempest-CreateVolumesFromImageTest-1219366183 None] Acquiring lock "cinder-quobyte-3a9b21b7-fb11-4003-b153-3b5c9710a07b" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:10 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7ae0e691-3d36-42a0-98e8-1e052bfc7f1a tempest-CreateVolumesFromImageTest-1219366183 None] Lock "cinder-quobyte-3a9b21b7-fb11-4003-b153-3b5c9710a07b" acquired by "delete_volume" :: waited 0.017s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:10 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cc8bb2-64e5-4171-8d2e-e90fd0dd75a8]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7ae0e691-3d36-42a0-98e8-1e052bfc7f1a tempest-CreateVolumesFromImageTest-1219366183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3a9b21b7-fb11-4003-b153-3b5c9710a07b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:10 devstack sudo[100350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3a9b21b7-fb11-4003-b153-3b5c9710a07b Jul 28 10:46:10 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-285d0065-685f-4fe4-9224-92952c2308bd tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-285d0065-685f-4fe4-9224-92952c2308bd tempest-VolumesSnapshotTestJSON-50191109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:10 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-285d0065-685f-4fe4-9224-92952c2308bd tempest-VolumesSnapshotTestJSON-50191109 None] Creating offline snapshot b9af27fc-7a44-45c6-8be9-9ba73238a513 of volume 0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:46:10 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db4e257-1715-40ee-a60c-047449292931]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-285d0065-685f-4fe4-9224-92952c2308bd tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:11 devstack sudo[100352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c Jul 28 10:46:11 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:11 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7ae0e691-3d36-42a0-98e8-1e052bfc7f1a tempest-CreateVolumesFromImageTest-1219366183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3a9b21b7-fb11-4003-b153-3b5c9710a07b" returned: 0 in 0.431s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7ae0e691-3d36-42a0-98e8-1e052bfc7f1a tempest-CreateVolumesFromImageTest-1219366183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3a9b21b7-fb11-4003-b153-3b5c9710a07b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:11 devstack sudo[100357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3a9b21b7-fb11-4003-b153-3b5c9710a07b Jul 28 10:46:11 devstack sudo[100357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:11 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-285d0065-685f-4fe4-9224-92952c2308bd tempest-VolumesSnapshotTestJSON-50191109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c" returned: 0 in 0.405s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-285d0065-685f-4fe4-9224-92952c2308bd tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c.b9af27fc-7a44-45c6-8be9-9ba73238a513 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:11 devstack sudo[100363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c.b9af27fc-7a44-45c6-8be9-9ba73238a513 1G Jul 28 10:46:11 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:11 devstack sudo[100357]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7ae0e691-3d36-42a0-98e8-1e052bfc7f1a tempest-CreateVolumesFromImageTest-1219366183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3a9b21b7-fb11-4003-b153-3b5c9710a07b" returned: 0 in 0.264s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:11 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7ae0e691-3d36-42a0-98e8-1e052bfc7f1a tempest-CreateVolumesFromImageTest-1219366183 None] Lock "cinder-quobyte-3a9b21b7-fb11-4003-b153-3b5c9710a07b" released by "delete_volume" :: held 0.759s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:11 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-7ae0e691-3d36-42a0-98e8-1e052bfc7f1a tempest-CreateVolumesFromImageTest-1219366183 None] Created reservations ['ac399f0e-2c83-49d6-8940-ef67a2f1e048', '3962f871-aa7f-48b3-a00e-b33a49352ec6', '2cc1efa1-1b0d-437a-b539-646e5de72a23', 'f0bcf2ae-a58c-4bb8-b27c-8cfc91eed9f4'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:46:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7ae0e691-3d36-42a0-98e8-1e052bfc7f1a tempest-CreateVolumesFromImageTest-1219366183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7ae0e691-3d36-42a0-98e8-1e052bfc7f1a tempest-CreateVolumesFromImageTest-1219366183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:11 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7ae0e691-3d36-42a0-98e8-1e052bfc7f1a tempest-CreateVolumesFromImageTest-1219366183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:46:11 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7ae0e691-3d36-42a0-98e8-1e052bfc7f1a tempest-CreateVolumesFromImageTest-1219366183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:46:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7ae0e691-3d36-42a0-98e8-1e052bfc7f1a tempest-CreateVolumesFromImageTest-1219366183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7ae0e691-3d36-42a0-98e8-1e052bfc7f1a tempest-CreateVolumesFromImageTest-1219366183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:11 devstack sudo[100365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:46:11 devstack sudo[100365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:11 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-14d1f42b-f86b-47b8-8ec7-feab8048c4f0 tempest-CreateVolumesFromImageTest-1219366183 None] Acquiring lock "cinder-39fd455b-068b-463b-9545-27f3014178d4-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:11 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-14d1f42b-f86b-47b8-8ec7-feab8048c4f0 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "cinder-39fd455b-068b-463b-9545-27f3014178d4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:11 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-14d1f42b-f86b-47b8-8ec7-feab8048c4f0 tempest-CreateVolumesFromImageTest-1219366183 None] Acquiring lock "cinder-quobyte-39fd455b-068b-463b-9545-27f3014178d4" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:11 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-14d1f42b-f86b-47b8-8ec7-feab8048c4f0 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "cinder-quobyte-39fd455b-068b-463b-9545-27f3014178d4" acquired by "delete_volume" :: waited 0.019s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:11 devstack sudo[100365]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7ae0e691-3d36-42a0-98e8-1e052bfc7f1a tempest-CreateVolumesFromImageTest-1219366183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.342s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:11 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-7ae0e691-3d36-42a0-98e8-1e052bfc7f1a tempest-CreateVolumesFromImageTest-1219366183 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:46:11 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-7ae0e691-3d36-42a0-98e8-1e052bfc7f1a tempest-CreateVolumesFromImageTest-1219366183 None] Deleted volume successfully. Jul 28 10:46:11 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-285d0065-685f-4fe4-9224-92952c2308bd tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c.b9af27fc-7a44-45c6-8be9-9ba73238a513 1G" returned: 0 in 0.590s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-285d0065-685f-4fe4-9224-92952c2308bd tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c.b9af27fc-7a44-45c6-8be9-9ba73238a513 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:11 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0e647c-29d1-49d2-853b-91f4046419c2]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-14d1f42b-f86b-47b8-8ec7-feab8048c4f0 tempest-CreateVolumesFromImageTest-1219366183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-39fd455b-068b-463b-9545-27f3014178d4 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:11 devstack sudo[100372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c.b9af27fc-7a44-45c6-8be9-9ba73238a513 Jul 28 10:46:11 devstack sudo[100372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:11 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7ae0e691-3d36-42a0-98e8-1e052bfc7f1a tempest-CreateVolumesFromImageTest-1219366183 None] Lock "cinder-3a9b21b7-fb11-4003-b153-3b5c9710a07b-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:12 devstack sudo[100373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-39fd455b-068b-463b-9545-27f3014178d4 Jul 28 10:46:12 devstack sudo[100373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:12 devstack sudo[100372]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-285d0065-685f-4fe4-9224-92952c2308bd tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c.b9af27fc-7a44-45c6-8be9-9ba73238a513" returned: 0 in 0.365s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:12 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-285d0065-685f-4fe4-9224-92952c2308bd tempest-VolumesSnapshotTestJSON-50191109 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c.b9af27fc-7a44-45c6-8be9-9ba73238a513 is being set with open permissions: ugo+rw Jul 28 10:46:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-285d0065-685f-4fe4-9224-92952c2308bd tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c.b9af27fc-7a44-45c6-8be9-9ba73238a513 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:12 devstack sudo[100379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c.b9af27fc-7a44-45c6-8be9-9ba73238a513 Jul 28 10:46:12 devstack sudo[100379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:12 devstack sudo[100373]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-14d1f42b-f86b-47b8-8ec7-feab8048c4f0 tempest-CreateVolumesFromImageTest-1219366183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-39fd455b-068b-463b-9545-27f3014178d4" returned: 0 in 0.451s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-14d1f42b-f86b-47b8-8ec7-feab8048c4f0 tempest-CreateVolumesFromImageTest-1219366183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-39fd455b-068b-463b-9545-27f3014178d4 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:12 devstack sudo[100384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-39fd455b-068b-463b-9545-27f3014178d4 Jul 28 10:46:12 devstack sudo[100384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:12 devstack sudo[100379]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-285d0065-685f-4fe4-9224-92952c2308bd tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c.b9af27fc-7a44-45c6-8be9-9ba73238a513" returned: 0 in 0.282s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-285d0065-685f-4fe4-9224-92952c2308bd tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:12 devstack sudo[100387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c.info Jul 28 10:46:12 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:12 devstack sudo[100384]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-14d1f42b-f86b-47b8-8ec7-feab8048c4f0 tempest-CreateVolumesFromImageTest-1219366183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-39fd455b-068b-463b-9545-27f3014178d4" returned: 0 in 0.306s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:12 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-14d1f42b-f86b-47b8-8ec7-feab8048c4f0 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "cinder-quobyte-39fd455b-068b-463b-9545-27f3014178d4" released by "delete_volume" :: held 0.835s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:12 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-14d1f42b-f86b-47b8-8ec7-feab8048c4f0 tempest-CreateVolumesFromImageTest-1219366183 None] Created reservations ['a0ed6990-322e-4074-8bb0-3aebbb2660b7', '2c750240-7f37-4c4f-9311-fe470b14f3f0', 'e5bddbaf-bed5-49c2-aa7d-7d9f58ed43f1', 'f7ca9dad-fa9b-435f-a935-e61ae1d800a9'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:46:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-14d1f42b-f86b-47b8-8ec7-feab8048c4f0 tempest-CreateVolumesFromImageTest-1219366183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-14d1f42b-f86b-47b8-8ec7-feab8048c4f0 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-14d1f42b-f86b-47b8-8ec7-feab8048c4f0 tempest-CreateVolumesFromImageTest-1219366183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:46:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-14d1f42b-f86b-47b8-8ec7-feab8048c4f0 tempest-CreateVolumesFromImageTest-1219366183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:46:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-14d1f42b-f86b-47b8-8ec7-feab8048c4f0 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-14d1f42b-f86b-47b8-8ec7-feab8048c4f0 tempest-CreateVolumesFromImageTest-1219366183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:12 devstack sudo[100390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:46:12 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:12 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-285d0065-685f-4fe4-9224-92952c2308bd tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c.info" returned: 0 in 0.353s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:12 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-285d0065-685f-4fe4-9224-92952c2308bd tempest-VolumesSnapshotTestJSON-50191109 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c.info is being set with open permissions: ugo+rw Jul 28 10:46:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-285d0065-685f-4fe4-9224-92952c2308bd tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:12 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-dc9d5841-7cd7-4bcf-9e37-95da4ae82d03 tempest-CreateVolumesFromImageTest-1219366183 None] Acquiring lock "cinder-e0a927d4-0df4-449a-a804-9732782e62b8-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:12 devstack sudo[100393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c.info Jul 28 10:46:12 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:12 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-dc9d5841-7cd7-4bcf-9e37-95da4ae82d03 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "cinder-e0a927d4-0df4-449a-a804-9732782e62b8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:13 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-dc9d5841-7cd7-4bcf-9e37-95da4ae82d03 tempest-CreateVolumesFromImageTest-1219366183 None] Acquiring lock "cinder-quobyte-e0a927d4-0df4-449a-a804-9732782e62b8" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:13 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-dc9d5841-7cd7-4bcf-9e37-95da4ae82d03 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "cinder-quobyte-e0a927d4-0df4-449a-a804-9732782e62b8" acquired by "delete_volume" :: waited 0.023s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:13 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a192ec5-f0c3-4fb9-9686-43a6e26270f8]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dc9d5841-7cd7-4bcf-9e37-95da4ae82d03 tempest-CreateVolumesFromImageTest-1219366183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e0a927d4-0df4-449a-a804-9732782e62b8 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:13 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-14d1f42b-f86b-47b8-8ec7-feab8048c4f0 tempest-CreateVolumesFromImageTest-1219366183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.412s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:13 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-14d1f42b-f86b-47b8-8ec7-feab8048c4f0 tempest-CreateVolumesFromImageTest-1219366183 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:46:13 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-14d1f42b-f86b-47b8-8ec7-feab8048c4f0 tempest-CreateVolumesFromImageTest-1219366183 None] Deleted volume successfully. Jul 28 10:46:13 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-14d1f42b-f86b-47b8-8ec7-feab8048c4f0 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "cinder-39fd455b-068b-463b-9545-27f3014178d4-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:13 devstack sudo[100395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e0a927d4-0df4-449a-a804-9732782e62b8 Jul 28 10:46:13 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:13 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-285d0065-685f-4fe4-9224-92952c2308bd tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c.info" returned: 0 in 0.422s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-285d0065-685f-4fe4-9224-92952c2308bd tempest-VolumesSnapshotTestJSON-50191109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.540s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:13 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-285d0065-685f-4fe4-9224-92952c2308bd tempest-VolumesSnapshotTestJSON-50191109 None] Create snapshot completed successfully Jul 28 10:46:13 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dc9d5841-7cd7-4bcf-9e37-95da4ae82d03 tempest-CreateVolumesFromImageTest-1219366183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e0a927d4-0df4-449a-a804-9732782e62b8" returned: 0 in 0.449s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dc9d5841-7cd7-4bcf-9e37-95da4ae82d03 tempest-CreateVolumesFromImageTest-1219366183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e0a927d4-0df4-449a-a804-9732782e62b8 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:13 devstack sudo[100402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e0a927d4-0df4-449a-a804-9732782e62b8 Jul 28 10:46:13 devstack sudo[100402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:13 devstack sudo[100402]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dc9d5841-7cd7-4bcf-9e37-95da4ae82d03 tempest-CreateVolumesFromImageTest-1219366183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e0a927d4-0df4-449a-a804-9732782e62b8" returned: 0 in 0.291s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:13 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-dc9d5841-7cd7-4bcf-9e37-95da4ae82d03 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "cinder-quobyte-e0a927d4-0df4-449a-a804-9732782e62b8" released by "delete_volume" :: held 0.811s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:13 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-dc9d5841-7cd7-4bcf-9e37-95da4ae82d03 tempest-CreateVolumesFromImageTest-1219366183 None] Created reservations ['91c327f6-6048-425a-ae61-1bf22e222d47', '7ffaae55-2aad-4e1c-8216-8e8536b0bc1a', 'fee059bb-0937-4a87-b2e0-ea6684c178d1', 'c933bc21-7dfc-43d3-b51f-edbffa37d957'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:46:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-dc9d5841-7cd7-4bcf-9e37-95da4ae82d03 tempest-CreateVolumesFromImageTest-1219366183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-dc9d5841-7cd7-4bcf-9e37-95da4ae82d03 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:14 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-dc9d5841-7cd7-4bcf-9e37-95da4ae82d03 tempest-CreateVolumesFromImageTest-1219366183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:46:14 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-dc9d5841-7cd7-4bcf-9e37-95da4ae82d03 tempest-CreateVolumesFromImageTest-1219366183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:46:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-dc9d5841-7cd7-4bcf-9e37-95da4ae82d03 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dc9d5841-7cd7-4bcf-9e37-95da4ae82d03 tempest-CreateVolumesFromImageTest-1219366183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:14 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ebb23b81-45e5-4657-9c09-78166d74c638 tempest-CreateVolumesFromImageTest-1219366183 None] Acquiring lock "cinder-01661c99-fc9d-41d3-af7a-ed32ceba0a07-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:14 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ebb23b81-45e5-4657-9c09-78166d74c638 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "cinder-01661c99-fc9d-41d3-af7a-ed32ceba0a07-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:14 devstack sudo[100407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:46:14 devstack sudo[100407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:14 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ebb23b81-45e5-4657-9c09-78166d74c638 tempest-CreateVolumesFromImageTest-1219366183 None] Acquiring lock "cinder-quobyte-01661c99-fc9d-41d3-af7a-ed32ceba0a07" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:14 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ebb23b81-45e5-4657-9c09-78166d74c638 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "cinder-quobyte-01661c99-fc9d-41d3-af7a-ed32ceba0a07" acquired by "delete_volume" :: waited 0.023s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:14 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[775817a0-9f2d-4ca1-b0ed-d86d73af33cc]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ebb23b81-45e5-4657-9c09-78166d74c638 tempest-CreateVolumesFromImageTest-1219366183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-01661c99-fc9d-41d3-af7a-ed32ceba0a07 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:14 devstack sudo[100409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-01661c99-fc9d-41d3-af7a-ed32ceba0a07 Jul 28 10:46:14 devstack sudo[100409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:14 devstack sudo[100407]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dc9d5841-7cd7-4bcf-9e37-95da4ae82d03 tempest-CreateVolumesFromImageTest-1219366183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.509s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:14 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-dc9d5841-7cd7-4bcf-9e37-95da4ae82d03 tempest-CreateVolumesFromImageTest-1219366183 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:46:14 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-dc9d5841-7cd7-4bcf-9e37-95da4ae82d03 tempest-CreateVolumesFromImageTest-1219366183 None] Deleted volume successfully. Jul 28 10:46:14 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-dc9d5841-7cd7-4bcf-9e37-95da4ae82d03 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "cinder-e0a927d4-0df4-449a-a804-9732782e62b8-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:14 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Flow 'volume_create_manager' (8e496e46-e2a8-4742-b9dd-2864a1ff7c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04546774-7849-4769-9ed4-3bf07cefd192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:15 devstack sudo[100409]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ebb23b81-45e5-4657-9c09-78166d74c638 tempest-CreateVolumesFromImageTest-1219366183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-01661c99-fc9d-41d3-af7a-ed32ceba0a07" returned: 0 in 0.649s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ebb23b81-45e5-4657-9c09-78166d74c638 tempest-CreateVolumesFromImageTest-1219366183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-01661c99-fc9d-41d3-af7a-ed32ceba0a07 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04546774-7849-4769-9ed4-3bf07cefd192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-939852564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe488328-1cb2-4f5b-b44b-8a89c7afa7c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db4b40b8f5c4400d8bd937bc704b3be4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:46:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=b9af27fc-7a44-45c6-8be9-9ba73238a513,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:46:15Z,use_quota=True,user_id='cfa42265cd99411b822baac6abab4ea7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bdf68d6-2283-487f-a05e-c7fa29e96c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:15 devstack sudo[100415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-01661c99-fc9d-41d3-af7a-ed32ceba0a07 Jul 28 10:46:15 devstack sudo[100415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bdf68d6-2283-487f-a05e-c7fa29e96c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ded708f8-a6cc-4dd5-a0e0-70d623c38cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ded708f8-a6cc-4dd5-a0e0-70d623c38cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fe488328-1cb2-4f5b-b44b-8a89c7afa7c5', 'volume_name': 'volume-fe488328-1cb2-4f5b-b44b-8a89c7afa7c5', 'volume_size': 2, 'snapshot_id': 'b9af27fc-7a44-45c6-8be9-9ba73238a513'}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb5f3924-0105-41c1-8d0f-054a75a9f822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb5f3924-0105-41c1-8d0f-054a75a9f822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6947ebe1-c180-4ca9-8d4e-648c0df8830f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:15 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Volume fe488328-1cb2-4f5b-b44b-8a89c7afa7c5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fe488328-1cb2-4f5b-b44b-8a89c7afa7c5', 'volume_size': 2, 'snapshot_id': 'b9af27fc-7a44-45c6-8be9-9ba73238a513'} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "cinder-quobyte-b9af27fc-7a44-45c6-8be9-9ba73238a513-fe488328-1cb2-4f5b-b44b-8a89c7afa7c5" by "_create_volume_from_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-quobyte-b9af27fc-7a44-45c6-8be9-9ba73238a513-fe488328-1cb2-4f5b-b44b-8a89c7afa7c5" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Creating volume fe488328-1cb2-4f5b-b44b-8a89c7afa7c5 from snapshot b9af27fc-7a44-45c6-8be9-9ba73238a513 {{(pid=88413) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "cinder-quobyte-fe488328-1cb2-4f5b-b44b-8a89c7afa7c5" by "_copy_volume_from_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-quobyte-fe488328-1cb2-4f5b-b44b-8a89c7afa7c5" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] snapshot: b9af27fc-7a44-45c6-8be9-9ba73238a513, volume: fe488328-1cb2-4f5b-b44b-8a89c7afa7c5, {{(pid=88413) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d14dcc7-be98-4bd1-bde8-1ad47480d46d]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c.b9af27fc-7a44-45c6-8be9-9ba73238a513 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:15 devstack sudo[100415]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ebb23b81-45e5-4657-9c09-78166d74c638 tempest-CreateVolumesFromImageTest-1219366183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-01661c99-fc9d-41d3-af7a-ed32ceba0a07" returned: 0 in 0.315s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ebb23b81-45e5-4657-9c09-78166d74c638 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "cinder-quobyte-01661c99-fc9d-41d3-af7a-ed32ceba0a07" released by "delete_volume" :: held 1.054s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:15 devstack sudo[100417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c.b9af27fc-7a44-45c6-8be9-9ba73238a513 Jul 28 10:46:15 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-ebb23b81-45e5-4657-9c09-78166d74c638 tempest-CreateVolumesFromImageTest-1219366183 None] Created reservations ['14cca036-89b8-4d5c-bd96-0f589905089d', 'e52e3777-c11b-492b-b379-b606835b7142', '6148d880-9041-4f23-8450-1b9e3d503e9c', '8dd70b1c-eaca-4118-8699-e7a37b04d9c2'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ebb23b81-45e5-4657-9c09-78166d74c638 tempest-CreateVolumesFromImageTest-1219366183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ebb23b81-45e5-4657-9c09-78166d74c638 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-ebb23b81-45e5-4657-9c09-78166d74c638 tempest-CreateVolumesFromImageTest-1219366183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-ebb23b81-45e5-4657-9c09-78166d74c638 tempest-CreateVolumesFromImageTest-1219366183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ebb23b81-45e5-4657-9c09-78166d74c638 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ebb23b81-45e5-4657-9c09-78166d74c638 tempest-CreateVolumesFromImageTest-1219366183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:15 devstack sudo[100420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:46:15 devstack sudo[100420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:15 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c.b9af27fc-7a44-45c6-8be9-9ba73238a513" returned: 0 in 0.477s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c {{(pid=88413) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Creating direct copy from snapshot {{(pid=88413) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[326140d3-870a-49f6-92fc-1b0ccd1402e5]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:15 devstack sudo[100420]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ebb23b81-45e5-4657-9c09-78166d74c638 tempest-CreateVolumesFromImageTest-1219366183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.309s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-ebb23b81-45e5-4657-9c09-78166d74c638 tempest-CreateVolumesFromImageTest-1219366183 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:46:15 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-ebb23b81-45e5-4657-9c09-78166d74c638 tempest-CreateVolumesFromImageTest-1219366183 None] Deleted volume successfully. Jul 28 10:46:15 devstack sudo[100425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c Jul 28 10:46:15 devstack sudo[100425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:15 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ebb23b81-45e5-4657-9c09-78166d74c638 tempest-CreateVolumesFromImageTest-1219366183 None] Lock "cinder-01661c99-fc9d-41d3-af7a-ed32ceba0a07-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:16 devstack sudo[100425]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c" returned: 0 in 0.441s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:16 devstack cinder-volume[88413]: DEBUG cinder.utils [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Path /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-fe488328-1cb2-4f5b-b44b-8a89c7afa7c5 not found in is_blk_device check {{(pid=88413) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 28 10:46:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-fe488328-1cb2-4f5b-b44b-8a89c7afa7c5 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:16 devstack sudo[100438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-fe488328-1cb2-4f5b-b44b-8a89c7afa7c5 Jul 28 10:46:16 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-294a88c5-b65e-4f08-bbef-a2d0eefb81a6 req-e0193911-e75a-46db-925d-16a7a7199552 tempest-TestInstancesWithCinderVolumes-733670174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:22 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-fe488328-1cb2-4f5b-b44b-8a89c7afa7c5" returned: 0 in 6.170s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:22 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a9c43b-5c68-43bf-912a-03c79a5786e4]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:22 devstack sudo[100503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c Jul 28 10:46:22 devstack sudo[100503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:23 devstack sudo[100503]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c" returned: 0 in 0.607s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:23 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c, size 1024.00 MB, duration 6.17 sec, destination /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-fe488328-1cb2-4f5b-b44b-8a89c7afa7c5 {{(pid=88413) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 10:46:23 devstack cinder-volume[88413]: INFO cinder.image.image_utils [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Converted 1024.00 MB image at 165.95 MB/s Jul 28 10:46:23 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-fe488328-1cb2-4f5b-b44b-8a89c7afa7c5 is being set with open permissions: ugo+rw Jul 28 10:46:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-fe488328-1cb2-4f5b-b44b-8a89c7afa7c5 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:23 devstack sudo[100508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-fe488328-1cb2-4f5b-b44b-8a89c7afa7c5 Jul 28 10:46:23 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-fe488328-1cb2-4f5b-b44b-8a89c7afa7c5" returned: 0 in 0.314s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:23 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:23 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-quobyte-fe488328-1cb2-4f5b-b44b-8a89c7afa7c5" released by "_copy_volume_from_snapshot" :: held 8.155s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:23 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-quobyte-b9af27fc-7a44-45c6-8be9-9ba73238a513-fe488328-1cb2-4f5b-b44b-8a89c7afa7c5" released by "_create_volume_from_snapshot" :: held 8.200s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.218s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-294a88c5-b65e-4f08-bbef-a2d0eefb81a6 req-e0193911-e75a-46db-925d-16a7a7199552 tempest-TestInstancesWithCinderVolumes-733670174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.383s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-294a88c5-b65e-4f08-bbef-a2d0eefb81a6 req-e0193911-e75a-46db-925d-16a7a7199552 tempest-TestInstancesWithCinderVolumes-733670174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:23 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6947ebe1-c180-4ca9-8d4e-648c0df8830f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe488328-1cb2-4f5b-b44b-8a89c7afa7c5', 'volume_size': 2, 'snapshot_id': 'b9af27fc-7a44-45c6-8be9-9ba73238a513'}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:23 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e505736-1799-4e70-973b-7d5688fe772a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:23 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Volume volume-fe488328-1cb2-4f5b-b44b-8a89c7afa7c5 (fe488328-1cb2-4f5b-b44b-8a89c7afa7c5): created successfully Jul 28 10:46:23 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e505736-1799-4e70-973b-7d5688fe772a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:23 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Flow 'volume_create_manager' (8e496e46-e2a8-4742-b9dd-2864a1ff7c82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:46:23 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-34b4dba7-7bea-40c9-84cf-90adbc1771cf tempest-CreateVolumesFromSnapshotTest-587921535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:46:23 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-34b4dba7-7bea-40c9-84cf-90adbc1771cf tempest-CreateVolumesFromSnapshotTest-587921535 None] Flow 'volume_create_manager' (3d7042c8-2ce7-4382-88b6-93b89bdc1e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:46:23 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-34b4dba7-7bea-40c9-84cf-90adbc1771cf tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0401cc9c-f577-4cf0-badd-026781692986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:23 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-34b4dba7-7bea-40c9-84cf-90adbc1771cf tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0401cc9c-f577-4cf0-badd-026781692986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-930959304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8c20e6b-2c90-4a6e-a77f-96a62f6103a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c38951ff47584c2f94161f994def8b24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:46:23Z,use_quota=True,user_id='83a21605d1ad4f3f8e0cff3c5a1cfdf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:23 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-34b4dba7-7bea-40c9-84cf-90adbc1771cf tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e3f83a-49c8-47cb-b1b3-225cfd99adea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:23 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-34b4dba7-7bea-40c9-84cf-90adbc1771cf tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e3f83a-49c8-47cb-b1b3-225cfd99adea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:23 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-34b4dba7-7bea-40c9-84cf-90adbc1771cf tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4ceb650-47c9-41bf-9f39-868e95251c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:23 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-34b4dba7-7bea-40c9-84cf-90adbc1771cf tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4ceb650-47c9-41bf-9f39-868e95251c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8c20e6b-2c90-4a6e-a77f-96a62f6103a6', 'volume_name': 'volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:23 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-34b4dba7-7bea-40c9-84cf-90adbc1771cf tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50966327-aef2-4268-91ca-0ea64a517cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:23 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-34b4dba7-7bea-40c9-84cf-90adbc1771cf tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50966327-aef2-4268-91ca-0ea64a517cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:23 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-34b4dba7-7bea-40c9-84cf-90adbc1771cf tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02f5e126-8f30-4ac3-9dd8-cde9aaa815a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:23 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-34b4dba7-7bea-40c9-84cf-90adbc1771cf tempest-CreateVolumesFromSnapshotTest-587921535 None] Volume c8c20e6b-2c90-4a6e-a77f-96a62f6103a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6', 'volume_size': 1} Jul 28 10:46:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-34b4dba7-7bea-40c9-84cf-90adbc1771cf tempest-CreateVolumesFromSnapshotTest-587921535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-34b4dba7-7bea-40c9-84cf-90adbc1771cf tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:23 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-34b4dba7-7bea-40c9-84cf-90adbc1771cf tempest-CreateVolumesFromSnapshotTest-587921535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-930959304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8c20e6b-2c90-4a6e-a77f-96a62f6103a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c38951ff47584c2f94161f994def8b24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:46:23Z,use_quota=True,user_id='83a21605d1ad4f3f8e0cff3c5a1cfdf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:46:23 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-34b4dba7-7bea-40c9-84cf-90adbc1771cf tempest-CreateVolumesFromSnapshotTest-587921535 None] Creating volume c8c20e6b-2c90-4a6e-a77f-96a62f6103a6 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:46:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-34b4dba7-7bea-40c9-84cf-90adbc1771cf tempest-CreateVolumesFromSnapshotTest-587921535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-34b4dba7-7bea-40c9-84cf-90adbc1771cf tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:23 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-34b4dba7-7bea-40c9-84cf-90adbc1771cf tempest-CreateVolumesFromSnapshotTest-587921535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:46:23 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-34b4dba7-7bea-40c9-84cf-90adbc1771cf tempest-CreateVolumesFromSnapshotTest-587921535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:46:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-34b4dba7-7bea-40c9-84cf-90adbc1771cf tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:23 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-34b4dba7-7bea-40c9-84cf-90adbc1771cf tempest-CreateVolumesFromSnapshotTest-587921535 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:46:23 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-34b4dba7-7bea-40c9-84cf-90adbc1771cf tempest-CreateVolumesFromSnapshotTest-587921535 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:46:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-34b4dba7-7bea-40c9-84cf-90adbc1771cf tempest-CreateVolumesFromSnapshotTest-587921535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:23 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-294a88c5-b65e-4f08-bbef-a2d0eefb81a6 req-e0193911-e75a-46db-925d-16a7a7199552 tempest-TestInstancesWithCinderVolumes-733670174 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7', 'name': 'volume-df86a441-a123-41e8-9fd9-f062ec3b9905', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7ad0283d-53ed-4599-863a-ec6e4d0d5857', 'enforce_multipath': True} {{(pid=88413) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 10:46:23 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-9779dbc0-c40f-4de4-9bcb-e20322a40c73 tempest-VolumesSnapshotTestJSON-50191109 None] Created volume successfully. Jul 28 10:46:23 devstack sudo[100511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6 1073741824 Jul 28 10:46:23 devstack sudo[100511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:23 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-294a88c5-b65e-4f08-bbef-a2d0eefb81a6 req-e0193911-e75a-46db-925d-16a7a7199552 tempest-TestInstancesWithCinderVolumes-733670174 None] attachment_update completed successfully. Jul 28 10:46:24 devstack sudo[100511]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-34b4dba7-7bea-40c9-84cf-90adbc1771cf tempest-CreateVolumesFromSnapshotTest-587921535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6 1073741824" returned: 0 in 0.557s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-34b4dba7-7bea-40c9-84cf-90adbc1771cf tempest-CreateVolumesFromSnapshotTest-587921535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:24 devstack sudo[100522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6 Jul 28 10:46:24 devstack sudo[100522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:24 devstack sudo[100522]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-34b4dba7-7bea-40c9-84cf-90adbc1771cf tempest-CreateVolumesFromSnapshotTest-587921535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6" returned: 0 in 0.326s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:24 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-34b4dba7-7bea-40c9-84cf-90adbc1771cf tempest-CreateVolumesFromSnapshotTest-587921535 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:46:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-34b4dba7-7bea-40c9-84cf-90adbc1771cf tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:24 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-34b4dba7-7bea-40c9-84cf-90adbc1771cf tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02f5e126-8f30-4ac3-9dd8-cde9aaa815a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:24 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-34b4dba7-7bea-40c9-84cf-90adbc1771cf tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (311273db-352b-4278-8cf4-da7159bd65be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:24 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-34b4dba7-7bea-40c9-84cf-90adbc1771cf tempest-CreateVolumesFromSnapshotTest-587921535 None] Volume volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6 (c8c20e6b-2c90-4a6e-a77f-96a62f6103a6): created successfully Jul 28 10:46:24 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-34b4dba7-7bea-40c9-84cf-90adbc1771cf tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (311273db-352b-4278-8cf4-da7159bd65be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:24 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-34b4dba7-7bea-40c9-84cf-90adbc1771cf tempest-CreateVolumesFromSnapshotTest-587921535 None] Flow 'volume_create_manager' (3d7042c8-2ce7-4382-88b6-93b89bdc1e5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:46:24 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-34b4dba7-7bea-40c9-84cf-90adbc1771cf tempest-CreateVolumesFromSnapshotTest-587921535 None] Created volume successfully. Jul 28 10:46:24 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-13855a43-75f3-4516-b992-46251fe3a296 tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "cinder-fe488328-1cb2-4f5b-b44b-8a89c7afa7c5-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:24 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-13855a43-75f3-4516-b992-46251fe3a296 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-fe488328-1cb2-4f5b-b44b-8a89c7afa7c5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:24 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-13855a43-75f3-4516-b992-46251fe3a296 tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "cinder-quobyte-fe488328-1cb2-4f5b-b44b-8a89c7afa7c5" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:24 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-13855a43-75f3-4516-b992-46251fe3a296 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-quobyte-fe488328-1cb2-4f5b-b44b-8a89c7afa7c5" acquired by "delete_volume" :: waited 0.016s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:24 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[b627efe7-29c6-4290-835d-ed02e60cd5b6]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-13855a43-75f3-4516-b992-46251fe3a296 tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-fe488328-1cb2-4f5b-b44b-8a89c7afa7c5 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:24 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-fe488328-1cb2-4f5b-b44b-8a89c7afa7c5 Jul 28 10:46:24 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:25 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-13855a43-75f3-4516-b992-46251fe3a296 tempest-VolumesSnapshotTestJSON-50191109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-fe488328-1cb2-4f5b-b44b-8a89c7afa7c5" returned: 0 in 0.371s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-13855a43-75f3-4516-b992-46251fe3a296 tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-fe488328-1cb2-4f5b-b44b-8a89c7afa7c5 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:25 devstack sudo[100530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-fe488328-1cb2-4f5b-b44b-8a89c7afa7c5 Jul 28 10:46:25 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:25 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-13855a43-75f3-4516-b992-46251fe3a296 tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-fe488328-1cb2-4f5b-b44b-8a89c7afa7c5" returned: 0 in 0.248s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:25 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-13855a43-75f3-4516-b992-46251fe3a296 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-quobyte-fe488328-1cb2-4f5b-b44b-8a89c7afa7c5" released by "delete_volume" :: held 0.663s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:25 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-13855a43-75f3-4516-b992-46251fe3a296 tempest-VolumesSnapshotTestJSON-50191109 None] Created reservations ['ac460c9f-23b9-4490-9e70-17b528a29e98', '48ab46ea-03f1-4589-83d6-d966888f4ce4', '5122c939-890f-479d-b95a-c3c502c87855', '90597eb9-0f74-467d-9156-b568997a2e5d'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:46:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-13855a43-75f3-4516-b992-46251fe3a296 tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-13855a43-75f3-4516-b992-46251fe3a296 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:25 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-13855a43-75f3-4516-b992-46251fe3a296 tempest-VolumesSnapshotTestJSON-50191109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:46:25 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-13855a43-75f3-4516-b992-46251fe3a296 tempest-VolumesSnapshotTestJSON-50191109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:46:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-13855a43-75f3-4516-b992-46251fe3a296 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-13855a43-75f3-4516-b992-46251fe3a296 tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:25 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:46:25 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:25 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-2d484b73-2c25-4b3f-b8de-ab28c0cf8088 tempest-CreateVolumesFromSnapshotTest-587921535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-2d484b73-2c25-4b3f-b8de-ab28c0cf8088 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-13855a43-75f3-4516-b992-46251fe3a296 tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.357s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:25 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-13855a43-75f3-4516-b992-46251fe3a296 tempest-VolumesSnapshotTestJSON-50191109 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:46:25 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-13855a43-75f3-4516-b992-46251fe3a296 tempest-VolumesSnapshotTestJSON-50191109 None] Deleted volume successfully. Jul 28 10:46:25 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-2d484b73-2c25-4b3f-b8de-ab28c0cf8088 tempest-CreateVolumesFromSnapshotTest-587921535 None] Creating offline snapshot 71ed53c3-f2ff-4612-a43c-66e95b4e0756 of volume c8c20e6b-2c90-4a6e-a77f-96a62f6103a6 {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:46:25 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-13855a43-75f3-4516-b992-46251fe3a296 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-fe488328-1cb2-4f5b-b44b-8a89c7afa7c5-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:25 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcfe7ae-bbeb-428a-9a33-4ebb0ff84313]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2d484b73-2c25-4b3f-b8de-ab28c0cf8088 tempest-CreateVolumesFromSnapshotTest-587921535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:26 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0dc82d8d-58a4-4df6-bed8-b4cd0346455a tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "cinder-b9af27fc-7a44-45c6-8be9-9ba73238a513-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:26 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0dc82d8d-58a4-4df6-bed8-b4cd0346455a tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-b9af27fc-7a44-45c6-8be9-9ba73238a513-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:26 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0dc82d8d-58a4-4df6-bed8-b4cd0346455a tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "cinder-quobyte-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:26 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0dc82d8d-58a4-4df6-bed8-b4cd0346455a tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-quobyte-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:26 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0dc82d8d-58a4-4df6-bed8-b4cd0346455a tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "cinder-quobyte-b9af27fc-7a44-45c6-8be9-9ba73238a513" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:26 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0dc82d8d-58a4-4df6-bed8-b4cd0346455a tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-quobyte-b9af27fc-7a44-45c6-8be9-9ba73238a513" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:26 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-0dc82d8d-58a4-4df6-bed8-b4cd0346455a tempest-VolumesSnapshotTestJSON-50191109 None] Deleting offline snapshot b9af27fc-7a44-45c6-8be9-9ba73238a513 of volume 0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:46:26 devstack sudo[100542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6 Jul 28 10:46:26 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:26 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-0dc82d8d-58a4-4df6-bed8-b4cd0346455a tempest-VolumesSnapshotTestJSON-50191109 None] snapshot_file for this snap is: volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c.b9af27fc-7a44-45c6-8be9-9ba73238a513 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:46:26 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62bcfe1-4949-4aef-912b-ef83353e4e14]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0dc82d8d-58a4-4df6-bed8-b4cd0346455a tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c.b9af27fc-7a44-45c6-8be9-9ba73238a513 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:26 devstack sudo[100544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c.b9af27fc-7a44-45c6-8be9-9ba73238a513 Jul 28 10:46:26 devstack sudo[100544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:26 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2d484b73-2c25-4b3f-b8de-ab28c0cf8088 tempest-CreateVolumesFromSnapshotTest-587921535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6" returned: 0 in 0.476s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2d484b73-2c25-4b3f-b8de-ab28c0cf8088 tempest-CreateVolumesFromSnapshotTest-587921535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6.71ed53c3-f2ff-4612-a43c-66e95b4e0756 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:26 devstack sudo[100552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6.71ed53c3-f2ff-4612-a43c-66e95b4e0756 1G Jul 28 10:46:26 devstack sudo[100552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:26 devstack sudo[100544]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0dc82d8d-58a4-4df6-bed8-b4cd0346455a tempest-VolumesSnapshotTestJSON-50191109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c.b9af27fc-7a44-45c6-8be9-9ba73238a513" returned: 0 in 0.456s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:26 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-0dc82d8d-58a4-4df6-bed8-b4cd0346455a tempest-VolumesSnapshotTestJSON-50191109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:46:26 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd512ce-443f-412f-9949-d526f690ca49]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0dc82d8d-58a4-4df6-bed8-b4cd0346455a tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:26 devstack sudo[100557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c Jul 28 10:46:26 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:27 devstack sudo[100552]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2d484b73-2c25-4b3f-b8de-ab28c0cf8088 tempest-CreateVolumesFromSnapshotTest-587921535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6.71ed53c3-f2ff-4612-a43c-66e95b4e0756 1G" returned: 0 in 0.538s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2d484b73-2c25-4b3f-b8de-ab28c0cf8088 tempest-CreateVolumesFromSnapshotTest-587921535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6.71ed53c3-f2ff-4612-a43c-66e95b4e0756 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:27 devstack sudo[100563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6.71ed53c3-f2ff-4612-a43c-66e95b4e0756 Jul 28 10:46:27 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:27 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0dc82d8d-58a4-4df6-bed8-b4cd0346455a tempest-VolumesSnapshotTestJSON-50191109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c" returned: 0 in 0.595s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0dc82d8d-58a4-4df6-bed8-b4cd0346455a tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c.b9af27fc-7a44-45c6-8be9-9ba73238a513 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:27 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c.b9af27fc-7a44-45c6-8be9-9ba73238a513 Jul 28 10:46:27 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:27 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2d484b73-2c25-4b3f-b8de-ab28c0cf8088 tempest-CreateVolumesFromSnapshotTest-587921535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6.71ed53c3-f2ff-4612-a43c-66e95b4e0756" returned: 0 in 0.438s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:27 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-2d484b73-2c25-4b3f-b8de-ab28c0cf8088 tempest-CreateVolumesFromSnapshotTest-587921535 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6.71ed53c3-f2ff-4612-a43c-66e95b4e0756 is being set with open permissions: ugo+rw Jul 28 10:46:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2d484b73-2c25-4b3f-b8de-ab28c0cf8088 tempest-CreateVolumesFromSnapshotTest-587921535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6.71ed53c3-f2ff-4612-a43c-66e95b4e0756 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:27 devstack sudo[100581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6.71ed53c3-f2ff-4612-a43c-66e95b4e0756 Jul 28 10:46:27 devstack sudo[100581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-86d23e1d-7ff8-4ddd-bd24-7664859dc1f8 req-4d0ad287-0ad9-4569-b4ab-a5d87c6f123e tempest-TestInstancesWithCinderVolumes-733670174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:27 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0dc82d8d-58a4-4df6-bed8-b4cd0346455a tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c.b9af27fc-7a44-45c6-8be9-9ba73238a513" returned: 0 in 0.397s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0dc82d8d-58a4-4df6-bed8-b4cd0346455a tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c.b9af27fc-7a44-45c6-8be9-9ba73238a513 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:27 devstack sudo[100587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c.b9af27fc-7a44-45c6-8be9-9ba73238a513 Jul 28 10:46:27 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:27 devstack sudo[100581]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2d484b73-2c25-4b3f-b8de-ab28c0cf8088 tempest-CreateVolumesFromSnapshotTest-587921535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6.71ed53c3-f2ff-4612-a43c-66e95b4e0756" returned: 0 in 0.277s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2d484b73-2c25-4b3f-b8de-ab28c0cf8088 tempest-CreateVolumesFromSnapshotTest-587921535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:27 devstack sudo[100589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6.info Jul 28 10:46:27 devstack sudo[100589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:28 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0dc82d8d-58a4-4df6-bed8-b4cd0346455a tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c.b9af27fc-7a44-45c6-8be9-9ba73238a513" returned: 0 in 0.317s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0dc82d8d-58a4-4df6-bed8-b4cd0346455a tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-quobyte-b9af27fc-7a44-45c6-8be9-9ba73238a513" released by "_delete_snapshot" :: held 1.935s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0dc82d8d-58a4-4df6-bed8-b4cd0346455a tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-quobyte-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c" released by "delete_snapshot" :: held 1.969s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:28 devstack sudo[100589]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2d484b73-2c25-4b3f-b8de-ab28c0cf8088 tempest-CreateVolumesFromSnapshotTest-587921535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6.info" returned: 0 in 0.321s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:28 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-2d484b73-2c25-4b3f-b8de-ab28c0cf8088 tempest-CreateVolumesFromSnapshotTest-587921535 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6.info is being set with open permissions: ugo+rw Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2d484b73-2c25-4b3f-b8de-ab28c0cf8088 tempest-CreateVolumesFromSnapshotTest-587921535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:28 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6.info Jul 28 10:46:28 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5779379-d618-41a8-ad4d-444070dded4c tempest-VolumeTypesAccessTest-641722930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e5779379-d618-41a8-ad4d-444070dded4c tempest-VolumeTypesAccessTest-641722930 None] Flow 'volume_create_manager' (3f4c3d94-1358-4aaf-acb4-25b738335e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e5779379-d618-41a8-ad4d-444070dded4c tempest-VolumeTypesAccessTest-641722930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d26388e4-e3ca-4c97-867c-d0ba5325cc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e5779379-d618-41a8-ad4d-444070dded4c tempest-VolumeTypesAccessTest-641722930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d26388e4-e3ca-4c97-867c-d0ba5325cc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1273626061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dddbcea7-f4a9-4103-a1ae-a34a18d5908c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3652b52cac4c9c91db429a1c715a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:46:28Z,use_quota=True,user_id='4883dcd623b44ac68f5daed618ad3751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(043d0e7d-1f0c-4e0a-a9fe-d2e79072a400),volume_type_id=043d0e7d-1f0c-4e0a-a9fe-d2e79072a400)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e5779379-d618-41a8-ad4d-444070dded4c tempest-VolumeTypesAccessTest-641722930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c78ecabf-be6e-4b91-a76f-f674657d4e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e5779379-d618-41a8-ad4d-444070dded4c tempest-VolumeTypesAccessTest-641722930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c78ecabf-be6e-4b91-a76f-f674657d4e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e5779379-d618-41a8-ad4d-444070dded4c tempest-VolumeTypesAccessTest-641722930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b79458f3-235b-46b0-900c-647fe40fd5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e5779379-d618-41a8-ad4d-444070dded4c tempest-VolumeTypesAccessTest-641722930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b79458f3-235b-46b0-900c-647fe40fd5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dddbcea7-f4a9-4103-a1ae-a34a18d5908c', 'volume_name': 'volume-dddbcea7-f4a9-4103-a1ae-a34a18d5908c', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e5779379-d618-41a8-ad4d-444070dded4c tempest-VolumeTypesAccessTest-641722930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ece69bef-f4d0-4f47-8b2b-791858e32cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e5779379-d618-41a8-ad4d-444070dded4c tempest-VolumeTypesAccessTest-641722930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ece69bef-f4d0-4f47-8b2b-791858e32cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e5779379-d618-41a8-ad4d-444070dded4c tempest-VolumeTypesAccessTest-641722930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ae7030-c996-47b6-ab42-e3aefe1f3453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:28 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-e5779379-d618-41a8-ad4d-444070dded4c tempest-VolumeTypesAccessTest-641722930 None] Volume dddbcea7-f4a9-4103-a1ae-a34a18d5908c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dddbcea7-f4a9-4103-a1ae-a34a18d5908c', 'volume_size': 1} Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e5779379-d618-41a8-ad4d-444070dded4c tempest-VolumeTypesAccessTest-641722930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-0dc82d8d-58a4-4df6-bed8-b4cd0346455a tempest-VolumesSnapshotTestJSON-50191109 None] Created reservations ['17203793-2f22-4ae2-aeed-483ba518d241', '3b3370f3-33ba-42a6-b241-d454cb9cdfb5', 'a9c8f071-2d88-4145-8b63-108f2d4f1de6', '527e376d-5f7e-48da-b070-47fdf48fc2df'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:46:28 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-0dc82d8d-58a4-4df6-bed8-b4cd0346455a tempest-VolumesSnapshotTestJSON-50191109 None] Delete snapshot completed successfully. Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0dc82d8d-58a4-4df6-bed8-b4cd0346455a tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-b9af27fc-7a44-45c6-8be9-9ba73238a513-delete_snapshot" released by "delete_snapshot" :: held 2.237s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:28 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2d484b73-2c25-4b3f-b8de-ab28c0cf8088 tempest-CreateVolumesFromSnapshotTest-587921535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6.info" returned: 0 in 0.264s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-2d484b73-2c25-4b3f-b8de-ab28c0cf8088 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.452s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-86d23e1d-7ff8-4ddd-bd24-7664859dc1f8 req-4d0ad287-0ad9-4569-b4ab-a5d87c6f123e tempest-TestInstancesWithCinderVolumes-733670174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.796s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-86d23e1d-7ff8-4ddd-bd24-7664859dc1f8 req-4d0ad287-0ad9-4569-b4ab-a5d87c6f123e tempest-TestInstancesWithCinderVolumes-733670174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e5779379-d618-41a8-ad4d-444070dded4c tempest-VolumeTypesAccessTest-641722930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.172s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e5779379-d618-41a8-ad4d-444070dded4c tempest-VolumeTypesAccessTest-641722930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1273626061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dddbcea7-f4a9-4103-a1ae-a34a18d5908c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3652b52cac4c9c91db429a1c715a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:46:28Z,use_quota=True,user_id='4883dcd623b44ac68f5daed618ad3751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(043d0e7d-1f0c-4e0a-a9fe-d2e79072a400),volume_type_id=043d0e7d-1f0c-4e0a-a9fe-d2e79072a400)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-e5779379-d618-41a8-ad4d-444070dded4c tempest-VolumeTypesAccessTest-641722930 None] Creating volume dddbcea7-f4a9-4103-a1ae-a34a18d5908c {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e5779379-d618-41a8-ad4d-444070dded4c tempest-VolumeTypesAccessTest-641722930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e5779379-d618-41a8-ad4d-444070dded4c tempest-VolumeTypesAccessTest-641722930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e5779379-d618-41a8-ad4d-444070dded4c tempest-VolumeTypesAccessTest-641722930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:46:28 devstack sudo[100596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:46:28 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e5779379-d618-41a8-ad4d-444070dded4c tempest-VolumeTypesAccessTest-641722930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e5779379-d618-41a8-ad4d-444070dded4c tempest-VolumeTypesAccessTest-641722930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e5779379-d618-41a8-ad4d-444070dded4c tempest-VolumeTypesAccessTest-641722930 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:46:28 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-e5779379-d618-41a8-ad4d-444070dded4c tempest-VolumeTypesAccessTest-641722930 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e5779379-d618-41a8-ad4d-444070dded4c tempest-VolumeTypesAccessTest-641722930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-dddbcea7-f4a9-4103-a1ae-a34a18d5908c 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:28 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-2d484b73-2c25-4b3f-b8de-ab28c0cf8088 tempest-CreateVolumesFromSnapshotTest-587921535 None] Create snapshot completed successfully Jul 28 10:46:28 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-dddbcea7-f4a9-4103-a1ae-a34a18d5908c 1073741824 Jul 28 10:46:28 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-86d23e1d-7ff8-4ddd-bd24-7664859dc1f8 req-4d0ad287-0ad9-4569-b4ab-a5d87c6f123e tempest-TestInstancesWithCinderVolumes-733670174 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7', 'name': 'volume-cff137d9-a2cd-420a-bf49-143187d1d0de', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '83560388-6ca1-4592-9114-979d836ead50', 'enforce_multipath': True} {{(pid=88413) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 10:46:28 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-86d23e1d-7ff8-4ddd-bd24-7664859dc1f8 req-4d0ad287-0ad9-4569-b4ab-a5d87c6f123e tempest-TestInstancesWithCinderVolumes-733670174 None] attachment_update completed successfully. Jul 28 10:46:28 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.259s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager._thread_info {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread count: 29 {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread info: [<_MainThread(MainThread, started 137939890385024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 10:46:28 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e5779379-d618-41a8-ad4d-444070dded4c tempest-VolumeTypesAccessTest-641722930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-dddbcea7-f4a9-4103-a1ae-a34a18d5908c 1073741824" returned: 0 in 0.466s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e5779379-d618-41a8-ad4d-444070dded4c tempest-VolumeTypesAccessTest-641722930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-dddbcea7-f4a9-4103-a1ae-a34a18d5908c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:28 devstack sudo[100609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-dddbcea7-f4a9-4103-a1ae-a34a18d5908c Jul 28 10:46:28 devstack sudo[100609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:29 devstack sudo[100609]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e5779379-d618-41a8-ad4d-444070dded4c tempest-VolumeTypesAccessTest-641722930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-dddbcea7-f4a9-4103-a1ae-a34a18d5908c" returned: 0 in 0.331s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:29 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e5779379-d618-41a8-ad4d-444070dded4c tempest-VolumeTypesAccessTest-641722930 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:46:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e5779379-d618-41a8-ad4d-444070dded4c tempest-VolumeTypesAccessTest-641722930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e5779379-d618-41a8-ad4d-444070dded4c tempest-VolumeTypesAccessTest-641722930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ae7030-c996-47b6-ab42-e3aefe1f3453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dddbcea7-f4a9-4103-a1ae-a34a18d5908c', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e5779379-d618-41a8-ad4d-444070dded4c tempest-VolumeTypesAccessTest-641722930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (663ba205-24cd-4385-a3ce-05a0d20e63ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:29 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-e5779379-d618-41a8-ad4d-444070dded4c tempest-VolumeTypesAccessTest-641722930 None] Volume volume-dddbcea7-f4a9-4103-a1ae-a34a18d5908c (dddbcea7-f4a9-4103-a1ae-a34a18d5908c): created successfully Jul 28 10:46:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e5779379-d618-41a8-ad4d-444070dded4c tempest-VolumeTypesAccessTest-641722930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (663ba205-24cd-4385-a3ce-05a0d20e63ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e5779379-d618-41a8-ad4d-444070dded4c tempest-VolumeTypesAccessTest-641722930 None] Flow 'volume_create_manager' (3f4c3d94-1358-4aaf-acb4-25b738335e5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:46:29 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-e5779379-d618-41a8-ad4d-444070dded4c tempest-VolumeTypesAccessTest-641722930 None] Created volume successfully. Jul 28 10:46:29 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e710474c-b70b-44c7-ab44-74fde4220b04 tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "cinder-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:29 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e710474c-b70b-44c7-ab44-74fde4220b04 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:29 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e710474c-b70b-44c7-ab44-74fde4220b04 tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "cinder-quobyte-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:29 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e710474c-b70b-44c7-ab44-74fde4220b04 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-quobyte-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c" acquired by "delete_volume" :: waited 0.022s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:29 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb8a051-a140-4e66-a681-89976d84407c]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e710474c-b70b-44c7-ab44-74fde4220b04 tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:29 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c Jul 28 10:46:29 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:29 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-78b710a7-99a1-4010-a739-6395c637ce2f tempest-CreateVolumesFromSnapshotTest-587921535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:46:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-78b710a7-99a1-4010-a739-6395c637ce2f tempest-CreateVolumesFromSnapshotTest-587921535 None] Flow 'volume_create_manager' (d99f9e8f-8cb5-480f-b1bf-f9b861ea30bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:46:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-78b710a7-99a1-4010-a739-6395c637ce2f tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa495635-2e0e-4d59-98fd-a8600454e61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-78b710a7-99a1-4010-a739-6395c637ce2f tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa495635-2e0e-4d59-98fd-a8600454e61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1635373736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03f757b2-9da3-4983-be96-2fac4121b60d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c38951ff47584c2f94161f994def8b24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:46:30Z,use_quota=True,user_id='83a21605d1ad4f3f8e0cff3c5a1cfdf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-78b710a7-99a1-4010-a739-6395c637ce2f tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ea48a13-9895-4dd5-bad6-9d28a2c60490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-78b710a7-99a1-4010-a739-6395c637ce2f tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ea48a13-9895-4dd5-bad6-9d28a2c60490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-78b710a7-99a1-4010-a739-6395c637ce2f tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e56f2b3-463f-4c09-8899-78c867237bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-78b710a7-99a1-4010-a739-6395c637ce2f tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e56f2b3-463f-4c09-8899-78c867237bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03f757b2-9da3-4983-be96-2fac4121b60d', 'volume_name': 'volume-03f757b2-9da3-4983-be96-2fac4121b60d', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-78b710a7-99a1-4010-a739-6395c637ce2f tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e49f4c6a-74da-4fc5-9949-f14330ccaa1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-78b710a7-99a1-4010-a739-6395c637ce2f tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e49f4c6a-74da-4fc5-9949-f14330ccaa1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-78b710a7-99a1-4010-a739-6395c637ce2f tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f20cbfba-aacb-4ada-82b2-ccad5c28506e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:29 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-78b710a7-99a1-4010-a739-6395c637ce2f tempest-CreateVolumesFromSnapshotTest-587921535 None] Volume 03f757b2-9da3-4983-be96-2fac4121b60d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03f757b2-9da3-4983-be96-2fac4121b60d', 'volume_size': 1} Jul 28 10:46:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-78b710a7-99a1-4010-a739-6395c637ce2f tempest-CreateVolumesFromSnapshotTest-587921535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-78b710a7-99a1-4010-a739-6395c637ce2f tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:29 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-78b710a7-99a1-4010-a739-6395c637ce2f tempest-CreateVolumesFromSnapshotTest-587921535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1635373736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03f757b2-9da3-4983-be96-2fac4121b60d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c38951ff47584c2f94161f994def8b24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:46:30Z,use_quota=True,user_id='83a21605d1ad4f3f8e0cff3c5a1cfdf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:46:29 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-78b710a7-99a1-4010-a739-6395c637ce2f tempest-CreateVolumesFromSnapshotTest-587921535 None] Creating volume 03f757b2-9da3-4983-be96-2fac4121b60d {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:46:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-78b710a7-99a1-4010-a739-6395c637ce2f tempest-CreateVolumesFromSnapshotTest-587921535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-78b710a7-99a1-4010-a739-6395c637ce2f tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:29 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-78b710a7-99a1-4010-a739-6395c637ce2f tempest-CreateVolumesFromSnapshotTest-587921535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:46:29 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-78b710a7-99a1-4010-a739-6395c637ce2f tempest-CreateVolumesFromSnapshotTest-587921535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:46:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-78b710a7-99a1-4010-a739-6395c637ce2f tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:29 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-78b710a7-99a1-4010-a739-6395c637ce2f tempest-CreateVolumesFromSnapshotTest-587921535 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:46:29 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-78b710a7-99a1-4010-a739-6395c637ce2f tempest-CreateVolumesFromSnapshotTest-587921535 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:46:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-78b710a7-99a1-4010-a739-6395c637ce2f tempest-CreateVolumesFromSnapshotTest-587921535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-03f757b2-9da3-4983-be96-2fac4121b60d 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:29 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-03f757b2-9da3-4983-be96-2fac4121b60d 1073741824 Jul 28 10:46:29 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:30 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e710474c-b70b-44c7-ab44-74fde4220b04 tempest-VolumesSnapshotTestJSON-50191109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c" returned: 0 in 0.505s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e710474c-b70b-44c7-ab44-74fde4220b04 tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:30 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c Jul 28 10:46:30 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:30 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-a60ce7dd-caa4-47cb-bb1d-70c6f74226da tempest-CreateVolumesFromSnapshotTest-587921535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:46:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a60ce7dd-caa4-47cb-bb1d-70c6f74226da tempest-CreateVolumesFromSnapshotTest-587921535 None] Flow 'volume_create_manager' (f087c9ea-a05b-43eb-93d5-0f016878201d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:46:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a60ce7dd-caa4-47cb-bb1d-70c6f74226da tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47f9f5b4-8c7d-40d4-acab-22f26cd321fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a60ce7dd-caa4-47cb-bb1d-70c6f74226da tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47f9f5b4-8c7d-40d4-acab-22f26cd321fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-475813516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c469d9f-c361-4fd1-89ea-6d547c0d4b63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c38951ff47584c2f94161f994def8b24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:46:30Z,use_quota=True,user_id='83a21605d1ad4f3f8e0cff3c5a1cfdf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a60ce7dd-caa4-47cb-bb1d-70c6f74226da tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56175e8d-d9cd-4e11-a1cf-c1136c5c0189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a60ce7dd-caa4-47cb-bb1d-70c6f74226da tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56175e8d-d9cd-4e11-a1cf-c1136c5c0189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a60ce7dd-caa4-47cb-bb1d-70c6f74226da tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c194abbd-ae9c-4f9d-80d7-c8c48ac7d957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a60ce7dd-caa4-47cb-bb1d-70c6f74226da tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c194abbd-ae9c-4f9d-80d7-c8c48ac7d957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c469d9f-c361-4fd1-89ea-6d547c0d4b63', 'volume_name': 'volume-4c469d9f-c361-4fd1-89ea-6d547c0d4b63', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a60ce7dd-caa4-47cb-bb1d-70c6f74226da tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b2cb8bc-9871-4406-9dbb-fc88082cebe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a60ce7dd-caa4-47cb-bb1d-70c6f74226da tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b2cb8bc-9871-4406-9dbb-fc88082cebe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a60ce7dd-caa4-47cb-bb1d-70c6f74226da tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a3609f3-72e3-4ecc-9e2e-58e0d2ed26a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:30 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-a60ce7dd-caa4-47cb-bb1d-70c6f74226da tempest-CreateVolumesFromSnapshotTest-587921535 None] Volume 4c469d9f-c361-4fd1-89ea-6d547c0d4b63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c469d9f-c361-4fd1-89ea-6d547c0d4b63', 'volume_size': 1} Jul 28 10:46:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a60ce7dd-caa4-47cb-bb1d-70c6f74226da tempest-CreateVolumesFromSnapshotTest-587921535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:30 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e710474c-b70b-44c7-ab44-74fde4220b04 tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c" returned: 0 in 0.414s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:30 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e710474c-b70b-44c7-ab44-74fde4220b04 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-quobyte-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c" released by "delete_volume" :: held 1.018s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:30 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-84f42165-0cd9-4391-bc42-72bb6a80a530 tempest-VolumeTypesAccessTest-641722930 None] Acquiring lock "cinder-dddbcea7-f4a9-4103-a1ae-a34a18d5908c-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:30 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-84f42165-0cd9-4391-bc42-72bb6a80a530 tempest-VolumeTypesAccessTest-641722930 None] Lock "cinder-dddbcea7-f4a9-4103-a1ae-a34a18d5908c-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:30 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-78b710a7-99a1-4010-a739-6395c637ce2f tempest-CreateVolumesFromSnapshotTest-587921535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-03f757b2-9da3-4983-be96-2fac4121b60d 1073741824" returned: 0 in 0.781s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:30 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-84f42165-0cd9-4391-bc42-72bb6a80a530 tempest-VolumeTypesAccessTest-641722930 None] Acquiring lock "cinder-quobyte-dddbcea7-f4a9-4103-a1ae-a34a18d5908c" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:30 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f2da618-21b0-49b7-8e18-aabc7db052f6 tempest-CreateVolumesFromSnapshotTest-587921535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:46:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6f2da618-21b0-49b7-8e18-aabc7db052f6 tempest-CreateVolumesFromSnapshotTest-587921535 None] Flow 'volume_create_manager' (1aba24dc-e17a-4b8d-bb9a-ce725cf6b083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:46:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6f2da618-21b0-49b7-8e18-aabc7db052f6 tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3f44c4b-9070-4d0d-b1b7-dc7299a6ddd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:30 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-e710474c-b70b-44c7-ab44-74fde4220b04 tempest-VolumesSnapshotTestJSON-50191109 None] Created reservations ['8bb409a8-deb3-46cc-a52b-9e3c0ca55717', '4bf65005-ba6a-4682-ba0b-7e93618e223b', 'e6221584-6c40-451b-9ab7-4e38ef09379b', '470e468b-b8b7-4856-9878-7b416ad52f91'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:46:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6f2da618-21b0-49b7-8e18-aabc7db052f6 tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3f44c4b-9070-4d0d-b1b7-dc7299a6ddd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1104403176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=713729d3-e3fb-4b7c-8112-ba7a2c76e385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c38951ff47584c2f94161f994def8b24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:46:31Z,use_quota=True,user_id='83a21605d1ad4f3f8e0cff3c5a1cfdf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6f2da618-21b0-49b7-8e18-aabc7db052f6 tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ea00b31-1c4c-4029-afbb-fc17b1737185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6f2da618-21b0-49b7-8e18-aabc7db052f6 tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ea00b31-1c4c-4029-afbb-fc17b1737185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6f2da618-21b0-49b7-8e18-aabc7db052f6 tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40247927-21e1-47e9-81c4-1503169d2681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6f2da618-21b0-49b7-8e18-aabc7db052f6 tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40247927-21e1-47e9-81c4-1503169d2681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '713729d3-e3fb-4b7c-8112-ba7a2c76e385', 'volume_name': 'volume-713729d3-e3fb-4b7c-8112-ba7a2c76e385', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6f2da618-21b0-49b7-8e18-aabc7db052f6 tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca1e0015-610a-4f6c-b65f-df2aa843288b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6f2da618-21b0-49b7-8e18-aabc7db052f6 tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca1e0015-610a-4f6c-b65f-df2aa843288b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6f2da618-21b0-49b7-8e18-aabc7db052f6 tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (453e2beb-fa94-4e56-b81b-f6e74895e99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:30 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-6f2da618-21b0-49b7-8e18-aabc7db052f6 tempest-CreateVolumesFromSnapshotTest-587921535 None] Volume 713729d3-e3fb-4b7c-8112-ba7a2c76e385: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-713729d3-e3fb-4b7c-8112-ba7a2c76e385', 'volume_size': 1} Jul 28 10:46:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-6f2da618-21b0-49b7-8e18-aabc7db052f6 tempest-CreateVolumesFromSnapshotTest-587921535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:30 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-84f42165-0cd9-4391-bc42-72bb6a80a530 tempest-VolumeTypesAccessTest-641722930 None] Lock "cinder-quobyte-dddbcea7-f4a9-4103-a1ae-a34a18d5908c" acquired by "delete_volume" :: waited 0.125s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:30 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e703a7d-9c5b-438d-9026-23719f8b3092]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-84f42165-0cd9-4391-bc42-72bb6a80a530 tempest-VolumeTypesAccessTest-641722930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-dddbcea7-f4a9-4103-a1ae-a34a18d5908c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-78b710a7-99a1-4010-a739-6395c637ce2f tempest-CreateVolumesFromSnapshotTest-587921535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-03f757b2-9da3-4983-be96-2fac4121b60d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e710474c-b70b-44c7-ab44-74fde4220b04 tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:31 devstack sudo[100637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-03f757b2-9da3-4983-be96-2fac4121b60d Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e710474c-b70b-44c7-ab44-74fde4220b04 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e710474c-b70b-44c7-ab44-74fde4220b04 tempest-VolumesSnapshotTestJSON-50191109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:46:31 devstack sudo[100637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e710474c-b70b-44c7-ab44-74fde4220b04 tempest-VolumesSnapshotTestJSON-50191109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e710474c-b70b-44c7-ab44-74fde4220b04 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e710474c-b70b-44c7-ab44-74fde4220b04 tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:31 devstack sudo[100639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:46:31 devstack sudo[100639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-48640168-f7a3-4314-8950-a145bbf8a829 tempest-CreateVolumesFromSnapshotTest-587921535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:46:31 devstack sudo[100636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-dddbcea7-f4a9-4103-a1ae-a34a18d5908c Jul 28 10:46:31 devstack sudo[100636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-48640168-f7a3-4314-8950-a145bbf8a829 tempest-CreateVolumesFromSnapshotTest-587921535 None] Flow 'volume_create_manager' (e2b17a5e-61fc-4606-9bb6-490c6352c0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-48640168-f7a3-4314-8950-a145bbf8a829 tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9311c81-62e5-4cdb-aaf3-2e726a148ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-48640168-f7a3-4314-8950-a145bbf8a829 tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9311c81-62e5-4cdb-aaf3-2e726a148ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-404673643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8dd1c92-2626-4c77-a474-801306575512,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c38951ff47584c2f94161f994def8b24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:46:31Z,use_quota=True,user_id='83a21605d1ad4f3f8e0cff3c5a1cfdf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-48640168-f7a3-4314-8950-a145bbf8a829 tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26149bc7-7d8d-428d-a2a5-0c6ff9d42026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-48640168-f7a3-4314-8950-a145bbf8a829 tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26149bc7-7d8d-428d-a2a5-0c6ff9d42026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-48640168-f7a3-4314-8950-a145bbf8a829 tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdcda165-abb1-445e-85ba-7632839e539a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-48640168-f7a3-4314-8950-a145bbf8a829 tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdcda165-abb1-445e-85ba-7632839e539a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8dd1c92-2626-4c77-a474-801306575512', 'volume_name': 'volume-c8dd1c92-2626-4c77-a474-801306575512', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-48640168-f7a3-4314-8950-a145bbf8a829 tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86771902-4e39-4524-ad88-d49445142f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-48640168-f7a3-4314-8950-a145bbf8a829 tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86771902-4e39-4524-ad88-d49445142f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-48640168-f7a3-4314-8950-a145bbf8a829 tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31a8d61a-1c20-42ee-a5fe-d7073c1d2fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:31 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-48640168-f7a3-4314-8950-a145bbf8a829 tempest-CreateVolumesFromSnapshotTest-587921535 None] Volume c8dd1c92-2626-4c77-a474-801306575512: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8dd1c92-2626-4c77-a474-801306575512', 'volume_size': 1} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-48640168-f7a3-4314-8950-a145bbf8a829 tempest-CreateVolumesFromSnapshotTest-587921535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:31 devstack sudo[100637]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-78b710a7-99a1-4010-a739-6395c637ce2f tempest-CreateVolumesFromSnapshotTest-587921535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-03f757b2-9da3-4983-be96-2fac4121b60d" returned: 0 in 0.497s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-78b710a7-99a1-4010-a739-6395c637ce2f tempest-CreateVolumesFromSnapshotTest-587921535 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-78b710a7-99a1-4010-a739-6395c637ce2f tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a60ce7dd-caa4-47cb-bb1d-70c6f74226da tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.238s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-a60ce7dd-caa4-47cb-bb1d-70c6f74226da tempest-CreateVolumesFromSnapshotTest-587921535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-475813516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c469d9f-c361-4fd1-89ea-6d547c0d4b63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c38951ff47584c2f94161f994def8b24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:46:30Z,use_quota=True,user_id='83a21605d1ad4f3f8e0cff3c5a1cfdf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-a60ce7dd-caa4-47cb-bb1d-70c6f74226da tempest-CreateVolumesFromSnapshotTest-587921535 None] Creating volume 4c469d9f-c361-4fd1-89ea-6d547c0d4b63 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a60ce7dd-caa4-47cb-bb1d-70c6f74226da tempest-CreateVolumesFromSnapshotTest-587921535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a60ce7dd-caa4-47cb-bb1d-70c6f74226da tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-a60ce7dd-caa4-47cb-bb1d-70c6f74226da tempest-CreateVolumesFromSnapshotTest-587921535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-a60ce7dd-caa4-47cb-bb1d-70c6f74226da tempest-CreateVolumesFromSnapshotTest-587921535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a60ce7dd-caa4-47cb-bb1d-70c6f74226da tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-a60ce7dd-caa4-47cb-bb1d-70c6f74226da tempest-CreateVolumesFromSnapshotTest-587921535 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:46:31 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-a60ce7dd-caa4-47cb-bb1d-70c6f74226da tempest-CreateVolumesFromSnapshotTest-587921535 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a60ce7dd-caa4-47cb-bb1d-70c6f74226da tempest-CreateVolumesFromSnapshotTest-587921535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4c469d9f-c361-4fd1-89ea-6d547c0d4b63 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:31 devstack sudo[100639]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e710474c-b70b-44c7-ab44-74fde4220b04 tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.484s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-e710474c-b70b-44c7-ab44-74fde4220b04 tempest-VolumesSnapshotTestJSON-50191109 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:46:31 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-e710474c-b70b-44c7-ab44-74fde4220b04 tempest-VolumesSnapshotTestJSON-50191109 None] Deleted volume successfully. Jul 28 10:46:31 devstack sudo[100644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4c469d9f-c361-4fd1-89ea-6d547c0d4b63 1073741824 Jul 28 10:46:31 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-78b710a7-99a1-4010-a739-6395c637ce2f tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f20cbfba-aacb-4ada-82b2-ccad5c28506e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03f757b2-9da3-4983-be96-2fac4121b60d', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-78b710a7-99a1-4010-a739-6395c637ce2f tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dc2378e-723a-452c-890d-df9f1cc3baab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:31 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-78b710a7-99a1-4010-a739-6395c637ce2f tempest-CreateVolumesFromSnapshotTest-587921535 None] Volume volume-03f757b2-9da3-4983-be96-2fac4121b60d (03f757b2-9da3-4983-be96-2fac4121b60d): created successfully Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-78b710a7-99a1-4010-a739-6395c637ce2f tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dc2378e-723a-452c-890d-df9f1cc3baab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-78b710a7-99a1-4010-a739-6395c637ce2f tempest-CreateVolumesFromSnapshotTest-587921535 None] Flow 'volume_create_manager' (d99f9e8f-8cb5-480f-b1bf-f9b861ea30bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e710474c-b70b-44c7-ab44-74fde4220b04 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-0f6741a7-7ec9-4ca9-ac4c-3288d5c7be5c-delete_volume" released by "delete_volume" :: held 2.209s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:31 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-78b710a7-99a1-4010-a739-6395c637ce2f tempest-CreateVolumesFromSnapshotTest-587921535 None] Created volume successfully. Jul 28 10:46:31 devstack sudo[100636]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-959132f0-f7bc-42c8-b935-c4ad9dde0649 tempest-CreateVolumesFromSnapshotTest-587921535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-959132f0-f7bc-42c8-b935-c4ad9dde0649 tempest-CreateVolumesFromSnapshotTest-587921535 None] Flow 'volume_create_manager' (f4cee2d3-6cb3-4925-b7dd-cfb9d0bd9e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-959132f0-f7bc-42c8-b935-c4ad9dde0649 tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (567d4698-fed9-48e2-84cf-6333a23b5af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-84f42165-0cd9-4391-bc42-72bb6a80a530 tempest-VolumeTypesAccessTest-641722930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-dddbcea7-f4a9-4103-a1ae-a34a18d5908c" returned: 0 in 0.884s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-84f42165-0cd9-4391-bc42-72bb6a80a530 tempest-VolumeTypesAccessTest-641722930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-dddbcea7-f4a9-4103-a1ae-a34a18d5908c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-959132f0-f7bc-42c8-b935-c4ad9dde0649 tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (567d4698-fed9-48e2-84cf-6333a23b5af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-945042271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5de627ce-ce5c-423a-8cce-c56d993041e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c38951ff47584c2f94161f994def8b24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:46:32Z,use_quota=True,user_id='83a21605d1ad4f3f8e0cff3c5a1cfdf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-959132f0-f7bc-42c8-b935-c4ad9dde0649 tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31370134-c7ed-432e-bd62-0ae72b2a4287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-959132f0-f7bc-42c8-b935-c4ad9dde0649 tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31370134-c7ed-432e-bd62-0ae72b2a4287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:31 devstack sudo[100649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-dddbcea7-f4a9-4103-a1ae-a34a18d5908c Jul 28 10:46:31 devstack sudo[100649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-959132f0-f7bc-42c8-b935-c4ad9dde0649 tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95b7c61d-f925-4e22-abec-dae24a35587d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-959132f0-f7bc-42c8-b935-c4ad9dde0649 tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95b7c61d-f925-4e22-abec-dae24a35587d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5de627ce-ce5c-423a-8cce-c56d993041e8', 'volume_name': 'volume-5de627ce-ce5c-423a-8cce-c56d993041e8', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-959132f0-f7bc-42c8-b935-c4ad9dde0649 tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26aeb262-7f12-49a0-9917-589c3d0accaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-959132f0-f7bc-42c8-b935-c4ad9dde0649 tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26aeb262-7f12-49a0-9917-589c3d0accaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-959132f0-f7bc-42c8-b935-c4ad9dde0649 tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf790a3-cde5-49f4-b92f-8a3181641e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:31 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-959132f0-f7bc-42c8-b935-c4ad9dde0649 tempest-CreateVolumesFromSnapshotTest-587921535 None] Volume 5de627ce-ce5c-423a-8cce-c56d993041e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5de627ce-ce5c-423a-8cce-c56d993041e8', 'volume_size': 1} Jul 28 10:46:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-959132f0-f7bc-42c8-b935-c4ad9dde0649 tempest-CreateVolumesFromSnapshotTest-587921535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:32 devstack sudo[100649]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-84f42165-0cd9-4391-bc42-72bb6a80a530 tempest-VolumeTypesAccessTest-641722930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-dddbcea7-f4a9-4103-a1ae-a34a18d5908c" returned: 0 in 0.331s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-84f42165-0cd9-4391-bc42-72bb6a80a530 tempest-VolumeTypesAccessTest-641722930 None] Lock "cinder-quobyte-dddbcea7-f4a9-4103-a1ae-a34a18d5908c" released by "delete_volume" :: held 1.286s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:32 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a60ce7dd-caa4-47cb-bb1d-70c6f74226da tempest-CreateVolumesFromSnapshotTest-587921535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4c469d9f-c361-4fd1-89ea-6d547c0d4b63 1073741824" returned: 0 in 0.673s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a60ce7dd-caa4-47cb-bb1d-70c6f74226da tempest-CreateVolumesFromSnapshotTest-587921535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4c469d9f-c361-4fd1-89ea-6d547c0d4b63 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:32 devstack cinder-volume[88413]: WARNING cinder.quota [None req-84f42165-0cd9-4391-bc42-72bb6a80a530 tempest-VolumeTypesAccessTest-641722930 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-629284509 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-629284509, it is now deprecated. Please use the default quota class for default quota. Jul 28 10:46:32 devstack cinder-volume[88413]: WARNING cinder.quota [None req-84f42165-0cd9-4391-bc42-72bb6a80a530 tempest-VolumeTypesAccessTest-641722930 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-629284509 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-629284509, it is now deprecated. Please use the default quota class for default quota. Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-84f42165-0cd9-4391-bc42-72bb6a80a530 tempest-VolumeTypesAccessTest-641722930 None] Created reservations ['5b30f613-be90-42d4-97a9-98b9fec680a5', 'cf7492aa-2026-4787-9863-81fdd30ecc34', '22655efc-1aaf-4c6e-87f5-40fac5d23841', '15508653-a1d4-4c0f-a906-82ea38174a8b'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:46:32 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4c469d9f-c361-4fd1-89ea-6d547c0d4b63 Jul 28 10:46:32 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-84f42165-0cd9-4391-bc42-72bb6a80a530 tempest-VolumeTypesAccessTest-641722930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-84f42165-0cd9-4391-bc42-72bb6a80a530 tempest-VolumeTypesAccessTest-641722930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-84f42165-0cd9-4391-bc42-72bb6a80a530 tempest-VolumeTypesAccessTest-641722930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-84f42165-0cd9-4391-bc42-72bb6a80a530 tempest-VolumeTypesAccessTest-641722930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-84f42165-0cd9-4391-bc42-72bb6a80a530 tempest-VolumeTypesAccessTest-641722930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-84f42165-0cd9-4391-bc42-72bb6a80a530 tempest-VolumeTypesAccessTest-641722930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:32 devstack sudo[100660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:46:32 devstack sudo[100660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-be8314d4-be53-442c-9987-45ddc9d0863c tempest-VolumesSnapshotTestJSON-50191109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-be8314d4-be53-442c-9987-45ddc9d0863c tempest-VolumesSnapshotTestJSON-50191109 None] Flow 'volume_create_manager' (385753e3-ae33-458a-aff2-9f3f3255204f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-be8314d4-be53-442c-9987-45ddc9d0863c tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6dce673-66bd-47d3-992b-9474aeb0ca60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-be8314d4-be53-442c-9987-45ddc9d0863c tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6dce673-66bd-47d3-992b-9474aeb0ca60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-377814563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ede7d330-0d26-41fe-b3be-19a89dceaf30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db4b40b8f5c4400d8bd937bc704b3be4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:46:32Z,use_quota=True,user_id='cfa42265cd99411b822baac6abab4ea7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:32 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-be8314d4-be53-442c-9987-45ddc9d0863c tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77ae5c2f-7baf-4c0f-898e-916712c98a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-be8314d4-be53-442c-9987-45ddc9d0863c tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77ae5c2f-7baf-4c0f-898e-916712c98a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-be8314d4-be53-442c-9987-45ddc9d0863c tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce551f25-e9aa-4dc9-bb6e-6b27a6a52264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-be8314d4-be53-442c-9987-45ddc9d0863c tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce551f25-e9aa-4dc9-bb6e-6b27a6a52264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ede7d330-0d26-41fe-b3be-19a89dceaf30', 'volume_name': 'volume-ede7d330-0d26-41fe-b3be-19a89dceaf30', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-be8314d4-be53-442c-9987-45ddc9d0863c tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dd1273b-6efb-4f97-8a73-a14a343a122f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-be8314d4-be53-442c-9987-45ddc9d0863c tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dd1273b-6efb-4f97-8a73-a14a343a122f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-be8314d4-be53-442c-9987-45ddc9d0863c tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afb74d8b-a6c6-4195-9e9d-fb02bdaf9774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:32 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-be8314d4-be53-442c-9987-45ddc9d0863c tempest-VolumesSnapshotTestJSON-50191109 None] Volume ede7d330-0d26-41fe-b3be-19a89dceaf30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ede7d330-0d26-41fe-b3be-19a89dceaf30', 'volume_size': 1} Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-be8314d4-be53-442c-9987-45ddc9d0863c tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a60ce7dd-caa4-47cb-bb1d-70c6f74226da tempest-CreateVolumesFromSnapshotTest-587921535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4c469d9f-c361-4fd1-89ea-6d547c0d4b63" returned: 0 in 0.342s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-a60ce7dd-caa4-47cb-bb1d-70c6f74226da tempest-CreateVolumesFromSnapshotTest-587921535 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a60ce7dd-caa4-47cb-bb1d-70c6f74226da tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-6f2da618-21b0-49b7-8e18-aabc7db052f6 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.706s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-6f2da618-21b0-49b7-8e18-aabc7db052f6 tempest-CreateVolumesFromSnapshotTest-587921535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1104403176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=713729d3-e3fb-4b7c-8112-ba7a2c76e385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c38951ff47584c2f94161f994def8b24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:46:31Z,use_quota=True,user_id='83a21605d1ad4f3f8e0cff3c5a1cfdf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-6f2da618-21b0-49b7-8e18-aabc7db052f6 tempest-CreateVolumesFromSnapshotTest-587921535 None] Creating volume 713729d3-e3fb-4b7c-8112-ba7a2c76e385 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-6f2da618-21b0-49b7-8e18-aabc7db052f6 tempest-CreateVolumesFromSnapshotTest-587921535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-6f2da618-21b0-49b7-8e18-aabc7db052f6 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-6f2da618-21b0-49b7-8e18-aabc7db052f6 tempest-CreateVolumesFromSnapshotTest-587921535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-6f2da618-21b0-49b7-8e18-aabc7db052f6 tempest-CreateVolumesFromSnapshotTest-587921535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-6f2da618-21b0-49b7-8e18-aabc7db052f6 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-6f2da618-21b0-49b7-8e18-aabc7db052f6 tempest-CreateVolumesFromSnapshotTest-587921535 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:46:32 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-6f2da618-21b0-49b7-8e18-aabc7db052f6 tempest-CreateVolumesFromSnapshotTest-587921535 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6f2da618-21b0-49b7-8e18-aabc7db052f6 tempest-CreateVolumesFromSnapshotTest-587921535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-713729d3-e3fb-4b7c-8112-ba7a2c76e385 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a60ce7dd-caa4-47cb-bb1d-70c6f74226da tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a3609f3-72e3-4ecc-9e2e-58e0d2ed26a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c469d9f-c361-4fd1-89ea-6d547c0d4b63', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a60ce7dd-caa4-47cb-bb1d-70c6f74226da tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (239432ac-e0af-4260-87f5-ce7e9e45abff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:32 devstack sudo[100665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-713729d3-e3fb-4b7c-8112-ba7a2c76e385 1073741824 Jul 28 10:46:32 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:32 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-a60ce7dd-caa4-47cb-bb1d-70c6f74226da tempest-CreateVolumesFromSnapshotTest-587921535 None] Volume volume-4c469d9f-c361-4fd1-89ea-6d547c0d4b63 (4c469d9f-c361-4fd1-89ea-6d547c0d4b63): created successfully Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a60ce7dd-caa4-47cb-bb1d-70c6f74226da tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (239432ac-e0af-4260-87f5-ce7e9e45abff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a60ce7dd-caa4-47cb-bb1d-70c6f74226da tempest-CreateVolumesFromSnapshotTest-587921535 None] Flow 'volume_create_manager' (f087c9ea-a05b-43eb-93d5-0f016878201d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:46:32 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-a60ce7dd-caa4-47cb-bb1d-70c6f74226da tempest-CreateVolumesFromSnapshotTest-587921535 None] Created volume successfully. Jul 28 10:46:32 devstack sudo[100660]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-84f42165-0cd9-4391-bc42-72bb6a80a530 tempest-VolumeTypesAccessTest-641722930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.320s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-84f42165-0cd9-4391-bc42-72bb6a80a530 tempest-VolumeTypesAccessTest-641722930 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:46:32 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-84f42165-0cd9-4391-bc42-72bb6a80a530 tempest-VolumeTypesAccessTest-641722930 None] Deleted volume successfully. Jul 28 10:46:32 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-84f42165-0cd9-4391-bc42-72bb6a80a530 tempest-VolumeTypesAccessTest-641722930 None] Lock "cinder-dddbcea7-f4a9-4103-a1ae-a34a18d5908c-delete_volume" released by "delete_volume" :: held 2.141s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:33 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6f2da618-21b0-49b7-8e18-aabc7db052f6 tempest-CreateVolumesFromSnapshotTest-587921535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-713729d3-e3fb-4b7c-8112-ba7a2c76e385 1073741824" returned: 0 in 0.562s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6f2da618-21b0-49b7-8e18-aabc7db052f6 tempest-CreateVolumesFromSnapshotTest-587921535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-713729d3-e3fb-4b7c-8112-ba7a2c76e385 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:33 devstack sudo[100691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-713729d3-e3fb-4b7c-8112-ba7a2c76e385 Jul 28 10:46:33 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:33 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-6f2da618-21b0-49b7-8e18-aabc7db052f6 tempest-CreateVolumesFromSnapshotTest-587921535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-713729d3-e3fb-4b7c-8112-ba7a2c76e385" returned: 0 in 0.281s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:33 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-6f2da618-21b0-49b7-8e18-aabc7db052f6 tempest-CreateVolumesFromSnapshotTest-587921535 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:46:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-6f2da618-21b0-49b7-8e18-aabc7db052f6 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-48640168-f7a3-4314-8950-a145bbf8a829 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.160s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:33 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-48640168-f7a3-4314-8950-a145bbf8a829 tempest-CreateVolumesFromSnapshotTest-587921535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-404673643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8dd1c92-2626-4c77-a474-801306575512,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c38951ff47584c2f94161f994def8b24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:46:31Z,use_quota=True,user_id='83a21605d1ad4f3f8e0cff3c5a1cfdf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:46:33 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-48640168-f7a3-4314-8950-a145bbf8a829 tempest-CreateVolumesFromSnapshotTest-587921535 None] Creating volume c8dd1c92-2626-4c77-a474-801306575512 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:46:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-48640168-f7a3-4314-8950-a145bbf8a829 tempest-CreateVolumesFromSnapshotTest-587921535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-48640168-f7a3-4314-8950-a145bbf8a829 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:33 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-48640168-f7a3-4314-8950-a145bbf8a829 tempest-CreateVolumesFromSnapshotTest-587921535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:46:33 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-48640168-f7a3-4314-8950-a145bbf8a829 tempest-CreateVolumesFromSnapshotTest-587921535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:46:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-48640168-f7a3-4314-8950-a145bbf8a829 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:33 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-48640168-f7a3-4314-8950-a145bbf8a829 tempest-CreateVolumesFromSnapshotTest-587921535 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:46:33 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-48640168-f7a3-4314-8950-a145bbf8a829 tempest-CreateVolumesFromSnapshotTest-587921535 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:46:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-48640168-f7a3-4314-8950-a145bbf8a829 tempest-CreateVolumesFromSnapshotTest-587921535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8dd1c92-2626-4c77-a474-801306575512 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:33 devstack sudo[100700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8dd1c92-2626-4c77-a474-801306575512 1073741824 Jul 28 10:46:33 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:33 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6f2da618-21b0-49b7-8e18-aabc7db052f6 tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (453e2beb-fa94-4e56-b81b-f6e74895e99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-713729d3-e3fb-4b7c-8112-ba7a2c76e385', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:33 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6f2da618-21b0-49b7-8e18-aabc7db052f6 tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fea8e1d-eb87-4312-9526-c770327ab6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:33 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-6f2da618-21b0-49b7-8e18-aabc7db052f6 tempest-CreateVolumesFromSnapshotTest-587921535 None] Volume volume-713729d3-e3fb-4b7c-8112-ba7a2c76e385 (713729d3-e3fb-4b7c-8112-ba7a2c76e385): created successfully Jul 28 10:46:33 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6f2da618-21b0-49b7-8e18-aabc7db052f6 tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fea8e1d-eb87-4312-9526-c770327ab6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:33 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-6f2da618-21b0-49b7-8e18-aabc7db052f6 tempest-CreateVolumesFromSnapshotTest-587921535 None] Flow 'volume_create_manager' (1aba24dc-e17a-4b8d-bb9a-ce725cf6b083) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:46:33 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-6f2da618-21b0-49b7-8e18-aabc7db052f6 tempest-CreateVolumesFromSnapshotTest-587921535 None] Created volume successfully. Jul 28 10:46:34 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-48640168-f7a3-4314-8950-a145bbf8a829 tempest-CreateVolumesFromSnapshotTest-587921535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8dd1c92-2626-4c77-a474-801306575512 1073741824" returned: 0 in 0.579s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-48640168-f7a3-4314-8950-a145bbf8a829 tempest-CreateVolumesFromSnapshotTest-587921535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8dd1c92-2626-4c77-a474-801306575512 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:34 devstack sudo[100705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8dd1c92-2626-4c77-a474-801306575512 Jul 28 10:46:34 devstack sudo[100705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:34 devstack sudo[100705]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-48640168-f7a3-4314-8950-a145bbf8a829 tempest-CreateVolumesFromSnapshotTest-587921535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8dd1c92-2626-4c77-a474-801306575512" returned: 0 in 0.266s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:34 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-48640168-f7a3-4314-8950-a145bbf8a829 tempest-CreateVolumesFromSnapshotTest-587921535 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:46:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-48640168-f7a3-4314-8950-a145bbf8a829 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-959132f0-f7bc-42c8-b935-c4ad9dde0649 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.465s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:34 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-959132f0-f7bc-42c8-b935-c4ad9dde0649 tempest-CreateVolumesFromSnapshotTest-587921535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-945042271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5de627ce-ce5c-423a-8cce-c56d993041e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c38951ff47584c2f94161f994def8b24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:46:32Z,use_quota=True,user_id='83a21605d1ad4f3f8e0cff3c5a1cfdf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:46:34 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-959132f0-f7bc-42c8-b935-c4ad9dde0649 tempest-CreateVolumesFromSnapshotTest-587921535 None] Creating volume 5de627ce-ce5c-423a-8cce-c56d993041e8 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:46:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-959132f0-f7bc-42c8-b935-c4ad9dde0649 tempest-CreateVolumesFromSnapshotTest-587921535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-959132f0-f7bc-42c8-b935-c4ad9dde0649 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:34 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-959132f0-f7bc-42c8-b935-c4ad9dde0649 tempest-CreateVolumesFromSnapshotTest-587921535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:46:34 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-959132f0-f7bc-42c8-b935-c4ad9dde0649 tempest-CreateVolumesFromSnapshotTest-587921535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:46:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-959132f0-f7bc-42c8-b935-c4ad9dde0649 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:34 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-959132f0-f7bc-42c8-b935-c4ad9dde0649 tempest-CreateVolumesFromSnapshotTest-587921535 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:46:34 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-959132f0-f7bc-42c8-b935-c4ad9dde0649 tempest-CreateVolumesFromSnapshotTest-587921535 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:46:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-959132f0-f7bc-42c8-b935-c4ad9dde0649 tempest-CreateVolumesFromSnapshotTest-587921535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5de627ce-ce5c-423a-8cce-c56d993041e8 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-48640168-f7a3-4314-8950-a145bbf8a829 tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31a8d61a-1c20-42ee-a5fe-d7073c1d2fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8dd1c92-2626-4c77-a474-801306575512', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:34 devstack sudo[100711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5de627ce-ce5c-423a-8cce-c56d993041e8 1073741824 Jul 28 10:46:34 devstack sudo[100711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-48640168-f7a3-4314-8950-a145bbf8a829 tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96470948-2081-4686-9128-c1ef8a7b6a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:34 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-48640168-f7a3-4314-8950-a145bbf8a829 tempest-CreateVolumesFromSnapshotTest-587921535 None] Volume volume-c8dd1c92-2626-4c77-a474-801306575512 (c8dd1c92-2626-4c77-a474-801306575512): created successfully Jul 28 10:46:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-48640168-f7a3-4314-8950-a145bbf8a829 tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96470948-2081-4686-9128-c1ef8a7b6a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-48640168-f7a3-4314-8950-a145bbf8a829 tempest-CreateVolumesFromSnapshotTest-587921535 None] Flow 'volume_create_manager' (e2b17a5e-61fc-4606-9bb6-490c6352c0e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:46:34 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-48640168-f7a3-4314-8950-a145bbf8a829 tempest-CreateVolumesFromSnapshotTest-587921535 None] Created volume successfully. Jul 28 10:46:34 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-852a23ff-cad7-48ad-8310-555cf6542550 req-a72c65ba-d4ad-47a8-8915-0780321de4f0 tempest-TestInstancesWithCinderVolumes-733670174 None] Terminate volume connection completed successfully. Jul 28 10:46:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-852a23ff-cad7-48ad-8310-555cf6542550 req-a72c65ba-d4ad-47a8-8915-0780321de4f0 tempest-TestInstancesWithCinderVolumes-733670174 None] Deleting attachment 7ad0283d-53ed-4599-863a-ec6e4d0d5857. {{(pid=88413) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 10:46:34 devstack sudo[100711]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-959132f0-f7bc-42c8-b935-c4ad9dde0649 tempest-CreateVolumesFromSnapshotTest-587921535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5de627ce-ce5c-423a-8cce-c56d993041e8 1073741824" returned: 0 in 0.539s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-959132f0-f7bc-42c8-b935-c4ad9dde0649 tempest-CreateVolumesFromSnapshotTest-587921535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5de627ce-ce5c-423a-8cce-c56d993041e8 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:35 devstack sudo[100719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5de627ce-ce5c-423a-8cce-c56d993041e8 Jul 28 10:46:35 devstack sudo[100719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:35 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-34a6bcfa-37fd-4efe-b7c0-96798a28fb8d tempest-TestInstancesWithCinderVolumes-733670174 None] Acquiring lock "cinder-df86a441-a123-41e8-9fd9-f062ec3b9905-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:35 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-34a6bcfa-37fd-4efe-b7c0-96798a28fb8d tempest-TestInstancesWithCinderVolumes-733670174 None] Lock "cinder-df86a441-a123-41e8-9fd9-f062ec3b9905-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:35 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-34a6bcfa-37fd-4efe-b7c0-96798a28fb8d tempest-TestInstancesWithCinderVolumes-733670174 None] Acquiring lock "cinder-quobyte-df86a441-a123-41e8-9fd9-f062ec3b9905" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:35 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-34a6bcfa-37fd-4efe-b7c0-96798a28fb8d tempest-TestInstancesWithCinderVolumes-733670174 None] Lock "cinder-quobyte-df86a441-a123-41e8-9fd9-f062ec3b9905" acquired by "delete_volume" :: waited 0.020s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:35 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[919b48c8-35e4-4f01-8d73-20c5bc7e1c05]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-34a6bcfa-37fd-4efe-b7c0-96798a28fb8d tempest-TestInstancesWithCinderVolumes-733670174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-df86a441-a123-41e8-9fd9-f062ec3b9905 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:35 devstack sudo[100719]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-959132f0-f7bc-42c8-b935-c4ad9dde0649 tempest-CreateVolumesFromSnapshotTest-587921535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5de627ce-ce5c-423a-8cce-c56d993041e8" returned: 0 in 0.332s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:35 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-959132f0-f7bc-42c8-b935-c4ad9dde0649 tempest-CreateVolumesFromSnapshotTest-587921535 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:46:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-959132f0-f7bc-42c8-b935-c4ad9dde0649 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-be8314d4-be53-442c-9987-45ddc9d0863c tempest-VolumesSnapshotTestJSON-50191109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.772s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:35 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-be8314d4-be53-442c-9987-45ddc9d0863c tempest-VolumesSnapshotTestJSON-50191109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-377814563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ede7d330-0d26-41fe-b3be-19a89dceaf30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db4b40b8f5c4400d8bd937bc704b3be4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:46:32Z,use_quota=True,user_id='cfa42265cd99411b822baac6abab4ea7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:46:35 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-be8314d4-be53-442c-9987-45ddc9d0863c tempest-VolumesSnapshotTestJSON-50191109 None] Creating volume ede7d330-0d26-41fe-b3be-19a89dceaf30 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:46:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-be8314d4-be53-442c-9987-45ddc9d0863c tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-be8314d4-be53-442c-9987-45ddc9d0863c tempest-VolumesSnapshotTestJSON-50191109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:35 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-be8314d4-be53-442c-9987-45ddc9d0863c tempest-VolumesSnapshotTestJSON-50191109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:46:35 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-be8314d4-be53-442c-9987-45ddc9d0863c tempest-VolumesSnapshotTestJSON-50191109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:46:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-be8314d4-be53-442c-9987-45ddc9d0863c tempest-VolumesSnapshotTestJSON-50191109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:35 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-be8314d4-be53-442c-9987-45ddc9d0863c tempest-VolumesSnapshotTestJSON-50191109 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:46:35 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-be8314d4-be53-442c-9987-45ddc9d0863c tempest-VolumesSnapshotTestJSON-50191109 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:46:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-be8314d4-be53-442c-9987-45ddc9d0863c tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:35 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-959132f0-f7bc-42c8-b935-c4ad9dde0649 tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf790a3-cde5-49f4-b92f-8a3181641e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5de627ce-ce5c-423a-8cce-c56d993041e8', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:35 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-959132f0-f7bc-42c8-b935-c4ad9dde0649 tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83005632-4777-42dc-8b56-12319061f41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:35 devstack sudo[100726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-df86a441-a123-41e8-9fd9-f062ec3b9905 Jul 28 10:46:35 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:35 devstack sudo[100728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30 1073741824 Jul 28 10:46:35 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:35 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-959132f0-f7bc-42c8-b935-c4ad9dde0649 tempest-CreateVolumesFromSnapshotTest-587921535 None] Volume volume-5de627ce-ce5c-423a-8cce-c56d993041e8 (5de627ce-ce5c-423a-8cce-c56d993041e8): created successfully Jul 28 10:46:35 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-959132f0-f7bc-42c8-b935-c4ad9dde0649 tempest-CreateVolumesFromSnapshotTest-587921535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83005632-4777-42dc-8b56-12319061f41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:35 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-959132f0-f7bc-42c8-b935-c4ad9dde0649 tempest-CreateVolumesFromSnapshotTest-587921535 None] Flow 'volume_create_manager' (f4cee2d3-6cb3-4925-b7dd-cfb9d0bd9e27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:46:35 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-959132f0-f7bc-42c8-b935-c4ad9dde0649 tempest-CreateVolumesFromSnapshotTest-587921535 None] Created volume successfully. Jul 28 10:46:35 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-34a6bcfa-37fd-4efe-b7c0-96798a28fb8d tempest-TestInstancesWithCinderVolumes-733670174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-df86a441-a123-41e8-9fd9-f062ec3b9905" returned: 0 in 0.469s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-34a6bcfa-37fd-4efe-b7c0-96798a28fb8d tempest-TestInstancesWithCinderVolumes-733670174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-df86a441-a123-41e8-9fd9-f062ec3b9905 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:35 devstack sudo[100737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-df86a441-a123-41e8-9fd9-f062ec3b9905 Jul 28 10:46:35 devstack sudo[100737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:36 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-be8314d4-be53-442c-9987-45ddc9d0863c tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30 1073741824" returned: 0 in 0.669s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-be8314d4-be53-442c-9987-45ddc9d0863c tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:36 devstack sudo[100737]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-34a6bcfa-37fd-4efe-b7c0-96798a28fb8d tempest-TestInstancesWithCinderVolumes-733670174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-df86a441-a123-41e8-9fd9-f062ec3b9905" returned: 0 in 0.368s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:36 devstack sudo[100741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30 Jul 28 10:46:36 devstack sudo[100741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:36 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-34a6bcfa-37fd-4efe-b7c0-96798a28fb8d tempest-TestInstancesWithCinderVolumes-733670174 None] Lock "cinder-quobyte-df86a441-a123-41e8-9fd9-f062ec3b9905" released by "delete_volume" :: held 0.911s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:36 devstack cinder-volume[88413]: WARNING cinder.quota [None req-34a6bcfa-37fd-4efe-b7c0-96798a28fb8d tempest-TestInstancesWithCinderVolumes-733670174 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1757741078-1958620905 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1757741078-1958620905, it is now deprecated. Please use the default quota class for default quota. Jul 28 10:46:36 devstack cinder-volume[88413]: WARNING cinder.quota [None req-34a6bcfa-37fd-4efe-b7c0-96798a28fb8d tempest-TestInstancesWithCinderVolumes-733670174 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1757741078-1958620905 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1757741078-1958620905, it is now deprecated. Please use the default quota class for default quota. Jul 28 10:46:36 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-34a6bcfa-37fd-4efe-b7c0-96798a28fb8d tempest-TestInstancesWithCinderVolumes-733670174 None] Created reservations ['9e03ed69-7aa8-43a6-99e4-275ac37507f4', '18a30d88-f998-4551-8ca9-d91ebbefa309', 'dfedabff-8816-453a-b207-88d27a966721', '8f17fde2-ba85-4795-98be-2a44386edc6a'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:46:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-34a6bcfa-37fd-4efe-b7c0-96798a28fb8d tempest-TestInstancesWithCinderVolumes-733670174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-34a6bcfa-37fd-4efe-b7c0-96798a28fb8d tempest-TestInstancesWithCinderVolumes-733670174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:36 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-34a6bcfa-37fd-4efe-b7c0-96798a28fb8d tempest-TestInstancesWithCinderVolumes-733670174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:46:36 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-34a6bcfa-37fd-4efe-b7c0-96798a28fb8d tempest-TestInstancesWithCinderVolumes-733670174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:46:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-34a6bcfa-37fd-4efe-b7c0-96798a28fb8d tempest-TestInstancesWithCinderVolumes-733670174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-34a6bcfa-37fd-4efe-b7c0-96798a28fb8d tempest-TestInstancesWithCinderVolumes-733670174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:36 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9731e62f-9d73-4eed-ac2c-bd2881e30d84 tempest-CreateVolumesFromSnapshotTest-587921535 None] Acquiring lock "cinder-5de627ce-ce5c-423a-8cce-c56d993041e8-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:36 devstack sudo[100743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:46:36 devstack sudo[100743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:36 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9731e62f-9d73-4eed-ac2c-bd2881e30d84 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "cinder-5de627ce-ce5c-423a-8cce-c56d993041e8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:36 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9731e62f-9d73-4eed-ac2c-bd2881e30d84 tempest-CreateVolumesFromSnapshotTest-587921535 None] Acquiring lock "cinder-quobyte-5de627ce-ce5c-423a-8cce-c56d993041e8" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:36 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9731e62f-9d73-4eed-ac2c-bd2881e30d84 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "cinder-quobyte-5de627ce-ce5c-423a-8cce-c56d993041e8" acquired by "delete_volume" :: waited 0.022s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:36 devstack sudo[100741]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-be8314d4-be53-442c-9987-45ddc9d0863c tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30" returned: 0 in 0.419s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:36 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-be8314d4-be53-442c-9987-45ddc9d0863c tempest-VolumesSnapshotTestJSON-50191109 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:46:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-be8314d4-be53-442c-9987-45ddc9d0863c tempest-VolumesSnapshotTestJSON-50191109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:36 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd374ab-6639-41e8-841a-699ce4c352c7]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9731e62f-9d73-4eed-ac2c-bd2881e30d84 tempest-CreateVolumesFromSnapshotTest-587921535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5de627ce-ce5c-423a-8cce-c56d993041e8 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-be8314d4-be53-442c-9987-45ddc9d0863c tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afb74d8b-a6c6-4195-9e9d-fb02bdaf9774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ede7d330-0d26-41fe-b3be-19a89dceaf30', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-be8314d4-be53-442c-9987-45ddc9d0863c tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (145e60a1-6475-46b2-b7bb-aeaeec13f977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:36 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-be8314d4-be53-442c-9987-45ddc9d0863c tempest-VolumesSnapshotTestJSON-50191109 None] Volume volume-ede7d330-0d26-41fe-b3be-19a89dceaf30 (ede7d330-0d26-41fe-b3be-19a89dceaf30): created successfully Jul 28 10:46:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-be8314d4-be53-442c-9987-45ddc9d0863c tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (145e60a1-6475-46b2-b7bb-aeaeec13f977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-be8314d4-be53-442c-9987-45ddc9d0863c tempest-VolumesSnapshotTestJSON-50191109 None] Flow 'volume_create_manager' (385753e3-ae33-458a-aff2-9f3f3255204f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:46:36 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-be8314d4-be53-442c-9987-45ddc9d0863c tempest-VolumesSnapshotTestJSON-50191109 None] Created volume successfully. Jul 28 10:46:36 devstack sudo[100743]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-34a6bcfa-37fd-4efe-b7c0-96798a28fb8d tempest-TestInstancesWithCinderVolumes-733670174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.333s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:36 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-34a6bcfa-37fd-4efe-b7c0-96798a28fb8d tempest-TestInstancesWithCinderVolumes-733670174 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:46:36 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-34a6bcfa-37fd-4efe-b7c0-96798a28fb8d tempest-TestInstancesWithCinderVolumes-733670174 None] Deleted volume successfully. Jul 28 10:46:36 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-34a6bcfa-37fd-4efe-b7c0-96798a28fb8d tempest-TestInstancesWithCinderVolumes-733670174 None] Lock "cinder-df86a441-a123-41e8-9fd9-f062ec3b9905-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:36 devstack sudo[100746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5de627ce-ce5c-423a-8cce-c56d993041e8 Jul 28 10:46:36 devstack sudo[100746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-de99b1e5-f6fa-48eb-b64e-023d0b8984e4 tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-de99b1e5-f6fa-48eb-b64e-023d0b8984e4 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:37 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-de99b1e5-f6fa-48eb-b64e-023d0b8984e4 tempest-VolumesSnapshotTestJSON-50191109 None] Creating offline snapshot bdc5dad6-fd5b-4495-a89d-a869ae5ac32d of volume ede7d330-0d26-41fe-b3be-19a89dceaf30 {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:46:37 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[c121583b-07bc-47b3-891f-16f129795072]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-de99b1e5-f6fa-48eb-b64e-023d0b8984e4 tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:37 devstack sudo[100746]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9731e62f-9d73-4eed-ac2c-bd2881e30d84 tempest-CreateVolumesFromSnapshotTest-587921535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5de627ce-ce5c-423a-8cce-c56d993041e8" returned: 0 in 0.621s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9731e62f-9d73-4eed-ac2c-bd2881e30d84 tempest-CreateVolumesFromSnapshotTest-587921535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5de627ce-ce5c-423a-8cce-c56d993041e8 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:37 devstack sudo[100753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5de627ce-ce5c-423a-8cce-c56d993041e8 Jul 28 10:46:37 devstack sudo[100753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:37 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30 Jul 28 10:46:37 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:37 devstack sudo[100753]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9731e62f-9d73-4eed-ac2c-bd2881e30d84 tempest-CreateVolumesFromSnapshotTest-587921535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5de627ce-ce5c-423a-8cce-c56d993041e8" returned: 0 in 0.367s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:37 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:37 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9731e62f-9d73-4eed-ac2c-bd2881e30d84 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "cinder-quobyte-5de627ce-ce5c-423a-8cce-c56d993041e8" released by "delete_volume" :: held 1.064s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-de99b1e5-f6fa-48eb-b64e-023d0b8984e4 tempest-VolumesSnapshotTestJSON-50191109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30" returned: 0 in 0.496s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-de99b1e5-f6fa-48eb-b64e-023d0b8984e4 tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30.bdc5dad6-fd5b-4495-a89d-a869ae5ac32d 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:37 devstack sudo[100760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30.bdc5dad6-fd5b-4495-a89d-a869ae5ac32d 1G Jul 28 10:46:37 devstack sudo[100760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:37 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-9731e62f-9d73-4eed-ac2c-bd2881e30d84 tempest-CreateVolumesFromSnapshotTest-587921535 None] Created reservations ['955235b7-3b52-4f1f-8740-c51d8b1a9a60', '950ae55d-0a6a-4486-ba1a-ffb8743c2e56', '5fcec60f-ca2c-4411-8748-0f0a46951ea3', '2fcd5c2c-0761-4ee5-91f6-eec6f2c54a68'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:46:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9731e62f-9d73-4eed-ac2c-bd2881e30d84 tempest-CreateVolumesFromSnapshotTest-587921535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9731e62f-9d73-4eed-ac2c-bd2881e30d84 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:37 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9731e62f-9d73-4eed-ac2c-bd2881e30d84 tempest-CreateVolumesFromSnapshotTest-587921535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:46:37 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9731e62f-9d73-4eed-ac2c-bd2881e30d84 tempest-CreateVolumesFromSnapshotTest-587921535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:46:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9731e62f-9d73-4eed-ac2c-bd2881e30d84 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9731e62f-9d73-4eed-ac2c-bd2881e30d84 tempest-CreateVolumesFromSnapshotTest-587921535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:37 devstack sudo[100764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:46:37 devstack sudo[100764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:38 devstack sudo[100764]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9731e62f-9d73-4eed-ac2c-bd2881e30d84 tempest-CreateVolumesFromSnapshotTest-587921535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.323s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:38 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-9731e62f-9d73-4eed-ac2c-bd2881e30d84 tempest-CreateVolumesFromSnapshotTest-587921535 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:46:38 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-9731e62f-9d73-4eed-ac2c-bd2881e30d84 tempest-CreateVolumesFromSnapshotTest-587921535 None] Deleted volume successfully. Jul 28 10:46:38 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9731e62f-9d73-4eed-ac2c-bd2881e30d84 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "cinder-5de627ce-ce5c-423a-8cce-c56d993041e8-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:38 devstack sudo[100760]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-de99b1e5-f6fa-48eb-b64e-023d0b8984e4 tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30.bdc5dad6-fd5b-4495-a89d-a869ae5ac32d 1G" returned: 0 in 0.614s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-de99b1e5-f6fa-48eb-b64e-023d0b8984e4 tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ede7d330-0d26-41fe-b3be-19a89dceaf30 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30.bdc5dad6-fd5b-4495-a89d-a869ae5ac32d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:38 devstack sudo[100779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ede7d330-0d26-41fe-b3be-19a89dceaf30 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30.bdc5dad6-fd5b-4495-a89d-a869ae5ac32d Jul 28 10:46:38 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:38 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-de99b1e5-f6fa-48eb-b64e-023d0b8984e4 tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ede7d330-0d26-41fe-b3be-19a89dceaf30 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30.bdc5dad6-fd5b-4495-a89d-a869ae5ac32d" returned: 0 in 0.331s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:38 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-de99b1e5-f6fa-48eb-b64e-023d0b8984e4 tempest-VolumesSnapshotTestJSON-50191109 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30.bdc5dad6-fd5b-4495-a89d-a869ae5ac32d is being set with open permissions: ugo+rw Jul 28 10:46:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-de99b1e5-f6fa-48eb-b64e-023d0b8984e4 tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30.bdc5dad6-fd5b-4495-a89d-a869ae5ac32d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:38 devstack sudo[100790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30.bdc5dad6-fd5b-4495-a89d-a869ae5ac32d Jul 28 10:46:38 devstack sudo[100790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:38 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f93d68e0-e724-4796-9287-0d3b5ac2a128 tempest-CreateVolumesFromSnapshotTest-587921535 None] Acquiring lock "cinder-c8dd1c92-2626-4c77-a474-801306575512-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:38 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f93d68e0-e724-4796-9287-0d3b5ac2a128 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "cinder-c8dd1c92-2626-4c77-a474-801306575512-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:38 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f93d68e0-e724-4796-9287-0d3b5ac2a128 tempest-CreateVolumesFromSnapshotTest-587921535 None] Acquiring lock "cinder-quobyte-c8dd1c92-2626-4c77-a474-801306575512" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:38 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f93d68e0-e724-4796-9287-0d3b5ac2a128 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "cinder-quobyte-c8dd1c92-2626-4c77-a474-801306575512" acquired by "delete_volume" :: waited 0.019s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:38 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1afcad-38da-4985-a4db-52a086eb17dd]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f93d68e0-e724-4796-9287-0d3b5ac2a128 tempest-CreateVolumesFromSnapshotTest-587921535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8dd1c92-2626-4c77-a474-801306575512 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:38 devstack sudo[100790]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-de99b1e5-f6fa-48eb-b64e-023d0b8984e4 tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30.bdc5dad6-fd5b-4495-a89d-a869ae5ac32d" returned: 0 in 0.343s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-de99b1e5-f6fa-48eb-b64e-023d0b8984e4 tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:38 devstack sudo[100798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30.info Jul 28 10:46:38 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:38 devstack sudo[100797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8dd1c92-2626-4c77-a474-801306575512 Jul 28 10:46:38 devstack sudo[100797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:39 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-de99b1e5-f6fa-48eb-b64e-023d0b8984e4 tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30.info" returned: 0 in 0.349s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:39 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-de99b1e5-f6fa-48eb-b64e-023d0b8984e4 tempest-VolumesSnapshotTestJSON-50191109 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30.info is being set with open permissions: ugo+rw Jul 28 10:46:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-de99b1e5-f6fa-48eb-b64e-023d0b8984e4 tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:39 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30.info Jul 28 10:46:39 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:39 devstack sudo[100797]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f93d68e0-e724-4796-9287-0d3b5ac2a128 tempest-CreateVolumesFromSnapshotTest-587921535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8dd1c92-2626-4c77-a474-801306575512" returned: 0 in 0.496s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f93d68e0-e724-4796-9287-0d3b5ac2a128 tempest-CreateVolumesFromSnapshotTest-587921535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8dd1c92-2626-4c77-a474-801306575512 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:39 devstack sudo[100807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8dd1c92-2626-4c77-a474-801306575512 Jul 28 10:46:39 devstack sudo[100807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:39 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-de99b1e5-f6fa-48eb-b64e-023d0b8984e4 tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30.info" returned: 0 in 0.276s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-de99b1e5-f6fa-48eb-b64e-023d0b8984e4 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.548s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:39 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-de99b1e5-f6fa-48eb-b64e-023d0b8984e4 tempest-VolumesSnapshotTestJSON-50191109 None] Create snapshot completed successfully Jul 28 10:46:39 devstack sudo[100807]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f93d68e0-e724-4796-9287-0d3b5ac2a128 tempest-CreateVolumesFromSnapshotTest-587921535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8dd1c92-2626-4c77-a474-801306575512" returned: 0 in 0.293s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:39 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f93d68e0-e724-4796-9287-0d3b5ac2a128 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "cinder-quobyte-c8dd1c92-2626-4c77-a474-801306575512" released by "delete_volume" :: held 0.848s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:39 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-f93d68e0-e724-4796-9287-0d3b5ac2a128 tempest-CreateVolumesFromSnapshotTest-587921535 None] Created reservations ['0ce72e79-6a12-497a-97ca-4cc63e145b6c', '30270c4f-ef2e-48df-bfb7-cb140e697395', 'b9e859e6-6b4c-46a1-951f-16909d1faf1f', 'ee61c0ad-e158-486c-b347-9f6604e2d242'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:46:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f93d68e0-e724-4796-9287-0d3b5ac2a128 tempest-CreateVolumesFromSnapshotTest-587921535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f93d68e0-e724-4796-9287-0d3b5ac2a128 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:39 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f93d68e0-e724-4796-9287-0d3b5ac2a128 tempest-CreateVolumesFromSnapshotTest-587921535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:46:39 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f93d68e0-e724-4796-9287-0d3b5ac2a128 tempest-CreateVolumesFromSnapshotTest-587921535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:46:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f93d68e0-e724-4796-9287-0d3b5ac2a128 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f93d68e0-e724-4796-9287-0d3b5ac2a128 tempest-CreateVolumesFromSnapshotTest-587921535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:39 devstack sudo[100818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:46:39 devstack sudo[100818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:39 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-7691ed1a-b719-49e8-b20d-31894668be73 req-dc7fb587-74d5-4624-9e8e-c568a195103d tempest-TestInstancesWithCinderVolumes-733670174 None] Terminate volume connection completed successfully. Jul 28 10:46:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-7691ed1a-b719-49e8-b20d-31894668be73 req-dc7fb587-74d5-4624-9e8e-c568a195103d tempest-TestInstancesWithCinderVolumes-733670174 None] Deleting attachment 83560388-6ca1-4592-9114-979d836ead50. {{(pid=88413) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 10:46:39 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-106ce621-37ea-487d-a970-3842badbd8a5 tempest-CreateVolumesFromSnapshotTest-587921535 None] Acquiring lock "cinder-713729d3-e3fb-4b7c-8112-ba7a2c76e385-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:39 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-106ce621-37ea-487d-a970-3842badbd8a5 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "cinder-713729d3-e3fb-4b7c-8112-ba7a2c76e385-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:39 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-106ce621-37ea-487d-a970-3842badbd8a5 tempest-CreateVolumesFromSnapshotTest-587921535 None] Acquiring lock "cinder-quobyte-713729d3-e3fb-4b7c-8112-ba7a2c76e385" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:40 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-106ce621-37ea-487d-a970-3842badbd8a5 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "cinder-quobyte-713729d3-e3fb-4b7c-8112-ba7a2c76e385" acquired by "delete_volume" :: waited 0.033s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:40 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[09881d3f-dc3f-4264-8afd-3dcf9e619e17]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-106ce621-37ea-487d-a970-3842badbd8a5 tempest-CreateVolumesFromSnapshotTest-587921535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-713729d3-e3fb-4b7c-8112-ba7a2c76e385 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:40 devstack sudo[100818]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f93d68e0-e724-4796-9287-0d3b5ac2a128 tempest-CreateVolumesFromSnapshotTest-587921535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.347s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:40 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-f93d68e0-e724-4796-9287-0d3b5ac2a128 tempest-CreateVolumesFromSnapshotTest-587921535 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:46:40 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-f93d68e0-e724-4796-9287-0d3b5ac2a128 tempest-CreateVolumesFromSnapshotTest-587921535 None] Deleted volume successfully. Jul 28 10:46:40 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f93d68e0-e724-4796-9287-0d3b5ac2a128 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "cinder-c8dd1c92-2626-4c77-a474-801306575512-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:40 devstack sudo[100821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-713729d3-e3fb-4b7c-8112-ba7a2c76e385 Jul 28 10:46:40 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:40 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ff2585b4-adbe-4275-96e5-fa9f1b94c4bd tempest-TestInstancesWithCinderVolumes-733670174 None] Acquiring lock "cinder-cff137d9-a2cd-420a-bf49-143187d1d0de-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:40 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ff2585b4-adbe-4275-96e5-fa9f1b94c4bd tempest-TestInstancesWithCinderVolumes-733670174 None] Lock "cinder-cff137d9-a2cd-420a-bf49-143187d1d0de-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:40 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ff2585b4-adbe-4275-96e5-fa9f1b94c4bd tempest-TestInstancesWithCinderVolumes-733670174 None] Acquiring lock "cinder-quobyte-cff137d9-a2cd-420a-bf49-143187d1d0de" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:40 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ff2585b4-adbe-4275-96e5-fa9f1b94c4bd tempest-TestInstancesWithCinderVolumes-733670174 None] Lock "cinder-quobyte-cff137d9-a2cd-420a-bf49-143187d1d0de" acquired by "delete_volume" :: waited 0.021s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:40 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[caef9e49-364c-4f3d-86c9-d480bc830459]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ff2585b4-adbe-4275-96e5-fa9f1b94c4bd tempest-TestInstancesWithCinderVolumes-733670174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-cff137d9-a2cd-420a-bf49-143187d1d0de {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:40 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-106ce621-37ea-487d-a970-3842badbd8a5 tempest-CreateVolumesFromSnapshotTest-587921535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-713729d3-e3fb-4b7c-8112-ba7a2c76e385" returned: 0 in 0.524s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-106ce621-37ea-487d-a970-3842badbd8a5 tempest-CreateVolumesFromSnapshotTest-587921535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-713729d3-e3fb-4b7c-8112-ba7a2c76e385 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:40 devstack sudo[100825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-cff137d9-a2cd-420a-bf49-143187d1d0de Jul 28 10:46:40 devstack sudo[100825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:40 devstack sudo[100827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-713729d3-e3fb-4b7c-8112-ba7a2c76e385 Jul 28 10:46:40 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:41 devstack sudo[100825]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ff2585b4-adbe-4275-96e5-fa9f1b94c4bd tempest-TestInstancesWithCinderVolumes-733670174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-cff137d9-a2cd-420a-bf49-143187d1d0de" returned: 0 in 0.545s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ff2585b4-adbe-4275-96e5-fa9f1b94c4bd tempest-TestInstancesWithCinderVolumes-733670174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-cff137d9-a2cd-420a-bf49-143187d1d0de {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:41 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-106ce621-37ea-487d-a970-3842badbd8a5 tempest-CreateVolumesFromSnapshotTest-587921535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-713729d3-e3fb-4b7c-8112-ba7a2c76e385" returned: 0 in 0.468s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:41 devstack sudo[100834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-cff137d9-a2cd-420a-bf49-143187d1d0de Jul 28 10:46:41 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-106ce621-37ea-487d-a970-3842badbd8a5 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "cinder-quobyte-713729d3-e3fb-4b7c-8112-ba7a2c76e385" released by "delete_volume" :: held 1.074s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Flow 'volume_create_manager' (378b6b47-34c5-49e7-aa5e-5f39546eb172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d227f7f-cb3a-48cf-a76c-05dedfbab488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d227f7f-cb3a-48cf-a76c-05dedfbab488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-760738676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75b2c136-4984-415e-9ef3-5bb895709e07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db4b40b8f5c4400d8bd937bc704b3be4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bdc5dad6-fd5b-4495-a89d-a869ae5ac32d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:46:41Z,use_quota=True,user_id='cfa42265cd99411b822baac6abab4ea7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d972372d-6b08-423e-92da-890759a838ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d972372d-6b08-423e-92da-890759a838ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5be8901-fe8c-4ad6-bc84-1f5fed2a6ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5be8901-fe8c-4ad6-bc84-1f5fed2a6ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '75b2c136-4984-415e-9ef3-5bb895709e07', 'volume_name': 'volume-75b2c136-4984-415e-9ef3-5bb895709e07', 'volume_size': 1, 'snapshot_id': 'bdc5dad6-fd5b-4495-a89d-a869ae5ac32d'}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8269a2f5-2e1f-449e-8a06-15120325a528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8269a2f5-2e1f-449e-8a06-15120325a528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17799dfd-ad1e-445e-83e7-93110d53243c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:41 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Volume 75b2c136-4984-415e-9ef3-5bb895709e07: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-75b2c136-4984-415e-9ef3-5bb895709e07', 'volume_size': 1, 'snapshot_id': 'bdc5dad6-fd5b-4495-a89d-a869ae5ac32d'} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "cinder-quobyte-bdc5dad6-fd5b-4495-a89d-a869ae5ac32d-75b2c136-4984-415e-9ef3-5bb895709e07" by "_create_volume_from_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-quobyte-bdc5dad6-fd5b-4495-a89d-a869ae5ac32d-75b2c136-4984-415e-9ef3-5bb895709e07" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Creating volume 75b2c136-4984-415e-9ef3-5bb895709e07 from snapshot bdc5dad6-fd5b-4495-a89d-a869ae5ac32d {{(pid=88413) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "cinder-quobyte-75b2c136-4984-415e-9ef3-5bb895709e07" by "_copy_volume_from_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-106ce621-37ea-487d-a970-3842badbd8a5 tempest-CreateVolumesFromSnapshotTest-587921535 None] Created reservations ['8f3433ee-585f-46fd-84dd-b85a84f455c5', 'a15ffac0-c56f-41ed-a68a-dc4ab7e216d6', '5223377d-136c-447d-bb2d-abf969b80616', '4c7d7bd7-35c0-4ae3-ba4e-16757c57b8bb'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-quobyte-75b2c136-4984-415e-9ef3-5bb895709e07" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] snapshot: bdc5dad6-fd5b-4495-a89d-a869ae5ac32d, volume: 75b2c136-4984-415e-9ef3-5bb895709e07, {{(pid=88413) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 28 10:46:41 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ff2585b4-adbe-4275-96e5-fa9f1b94c4bd tempest-TestInstancesWithCinderVolumes-733670174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-cff137d9-a2cd-420a-bf49-143187d1d0de" returned: 0 in 0.386s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd49e8b-35ce-4fe5-a229-2401bc8e0654]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30.bdc5dad6-fd5b-4495-a89d-a869ae5ac32d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ff2585b4-adbe-4275-96e5-fa9f1b94c4bd tempest-TestInstancesWithCinderVolumes-733670174 None] Lock "cinder-quobyte-cff137d9-a2cd-420a-bf49-143187d1d0de" released by "delete_volume" :: held 1.023s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-106ce621-37ea-487d-a970-3842badbd8a5 tempest-CreateVolumesFromSnapshotTest-587921535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-106ce621-37ea-487d-a970-3842badbd8a5 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-106ce621-37ea-487d-a970-3842badbd8a5 tempest-CreateVolumesFromSnapshotTest-587921535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-106ce621-37ea-487d-a970-3842badbd8a5 tempest-CreateVolumesFromSnapshotTest-587921535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-106ce621-37ea-487d-a970-3842badbd8a5 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-106ce621-37ea-487d-a970-3842badbd8a5 tempest-CreateVolumesFromSnapshotTest-587921535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:41 devstack cinder-volume[88413]: WARNING cinder.quota [None req-ff2585b4-adbe-4275-96e5-fa9f1b94c4bd tempest-TestInstancesWithCinderVolumes-733670174 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1755926223-1857675306 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1755926223-1857675306, it is now deprecated. Please use the default quota class for default quota. Jul 28 10:46:41 devstack cinder-volume[88413]: WARNING cinder.quota [None req-ff2585b4-adbe-4275-96e5-fa9f1b94c4bd tempest-TestInstancesWithCinderVolumes-733670174 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1755926223-1857675306 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1755926223-1857675306, it is now deprecated. Please use the default quota class for default quota. Jul 28 10:46:41 devstack sudo[100838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:46:41 devstack sudo[100838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:41 devstack sudo[100837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30.bdc5dad6-fd5b-4495-a89d-a869ae5ac32d Jul 28 10:46:41 devstack sudo[100837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-ff2585b4-adbe-4275-96e5-fa9f1b94c4bd tempest-TestInstancesWithCinderVolumes-733670174 None] Created reservations ['f16f8c82-3763-4492-b431-407feb86ebde', 'bb7fd40e-5a73-4c07-9b27-abc9f39dbc1d', '4c99c0b6-576f-403d-ab2c-03a72d80ae05', 'ca2b54e5-b2c9-4c06-af99-ccbd55664c1e'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ff2585b4-adbe-4275-96e5-fa9f1b94c4bd tempest-TestInstancesWithCinderVolumes-733670174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ff2585b4-adbe-4275-96e5-fa9f1b94c4bd tempest-TestInstancesWithCinderVolumes-733670174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-ff2585b4-adbe-4275-96e5-fa9f1b94c4bd tempest-TestInstancesWithCinderVolumes-733670174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-ff2585b4-adbe-4275-96e5-fa9f1b94c4bd tempest-TestInstancesWithCinderVolumes-733670174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ff2585b4-adbe-4275-96e5-fa9f1b94c4bd tempest-TestInstancesWithCinderVolumes-733670174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ff2585b4-adbe-4275-96e5-fa9f1b94c4bd tempest-TestInstancesWithCinderVolumes-733670174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:41 devstack sudo[100841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:46:41 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:41 devstack sudo[100838]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-106ce621-37ea-487d-a970-3842badbd8a5 tempest-CreateVolumesFromSnapshotTest-587921535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.329s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-106ce621-37ea-487d-a970-3842badbd8a5 tempest-CreateVolumesFromSnapshotTest-587921535 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:46:41 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-106ce621-37ea-487d-a970-3842badbd8a5 tempest-CreateVolumesFromSnapshotTest-587921535 None] Deleted volume successfully. Jul 28 10:46:41 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-106ce621-37ea-487d-a970-3842badbd8a5 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "cinder-713729d3-e3fb-4b7c-8112-ba7a2c76e385-delete_volume" released by "delete_volume" :: held 1.989s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:42 devstack sudo[100837]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30.bdc5dad6-fd5b-4495-a89d-a869ae5ac32d" returned: 0 in 0.624s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:42 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ede7d330-0d26-41fe-b3be-19a89dceaf30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:46:42 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30 {{(pid=88413) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 28 10:46:42 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Creating direct copy from snapshot {{(pid=88413) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 28 10:46:42 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[54be5a5f-da69-4e33-9a8f-c7b0d9a8a9c7]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:42 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ff2585b4-adbe-4275-96e5-fa9f1b94c4bd tempest-TestInstancesWithCinderVolumes-733670174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.397s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:42 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-ff2585b4-adbe-4275-96e5-fa9f1b94c4bd tempest-TestInstancesWithCinderVolumes-733670174 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:46:42 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-ff2585b4-adbe-4275-96e5-fa9f1b94c4bd tempest-TestInstancesWithCinderVolumes-733670174 None] Deleted volume successfully. Jul 28 10:46:42 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ff2585b4-adbe-4275-96e5-fa9f1b94c4bd tempest-TestInstancesWithCinderVolumes-733670174 None] Lock "cinder-cff137d9-a2cd-420a-bf49-143187d1d0de-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:42 devstack sudo[100849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30 Jul 28 10:46:42 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:42 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fb73b33f-0eb4-40bc-ab37-25c01bf11ba1 tempest-CreateVolumesFromSnapshotTest-587921535 None] Acquiring lock "cinder-4c469d9f-c361-4fd1-89ea-6d547c0d4b63-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:42 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fb73b33f-0eb4-40bc-ab37-25c01bf11ba1 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "cinder-4c469d9f-c361-4fd1-89ea-6d547c0d4b63-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:42 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fb73b33f-0eb4-40bc-ab37-25c01bf11ba1 tempest-CreateVolumesFromSnapshotTest-587921535 None] Acquiring lock "cinder-quobyte-4c469d9f-c361-4fd1-89ea-6d547c0d4b63" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:42 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fb73b33f-0eb4-40bc-ab37-25c01bf11ba1 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "cinder-quobyte-4c469d9f-c361-4fd1-89ea-6d547c0d4b63" acquired by "delete_volume" :: waited 0.029s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:42 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec2f165-6e0d-4ddb-b6fe-a0e465c4c73c]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fb73b33f-0eb4-40bc-ab37-25c01bf11ba1 tempest-CreateVolumesFromSnapshotTest-587921535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4c469d9f-c361-4fd1-89ea-6d547c0d4b63 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:42 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30" returned: 0 in 0.648s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:42 devstack cinder-volume[88413]: DEBUG cinder.utils [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Path /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-75b2c136-4984-415e-9ef3-5bb895709e07 not found in is_blk_device check {{(pid=88413) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 28 10:46:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-75b2c136-4984-415e-9ef3-5bb895709e07 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:42 devstack sudo[100852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4c469d9f-c361-4fd1-89ea-6d547c0d4b63 Jul 28 10:46:42 devstack sudo[100852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:42 devstack sudo[100856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-75b2c136-4984-415e-9ef3-5bb895709e07 Jul 28 10:46:42 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:43 devstack sudo[100852]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fb73b33f-0eb4-40bc-ab37-25c01bf11ba1 tempest-CreateVolumesFromSnapshotTest-587921535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4c469d9f-c361-4fd1-89ea-6d547c0d4b63" returned: 0 in 0.670s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fb73b33f-0eb4-40bc-ab37-25c01bf11ba1 tempest-CreateVolumesFromSnapshotTest-587921535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4c469d9f-c361-4fd1-89ea-6d547c0d4b63 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:43 devstack sudo[100866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4c469d9f-c361-4fd1-89ea-6d547c0d4b63 Jul 28 10:46:43 devstack sudo[100866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:43 devstack sudo[100866]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fb73b33f-0eb4-40bc-ab37-25c01bf11ba1 tempest-CreateVolumesFromSnapshotTest-587921535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4c469d9f-c361-4fd1-89ea-6d547c0d4b63" returned: 0 in 0.667s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:43 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fb73b33f-0eb4-40bc-ab37-25c01bf11ba1 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "cinder-quobyte-4c469d9f-c361-4fd1-89ea-6d547c0d4b63" released by "delete_volume" :: held 1.437s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:44 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-fb73b33f-0eb4-40bc-ab37-25c01bf11ba1 tempest-CreateVolumesFromSnapshotTest-587921535 None] Created reservations ['23cc3462-5701-46e4-a54c-6cd009586939', '248e6447-40b0-46d8-b730-238ce3330acb', 'b7209508-0c1c-4112-9c73-0ea79c9ac03d', 'df5a2783-0071-4e5e-afe8-93f576f858c0'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:46:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fb73b33f-0eb4-40bc-ab37-25c01bf11ba1 tempest-CreateVolumesFromSnapshotTest-587921535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fb73b33f-0eb4-40bc-ab37-25c01bf11ba1 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:44 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-fb73b33f-0eb4-40bc-ab37-25c01bf11ba1 tempest-CreateVolumesFromSnapshotTest-587921535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:46:44 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-fb73b33f-0eb4-40bc-ab37-25c01bf11ba1 tempest-CreateVolumesFromSnapshotTest-587921535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:46:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fb73b33f-0eb4-40bc-ab37-25c01bf11ba1 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fb73b33f-0eb4-40bc-ab37-25c01bf11ba1 tempest-CreateVolumesFromSnapshotTest-587921535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:44 devstack sudo[100881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:46:44 devstack sudo[100881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:45 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-449da845-331d-40de-be70-4061e9c6edac tempest-CreateVolumesFromSnapshotTest-587921535 None] Acquiring lock "cinder-03f757b2-9da3-4983-be96-2fac4121b60d-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:45 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-449da845-331d-40de-be70-4061e9c6edac tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "cinder-03f757b2-9da3-4983-be96-2fac4121b60d-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:45 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-449da845-331d-40de-be70-4061e9c6edac tempest-CreateVolumesFromSnapshotTest-587921535 None] Acquiring lock "cinder-quobyte-03f757b2-9da3-4983-be96-2fac4121b60d" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:45 devstack sudo[100881]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fb73b33f-0eb4-40bc-ab37-25c01bf11ba1 tempest-CreateVolumesFromSnapshotTest-587921535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.828s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:45 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-fb73b33f-0eb4-40bc-ab37-25c01bf11ba1 tempest-CreateVolumesFromSnapshotTest-587921535 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:46:45 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-449da845-331d-40de-be70-4061e9c6edac tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "cinder-quobyte-03f757b2-9da3-4983-be96-2fac4121b60d" acquired by "delete_volume" :: waited 0.082s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:45 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-fb73b33f-0eb4-40bc-ab37-25c01bf11ba1 tempest-CreateVolumesFromSnapshotTest-587921535 None] Deleted volume successfully. Jul 28 10:46:45 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[788f69a3-df5c-4c68-a629-b1194535f288]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-449da845-331d-40de-be70-4061e9c6edac tempest-CreateVolumesFromSnapshotTest-587921535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-03f757b2-9da3-4983-be96-2fac4121b60d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:45 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fb73b33f-0eb4-40bc-ab37-25c01bf11ba1 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "cinder-4c469d9f-c361-4fd1-89ea-6d547c0d4b63-delete_volume" released by "delete_volume" :: held 3.423s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:45 devstack sudo[100904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-03f757b2-9da3-4983-be96-2fac4121b60d Jul 28 10:46:45 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:46 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-449da845-331d-40de-be70-4061e9c6edac tempest-CreateVolumesFromSnapshotTest-587921535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-03f757b2-9da3-4983-be96-2fac4121b60d" returned: 0 in 0.725s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-449da845-331d-40de-be70-4061e9c6edac tempest-CreateVolumesFromSnapshotTest-587921535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-03f757b2-9da3-4983-be96-2fac4121b60d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:46 devstack sudo[100914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-03f757b2-9da3-4983-be96-2fac4121b60d Jul 28 10:46:46 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:47 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-449da845-331d-40de-be70-4061e9c6edac tempest-CreateVolumesFromSnapshotTest-587921535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-03f757b2-9da3-4983-be96-2fac4121b60d" returned: 0 in 0.834s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:47 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-449da845-331d-40de-be70-4061e9c6edac tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "cinder-quobyte-03f757b2-9da3-4983-be96-2fac4121b60d" released by "delete_volume" :: held 1.764s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:47 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-449da845-331d-40de-be70-4061e9c6edac tempest-CreateVolumesFromSnapshotTest-587921535 None] Created reservations ['34326cff-b8a4-42ae-aea1-afdcdddc7571', 'dce7fa2f-cd3a-4a5f-87dc-a7fe9b1365d5', 'b36e77d4-9ee9-45c1-9ddb-cc67a3ea002c', 'd6142d7b-df09-4097-a3c4-19474747ca50'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:46:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-449da845-331d-40de-be70-4061e9c6edac tempest-CreateVolumesFromSnapshotTest-587921535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-449da845-331d-40de-be70-4061e9c6edac tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:47 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-449da845-331d-40de-be70-4061e9c6edac tempest-CreateVolumesFromSnapshotTest-587921535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:46:47 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-449da845-331d-40de-be70-4061e9c6edac tempest-CreateVolumesFromSnapshotTest-587921535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:46:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-449da845-331d-40de-be70-4061e9c6edac tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-449da845-331d-40de-be70-4061e9c6edac tempest-CreateVolumesFromSnapshotTest-587921535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:47 devstack sudo[100918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:46:47 devstack sudo[100918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-54ab1ded-d397-4e9f-b2ef-54579335f1b5 tempest-CreateVolumesFromSnapshotTest-587921535 None] Acquiring lock "cinder-71ed53c3-f2ff-4612-a43c-66e95b4e0756-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-54ab1ded-d397-4e9f-b2ef-54579335f1b5 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "cinder-71ed53c3-f2ff-4612-a43c-66e95b4e0756-delete_snapshot" acquired by "delete_snapshot" :: waited 0.076s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-54ab1ded-d397-4e9f-b2ef-54579335f1b5 tempest-CreateVolumesFromSnapshotTest-587921535 None] Acquiring lock "cinder-quobyte-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:48 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-dacfb369-23bf-40ef-be03-5b887495a833 req-1b321e7b-a01d-4db7-bd17-48e3ed859d65 tempest-TestInstancesWithCinderVolumes-733670174 None] Terminate volume connection completed successfully. Jul 28 10:46:48 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-dacfb369-23bf-40ef-be03-5b887495a833 req-1b321e7b-a01d-4db7-bd17-48e3ed859d65 tempest-TestInstancesWithCinderVolumes-733670174 None] Deleting attachment 8eaa7e08-ed1a-47b1-a69b-3319ac737a90. {{(pid=88413) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 10:46:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-54ab1ded-d397-4e9f-b2ef-54579335f1b5 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "cinder-quobyte-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-54ab1ded-d397-4e9f-b2ef-54579335f1b5 tempest-CreateVolumesFromSnapshotTest-587921535 None] Acquiring lock "cinder-quobyte-71ed53c3-f2ff-4612-a43c-66e95b4e0756" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-54ab1ded-d397-4e9f-b2ef-54579335f1b5 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "cinder-quobyte-71ed53c3-f2ff-4612-a43c-66e95b4e0756" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:48 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-54ab1ded-d397-4e9f-b2ef-54579335f1b5 tempest-CreateVolumesFromSnapshotTest-587921535 None] Deleting offline snapshot 71ed53c3-f2ff-4612-a43c-66e95b4e0756 of volume c8c20e6b-2c90-4a6e-a77f-96a62f6103a6 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:46:48 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-54ab1ded-d397-4e9f-b2ef-54579335f1b5 tempest-CreateVolumesFromSnapshotTest-587921535 None] snapshot_file for this snap is: volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6.71ed53c3-f2ff-4612-a43c-66e95b4e0756 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:46:48 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[5791a4e1-8911-436b-9317-baf1fa3465ed]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-54ab1ded-d397-4e9f-b2ef-54579335f1b5 tempest-CreateVolumesFromSnapshotTest-587921535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6.71ed53c3-f2ff-4612-a43c-66e95b4e0756 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:48 devstack sudo[100918]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-449da845-331d-40de-be70-4061e9c6edac tempest-CreateVolumesFromSnapshotTest-587921535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.707s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:48 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-449da845-331d-40de-be70-4061e9c6edac tempest-CreateVolumesFromSnapshotTest-587921535 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:46:48 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-449da845-331d-40de-be70-4061e9c6edac tempest-CreateVolumesFromSnapshotTest-587921535 None] Deleted volume successfully. Jul 28 10:46:48 devstack sudo[100920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6.71ed53c3-f2ff-4612-a43c-66e95b4e0756 Jul 28 10:46:48 devstack sudo[100920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-449da845-331d-40de-be70-4061e9c6edac tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "cinder-03f757b2-9da3-4983-be96-2fac4121b60d-delete_volume" released by "delete_volume" :: held 3.516s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:49 devstack sudo[100920]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-54ab1ded-d397-4e9f-b2ef-54579335f1b5 tempest-CreateVolumesFromSnapshotTest-587921535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6.71ed53c3-f2ff-4612-a43c-66e95b4e0756" returned: 0 in 1.324s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:49 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-54ab1ded-d397-4e9f-b2ef-54579335f1b5 tempest-CreateVolumesFromSnapshotTest-587921535 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:46:49 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f641716-6003-4a2f-8dee-25b7301e36b0]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-54ab1ded-d397-4e9f-b2ef-54579335f1b5 tempest-CreateVolumesFromSnapshotTest-587921535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:49 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-75b2c136-4984-415e-9ef3-5bb895709e07" returned: 0 in 7.265s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:50 devstack sudo[100930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6 Jul 28 10:46:50 devstack sudo[100930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:50 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[71007075-8748-4217-b49f-c8fbf116a765]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:50 devstack sudo[100932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30 Jul 28 10:46:50 devstack sudo[100932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:50 devstack sudo[100930]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-54ab1ded-d397-4e9f-b2ef-54579335f1b5 tempest-CreateVolumesFromSnapshotTest-587921535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6" returned: 0 in 0.484s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-54ab1ded-d397-4e9f-b2ef-54579335f1b5 tempest-CreateVolumesFromSnapshotTest-587921535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6.71ed53c3-f2ff-4612-a43c-66e95b4e0756 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:50 devstack sudo[100937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6.71ed53c3-f2ff-4612-a43c-66e95b4e0756 Jul 28 10:46:50 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:50 devstack sudo[100932]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30" returned: 0 in 0.580s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:50 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30, size 1024.00 MB, duration 7.27 sec, destination /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-75b2c136-4984-415e-9ef3-5bb895709e07 {{(pid=88413) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 10:46:50 devstack cinder-volume[88413]: INFO cinder.image.image_utils [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Converted 1024.00 MB image at 140.93 MB/s Jul 28 10:46:50 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-75b2c136-4984-415e-9ef3-5bb895709e07 is being set with open permissions: ugo+rw Jul 28 10:46:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-75b2c136-4984-415e-9ef3-5bb895709e07 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:50 devstack sudo[100945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-75b2c136-4984-415e-9ef3-5bb895709e07 Jul 28 10:46:50 devstack sudo[100945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4d034e8c-fd8e-4d9f-8a90-57998d8ea200 tempest-TestInstancesWithCinderVolumes-733670174 None] Acquiring lock "cinder-2d7abac5-60fa-4005-8237-8e02d2de135a-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4d034e8c-fd8e-4d9f-8a90-57998d8ea200 tempest-TestInstancesWithCinderVolumes-733670174 None] Lock "cinder-2d7abac5-60fa-4005-8237-8e02d2de135a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:50 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-54ab1ded-d397-4e9f-b2ef-54579335f1b5 tempest-CreateVolumesFromSnapshotTest-587921535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6.71ed53c3-f2ff-4612-a43c-66e95b4e0756" returned: 0 in 0.485s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-54ab1ded-d397-4e9f-b2ef-54579335f1b5 tempest-CreateVolumesFromSnapshotTest-587921535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6.71ed53c3-f2ff-4612-a43c-66e95b4e0756 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:50 devstack sudo[100947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6.71ed53c3-f2ff-4612-a43c-66e95b4e0756 Jul 28 10:46:50 devstack sudo[100947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4d034e8c-fd8e-4d9f-8a90-57998d8ea200 tempest-TestInstancesWithCinderVolumes-733670174 None] Acquiring lock "cinder-quobyte-2d7abac5-60fa-4005-8237-8e02d2de135a" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4d034e8c-fd8e-4d9f-8a90-57998d8ea200 tempest-TestInstancesWithCinderVolumes-733670174 None] Lock "cinder-quobyte-2d7abac5-60fa-4005-8237-8e02d2de135a" acquired by "delete_volume" :: waited 0.022s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:50 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[1732edc7-8a7c-426c-bf5b-0035be219559]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4d034e8c-fd8e-4d9f-8a90-57998d8ea200 tempest-TestInstancesWithCinderVolumes-733670174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2d7abac5-60fa-4005-8237-8e02d2de135a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:50 devstack sudo[100945]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-75b2c136-4984-415e-9ef3-5bb895709e07" returned: 0 in 0.327s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-quobyte-75b2c136-4984-415e-9ef3-5bb895709e07" released by "_copy_volume_from_snapshot" :: held 9.626s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-quobyte-bdc5dad6-fd5b-4495-a89d-a869ae5ac32d-75b2c136-4984-415e-9ef3-5bb895709e07" released by "_create_volume_from_snapshot" :: held 9.682s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.726s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:50 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17799dfd-ad1e-445e-83e7-93110d53243c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75b2c136-4984-415e-9ef3-5bb895709e07', 'volume_size': 1, 'snapshot_id': 'bdc5dad6-fd5b-4495-a89d-a869ae5ac32d'}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcfb2cca-6cbe-47a0-a31c-bd657b74427f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:51 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Volume volume-75b2c136-4984-415e-9ef3-5bb895709e07 (75b2c136-4984-415e-9ef3-5bb895709e07): created successfully Jul 28 10:46:51 devstack sudo[100950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2d7abac5-60fa-4005-8237-8e02d2de135a Jul 28 10:46:51 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcfb2cca-6cbe-47a0-a31c-bd657b74427f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Flow 'volume_create_manager' (378b6b47-34c5-49e7-aa5e-5f39546eb172) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:46:51 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-3b3fa265-e997-4ae1-b316-5e6832a7b35d tempest-VolumesSnapshotTestJSON-50191109 None] Created volume successfully. Jul 28 10:46:51 devstack sudo[100947]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-54ab1ded-d397-4e9f-b2ef-54579335f1b5 tempest-CreateVolumesFromSnapshotTest-587921535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6.71ed53c3-f2ff-4612-a43c-66e95b4e0756" returned: 0 in 0.332s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-54ab1ded-d397-4e9f-b2ef-54579335f1b5 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "cinder-quobyte-71ed53c3-f2ff-4612-a43c-66e95b4e0756" released by "_delete_snapshot" :: held 2.885s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-54ab1ded-d397-4e9f-b2ef-54579335f1b5 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "cinder-quobyte-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6" released by "delete_snapshot" :: held 2.947s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:51 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-54ab1ded-d397-4e9f-b2ef-54579335f1b5 tempest-CreateVolumesFromSnapshotTest-587921535 None] Created reservations ['2f25bbdf-e7d9-44ea-ba9c-7486afc70cef', '4b701501-d59f-4029-a89d-7766777f1cf9', 'a55d8dc1-f509-46a5-81db-dc5189a8894a', '11ff096f-5a3a-411c-9305-5e24c333d8e5'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:46:51 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-54ab1ded-d397-4e9f-b2ef-54579335f1b5 tempest-CreateVolumesFromSnapshotTest-587921535 None] Delete snapshot completed successfully. Jul 28 10:46:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-54ab1ded-d397-4e9f-b2ef-54579335f1b5 tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "cinder-71ed53c3-f2ff-4612-a43c-66e95b4e0756-delete_snapshot" released by "delete_snapshot" :: held 3.133s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:51 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4d034e8c-fd8e-4d9f-8a90-57998d8ea200 tempest-TestInstancesWithCinderVolumes-733670174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2d7abac5-60fa-4005-8237-8e02d2de135a" returned: 0 in 0.442s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4d034e8c-fd8e-4d9f-8a90-57998d8ea200 tempest-TestInstancesWithCinderVolumes-733670174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2d7abac5-60fa-4005-8237-8e02d2de135a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:51 devstack sudo[100957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2d7abac5-60fa-4005-8237-8e02d2de135a Jul 28 10:46:51 devstack sudo[100957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-a2440d21-f887-4a97-b4a4-4f50403ecc3c tempest-CreateVolumesFromSnapshotTest-587921535 None] Acquiring lock "cinder-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-a2440d21-f887-4a97-b4a4-4f50403ecc3c tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "cinder-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-a2440d21-f887-4a97-b4a4-4f50403ecc3c tempest-CreateVolumesFromSnapshotTest-587921535 None] Acquiring lock "cinder-quobyte-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-73290ee5-da30-4ba9-be98-56b602c00815 tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "cinder-75b2c136-4984-415e-9ef3-5bb895709e07-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-a2440d21-f887-4a97-b4a4-4f50403ecc3c tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "cinder-quobyte-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6" acquired by "delete_volume" :: waited 0.040s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:51 devstack sudo[100957]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-73290ee5-da30-4ba9-be98-56b602c00815 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-75b2c136-4984-415e-9ef3-5bb895709e07-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4d034e8c-fd8e-4d9f-8a90-57998d8ea200 tempest-TestInstancesWithCinderVolumes-733670174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2d7abac5-60fa-4005-8237-8e02d2de135a" returned: 0 in 0.300s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4d034e8c-fd8e-4d9f-8a90-57998d8ea200 tempest-TestInstancesWithCinderVolumes-733670174 None] Lock "cinder-quobyte-2d7abac5-60fa-4005-8237-8e02d2de135a" released by "delete_volume" :: held 0.795s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:51 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a7314c-3d48-4f23-8bb1-cdfae47386d6]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a2440d21-f887-4a97-b4a4-4f50403ecc3c tempest-CreateVolumesFromSnapshotTest-587921535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-73290ee5-da30-4ba9-be98-56b602c00815 tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "cinder-quobyte-75b2c136-4984-415e-9ef3-5bb895709e07" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-73290ee5-da30-4ba9-be98-56b602c00815 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-quobyte-75b2c136-4984-415e-9ef3-5bb895709e07" acquired by "delete_volume" :: waited 0.025s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:51 devstack cinder-volume[88413]: WARNING cinder.quota [None req-4d034e8c-fd8e-4d9f-8a90-57998d8ea200 tempest-TestInstancesWithCinderVolumes-733670174 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2007549497-1439043749 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2007549497-1439043749, it is now deprecated. Please use the default quota class for default quota. Jul 28 10:46:51 devstack cinder-volume[88413]: WARNING cinder.quota [None req-4d034e8c-fd8e-4d9f-8a90-57998d8ea200 tempest-TestInstancesWithCinderVolumes-733670174 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2007549497-1439043749 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2007549497-1439043749, it is now deprecated. Please use the default quota class for default quota. Jul 28 10:46:51 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db4e029-738f-48a6-afb8-5a37d34a7e89]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-73290ee5-da30-4ba9-be98-56b602c00815 tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-75b2c136-4984-415e-9ef3-5bb895709e07 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:51 devstack sudo[100960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6 Jul 28 10:46:51 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-4d034e8c-fd8e-4d9f-8a90-57998d8ea200 tempest-TestInstancesWithCinderVolumes-733670174 None] Created reservations ['bfebf79f-7a58-4e96-bba7-90ef056adbee', 'a6b80fb7-a5b4-4e77-bdec-4967a2452619', '591d15e5-b7c8-43cd-8ea5-67096c95e2a8', '32e402c0-f487-4306-909b-8b788df91c5a'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:46:51 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:51 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:46:51 devstack sudo[100961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-75b2c136-4984-415e-9ef3-5bb895709e07 Jul 28 10:46:51 devstack sudo[100961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Flow 'volume_create_manager' (ce994e06-1ebd-4c2f-8acb-5a92d1aafd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:46:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d59f9ec2-7f04-4f3e-baf9-2a0fbb1005a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d59f9ec2-7f04-4f3e-baf9-2a0fbb1005a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1668847236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2478afe9-04fc-46fd-9522-36a24514b7b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a74ac2968bc54a55ad81a0c7dd5b27b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:46:52Z,use_quota=True,user_id='70cf4e4ca5244750938450ed583a20bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71da4f62-c1c2-4e87-b917-7c1bf44511fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71da4f62-c1c2-4e87-b917-7c1bf44511fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7164fb66-8aa5-4d6f-a318-20203d8c86d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG cinder.image.glance [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Creating Keystone auth plugin from conf {{(pid=88413) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-4d034e8c-fd8e-4d9f-8a90-57998d8ea200 tempest-TestInstancesWithCinderVolumes-733670174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-4d034e8c-fd8e-4d9f-8a90-57998d8ea200 tempest-TestInstancesWithCinderVolumes-733670174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-4d034e8c-fd8e-4d9f-8a90-57998d8ea200 tempest-TestInstancesWithCinderVolumes-733670174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-4d034e8c-fd8e-4d9f-8a90-57998d8ea200 tempest-TestInstancesWithCinderVolumes-733670174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-4d034e8c-fd8e-4d9f-8a90-57998d8ea200 tempest-TestInstancesWithCinderVolumes-733670174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4d034e8c-fd8e-4d9f-8a90-57998d8ea200 tempest-TestInstancesWithCinderVolumes-733670174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:52 devstack sudo[100964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:46:52 devstack sudo[100964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:52 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a2440d21-f887-4a97-b4a4-4f50403ecc3c tempest-CreateVolumesFromSnapshotTest-587921535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6" returned: 0 in 0.505s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a2440d21-f887-4a97-b4a4-4f50403ecc3c tempest-CreateVolumesFromSnapshotTest-587921535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:52 devstack sudo[100961]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:52 devstack sudo[100973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6 Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-73290ee5-da30-4ba9-be98-56b602c00815 tempest-VolumesSnapshotTestJSON-50191109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-75b2c136-4984-415e-9ef3-5bb895709e07" returned: 0 in 0.434s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:52 devstack sudo[100973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-73290ee5-da30-4ba9-be98-56b602c00815 tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-75b2c136-4984-415e-9ef3-5bb895709e07 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:52 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-75b2c136-4984-415e-9ef3-5bb895709e07 Jul 28 10:46:52 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7164fb66-8aa5-4d6f-a318-20203d8c86d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2478afe9-04fc-46fd-9522-36a24514b7b4', 'volume_name': 'volume-2478afe9-04fc-46fd-9522-36a24514b7b4', 'volume_size': 1, 'image_id': '3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b606c34dd1dc45a6a010943235754dcb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'created_at': datetime.datetime(2026, 7, 28, 8, 30, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 8, 30, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c7ac9f7-f638-43c1-9c8d-41f36b0aec05/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1b77e2b-0164-49e1-bf81-9fdb134e556b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1b77e2b-0164-49e1-bf81-9fdb134e556b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d323183-d130-447d-8e6b-d34e837ec57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:52 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Volume 2478afe9-04fc-46fd-9522-36a24514b7b4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2478afe9-04fc-46fd-9522-36a24514b7b4', 'volume_size': 1, 'image_id': '3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b606c34dd1dc45a6a010943235754dcb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'created_at': datetime.datetime(2026, 7, 28, 8, 30, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 8, 30, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c7ac9f7-f638-43c1-9c8d-41f36b0aec05/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Trying to clone 2478afe9-04fc-46fd-9522-36a24514b7b4 from image 3c7ac9f7-f638-43c1-9c8d-41f36b0aec05 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'metadata': {}}]). {{(pid=88413) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 28 10:46:52 devstack sudo[100964]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4d034e8c-fd8e-4d9f-8a90-57998d8ea200 tempest-TestInstancesWithCinderVolumes-733670174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.309s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-4d034e8c-fd8e-4d9f-8a90-57998d8ea200 tempest-TestInstancesWithCinderVolumes-733670174 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:46:52 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-4d034e8c-fd8e-4d9f-8a90-57998d8ea200 tempest-TestInstancesWithCinderVolumes-733670174 None] Deleted volume successfully. Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4d034e8c-fd8e-4d9f-8a90-57998d8ea200 tempest-TestInstancesWithCinderVolumes-733670174 None] Lock "cinder-2d7abac5-60fa-4005-8237-8e02d2de135a-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:52 devstack sudo[100973]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a2440d21-f887-4a97-b4a4-4f50403ecc3c tempest-CreateVolumesFromSnapshotTest-587921535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6" returned: 0 in 0.288s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-a2440d21-f887-4a97-b4a4-4f50403ecc3c tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "cinder-quobyte-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6" released by "delete_volume" :: held 0.910s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:52 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-73290ee5-da30-4ba9-be98-56b602c00815 tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-75b2c136-4984-415e-9ef3-5bb895709e07" returned: 0 in 0.311s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-73290ee5-da30-4ba9-be98-56b602c00815 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-quobyte-75b2c136-4984-415e-9ef3-5bb895709e07" released by "delete_volume" :: held 0.818s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-a2440d21-f887-4a97-b4a4-4f50403ecc3c tempest-CreateVolumesFromSnapshotTest-587921535 None] Created reservations ['564fc1e6-6848-4968-9eff-2a25d56987aa', 'b3a3730c-fe6c-4dba-955c-ec2315f172f0', 'b4ce24d3-f291-43e3-bab2-3400dbd0c8ae', '0a401d66-b721-4e28-8317-2722b916c0eb'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-73290ee5-da30-4ba9-be98-56b602c00815 tempest-VolumesSnapshotTestJSON-50191109 None] Created reservations ['412275c6-2f01-4e5f-8942-6dd0d28738b1', '2d4c46c3-166f-48ca-a102-f9ac977ade8e', '35c0f1ab-f22d-4e12-b308-7a119fae51b6', 'ff996a78-f06f-4d2e-a74f-18f6ccc9bc00'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_fvq2yxa9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88413) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 28 10:46:52 devstack cinder-volume[88413]: INFO cinder.image.image_utils [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Image download 20.69 MB at 20.69 MB/s Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a2440d21-f887-4a97-b4a4-4f50403ecc3c tempest-CreateVolumesFromSnapshotTest-587921535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a2440d21-f887-4a97-b4a4-4f50403ecc3c tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-a2440d21-f887-4a97-b4a4-4f50403ecc3c tempest-CreateVolumesFromSnapshotTest-587921535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-a2440d21-f887-4a97-b4a4-4f50403ecc3c tempest-CreateVolumesFromSnapshotTest-587921535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a2440d21-f887-4a97-b4a4-4f50403ecc3c tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a2440d21-f887-4a97-b4a4-4f50403ecc3c tempest-CreateVolumesFromSnapshotTest-587921535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e58866-1cea-4114-b568-df0d60c4edda]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_fvq2yxa9devstack@QuobyteHD {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:52 devstack sudo[100981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:46:52 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-73290ee5-da30-4ba9-be98-56b602c00815 tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-73290ee5-da30-4ba9-be98-56b602c00815 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-73290ee5-da30-4ba9-be98-56b602c00815 tempest-VolumesSnapshotTestJSON-50191109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-73290ee5-da30-4ba9-be98-56b602c00815 tempest-VolumesSnapshotTestJSON-50191109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-73290ee5-da30-4ba9-be98-56b602c00815 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-73290ee5-da30-4ba9-be98-56b602c00815 tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:52 devstack sudo[100984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:46:52 devstack sudo[100984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:52 devstack sudo[100983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_fvq2yxa9devstack@QuobyteHD Jul 28 10:46:52 devstack sudo[100983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:53 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a2440d21-f887-4a97-b4a4-4f50403ecc3c tempest-CreateVolumesFromSnapshotTest-587921535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.271s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:53 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-a2440d21-f887-4a97-b4a4-4f50403ecc3c tempest-CreateVolumesFromSnapshotTest-587921535 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:46:53 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-a2440d21-f887-4a97-b4a4-4f50403ecc3c tempest-CreateVolumesFromSnapshotTest-587921535 None] Deleted volume successfully. Jul 28 10:46:53 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-a2440d21-f887-4a97-b4a4-4f50403ecc3c tempest-CreateVolumesFromSnapshotTest-587921535 None] Lock "cinder-c8c20e6b-2c90-4a6e-a77f-96a62f6103a6-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:53 devstack sudo[100984]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-73290ee5-da30-4ba9-be98-56b602c00815 tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.301s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:53 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-73290ee5-da30-4ba9-be98-56b602c00815 tempest-VolumesSnapshotTestJSON-50191109 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:46:53 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-73290ee5-da30-4ba9-be98-56b602c00815 tempest-VolumesSnapshotTestJSON-50191109 None] Deleted volume successfully. Jul 28 10:46:53 devstack sudo[100983]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:53 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-73290ee5-da30-4ba9-be98-56b602c00815 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-75b2c136-4984-415e-9ef3-5bb895709e07-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_fvq2yxa9devstack@QuobyteHD" returned: 0 in 0.391s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:53 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Temporary image 3c7ac9f7-f638-43c1-9c8d-41f36b0aec05 is fetched for user 70cf4e4ca5244750938450ed583a20bf. {{(pid=88413) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 28 10:46:53 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[936a97fa-f071-4845-8150-7e44dccab213]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_fvq2yxa9devstack@QuobyteHD {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:53 devstack sudo[100992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_fvq2yxa9devstack@QuobyteHD Jul 28 10:46:53 devstack sudo[100992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:53 devstack sudo[100992]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_fvq2yxa9devstack@QuobyteHD" returned: 0 in 0.330s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:53 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1668847236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2478afe9-04fc-46fd-9522-36a24514b7b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a74ac2968bc54a55ad81a0c7dd5b27b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:46:52Z,use_quota=True,user_id='70cf4e4ca5244750938450ed583a20bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:46:53 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Creating volume 2478afe9-04fc-46fd-9522-36a24514b7b4 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:46:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:53 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:46:53 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:46:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:53 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:46:53 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:46:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2478afe9-04fc-46fd-9522-36a24514b7b4 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:53 devstack sudo[100997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2478afe9-04fc-46fd-9522-36a24514b7b4 1073741824 Jul 28 10:46:53 devstack sudo[100997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:53 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-18f145a2-ebf8-4bbe-acf9-d590d571e958 tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "cinder-bdc5dad6-fd5b-4495-a89d-a869ae5ac32d-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:53 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-18f145a2-ebf8-4bbe-acf9-d590d571e958 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-bdc5dad6-fd5b-4495-a89d-a869ae5ac32d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:54 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-18f145a2-ebf8-4bbe-acf9-d590d571e958 tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "cinder-quobyte-ede7d330-0d26-41fe-b3be-19a89dceaf30" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:54 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-18f145a2-ebf8-4bbe-acf9-d590d571e958 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-quobyte-ede7d330-0d26-41fe-b3be-19a89dceaf30" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:54 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-18f145a2-ebf8-4bbe-acf9-d590d571e958 tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "cinder-quobyte-bdc5dad6-fd5b-4495-a89d-a869ae5ac32d" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:54 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-18f145a2-ebf8-4bbe-acf9-d590d571e958 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-quobyte-bdc5dad6-fd5b-4495-a89d-a869ae5ac32d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:54 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-18f145a2-ebf8-4bbe-acf9-d590d571e958 tempest-VolumesSnapshotTestJSON-50191109 None] Deleting offline snapshot bdc5dad6-fd5b-4495-a89d-a869ae5ac32d of volume ede7d330-0d26-41fe-b3be-19a89dceaf30 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:46:54 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-18f145a2-ebf8-4bbe-acf9-d590d571e958 tempest-VolumesSnapshotTestJSON-50191109 None] snapshot_file for this snap is: volume-ede7d330-0d26-41fe-b3be-19a89dceaf30.bdc5dad6-fd5b-4495-a89d-a869ae5ac32d {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:46:54 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[7642fe5b-3ff0-4b0f-b0b0-5727ed6a1105]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-18f145a2-ebf8-4bbe-acf9-d590d571e958 tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30.bdc5dad6-fd5b-4495-a89d-a869ae5ac32d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:54 devstack sudo[100997]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:54 devstack sudo[101002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30.bdc5dad6-fd5b-4495-a89d-a869ae5ac32d Jul 28 10:46:54 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2478afe9-04fc-46fd-9522-36a24514b7b4 1073741824" returned: 0 in 0.599s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2478afe9-04fc-46fd-9522-36a24514b7b4 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:54 devstack sudo[101005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2478afe9-04fc-46fd-9522-36a24514b7b4 Jul 28 10:46:54 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:54 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-18f145a2-ebf8-4bbe-acf9-d590d571e958 tempest-VolumesSnapshotTestJSON-50191109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30.bdc5dad6-fd5b-4495-a89d-a869ae5ac32d" returned: 0 in 0.433s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:54 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-18f145a2-ebf8-4bbe-acf9-d590d571e958 tempest-VolumesSnapshotTestJSON-50191109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ede7d330-0d26-41fe-b3be-19a89dceaf30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:46:54 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2478afe9-04fc-46fd-9522-36a24514b7b4" returned: 0 in 0.315s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:54 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:46:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:54 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03c8ef3-10e4-4ecc-a8a4-aa3624fc5756]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-18f145a2-ebf8-4bbe-acf9-d590d571e958 tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:54 devstack cinder-volume[88413]: DEBUG cinder.volume.volume_utils [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Attempting download of 3c7ac9f7-f638-43c1-9c8d-41f36b0aec05 ((None, [{'url': 'file:///opt/stack/data/glance/images/3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'metadata': {}}])) to volume 2478afe9-04fc-46fd-9522-36a24514b7b4. {{(pid=88413) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 28 10:46:54 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3fd728-cbbd-4671-a63d-b6f2c4fc9210]: (4, 'raw') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_pu3mlacs {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:54 devstack sudo[101012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30 Jul 28 10:46:54 devstack sudo[101012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:54 devstack sudo[101013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_pu3mlacs Jul 28 10:46:54 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:55 devstack sudo[101012]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-18f145a2-ebf8-4bbe-acf9-d590d571e958 tempest-VolumesSnapshotTestJSON-50191109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30" returned: 0 in 0.524s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-18f145a2-ebf8-4bbe-acf9-d590d571e958 tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30.bdc5dad6-fd5b-4495-a89d-a869ae5ac32d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:55 devstack sudo[101020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30.bdc5dad6-fd5b-4495-a89d-a869ae5ac32d Jul 28 10:46:55 devstack sudo[101020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:55 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_pu3mlacs" returned: 0 in 0.531s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_pu3mlacs {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:55 devstack sudo[101024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_pu3mlacs Jul 28 10:46:55 devstack sudo[101024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:55 devstack sudo[101020]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-18f145a2-ebf8-4bbe-acf9-d590d571e958 tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30.bdc5dad6-fd5b-4495-a89d-a869ae5ac32d" returned: 0 in 0.499s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-18f145a2-ebf8-4bbe-acf9-d590d571e958 tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30.bdc5dad6-fd5b-4495-a89d-a869ae5ac32d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:55 devstack sudo[101031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30.bdc5dad6-fd5b-4495-a89d-a869ae5ac32d Jul 28 10:46:55 devstack sudo[101031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:55 devstack sudo[101024]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_pu3mlacs" returned: 1 in 0.458s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_pu3mlacs' failed. Not Retrying. {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 10:46:55 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87c7dfa-770c-4ec3-a080-b70c84ce945e]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_fvq2yxa9devstack@QuobyteHD {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:55 devstack sudo[101035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_fvq2yxa9devstack@QuobyteHD Jul 28 10:46:55 devstack sudo[101035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:55 devstack sudo[101031]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-18f145a2-ebf8-4bbe-acf9-d590d571e958 tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30.bdc5dad6-fd5b-4495-a89d-a869ae5ac32d" returned: 0 in 0.338s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:56 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-18f145a2-ebf8-4bbe-acf9-d590d571e958 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-quobyte-bdc5dad6-fd5b-4495-a89d-a869ae5ac32d" released by "_delete_snapshot" :: held 2.064s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:56 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-18f145a2-ebf8-4bbe-acf9-d590d571e958 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-quobyte-ede7d330-0d26-41fe-b3be-19a89dceaf30" released by "delete_snapshot" :: held 2.106s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:56 devstack sudo[101035]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_fvq2yxa9devstack@QuobyteHD" returned: 0 in 0.403s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:56 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] 3c7ac9f7-f638-43c1-9c8d-41f36b0aec05 was qcow2, converting to qcow2 {{(pid=88413) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 28 10:46:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_fvq2yxa9devstack@QuobyteHD /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2478afe9-04fc-46fd-9522-36a24514b7b4 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:56 devstack sudo[101042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_fvq2yxa9devstack@QuobyteHD /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2478afe9-04fc-46fd-9522-36a24514b7b4 Jul 28 10:46:56 devstack sudo[101042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:56 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-18f145a2-ebf8-4bbe-acf9-d590d571e958 tempest-VolumesSnapshotTestJSON-50191109 None] Created reservations ['b3b0f057-4b23-4e6d-bdcb-42c1eca06c7c', 'f59e04c9-fed2-4850-acab-67862525fb7d', '5f5da9e3-ca3f-4bfc-bdcc-9242afa70fd0', '27abd6dd-3905-444c-9d87-2cfefefed1af'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:46:56 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-18f145a2-ebf8-4bbe-acf9-d590d571e958 tempest-VolumesSnapshotTestJSON-50191109 None] Delete snapshot completed successfully. Jul 28 10:46:56 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-18f145a2-ebf8-4bbe-acf9-d590d571e958 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-bdc5dad6-fd5b-4495-a89d-a869ae5ac32d-delete_snapshot" released by "delete_snapshot" :: held 2.326s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:57 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e1aed5b2-5b08-492a-b586-ccb50c94500e tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "cinder-ede7d330-0d26-41fe-b3be-19a89dceaf30-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:57 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e1aed5b2-5b08-492a-b586-ccb50c94500e tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-ede7d330-0d26-41fe-b3be-19a89dceaf30-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:57 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e1aed5b2-5b08-492a-b586-ccb50c94500e tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "cinder-quobyte-ede7d330-0d26-41fe-b3be-19a89dceaf30" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:57 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e1aed5b2-5b08-492a-b586-ccb50c94500e tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-quobyte-ede7d330-0d26-41fe-b3be-19a89dceaf30" acquired by "delete_volume" :: waited 0.016s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:57 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a0d86e-b445-40cf-a610-9b16f518c088]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e1aed5b2-5b08-492a-b586-ccb50c94500e tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:57 devstack sudo[101051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30 Jul 28 10:46:57 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:57 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e1aed5b2-5b08-492a-b586-ccb50c94500e tempest-VolumesSnapshotTestJSON-50191109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30" returned: 0 in 0.473s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e1aed5b2-5b08-492a-b586-ccb50c94500e tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:57 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30 Jul 28 10:46:57 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:58 devstack sudo[101042]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_fvq2yxa9devstack@QuobyteHD /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2478afe9-04fc-46fd-9522-36a24514b7b4" returned: 0 in 2.096s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:58 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_fvq2yxa9devstack@QuobyteHD, size 112.00 MB, duration 2.10 sec, destination /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2478afe9-04fc-46fd-9522-36a24514b7b4 {{(pid=88413) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 10:46:58 devstack cinder-volume[88413]: INFO cinder.image.image_utils [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Converted 112.00 MB image at 53.39 MB/s Jul 28 10:46:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2478afe9-04fc-46fd-9522-36a24514b7b4 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:58 devstack sudo[101062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2478afe9-04fc-46fd-9522-36a24514b7b4 1G Jul 28 10:46:58 devstack sudo[101062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:58 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e1aed5b2-5b08-492a-b586-ccb50c94500e tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ede7d330-0d26-41fe-b3be-19a89dceaf30" returned: 0 in 0.350s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:58 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e1aed5b2-5b08-492a-b586-ccb50c94500e tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-quobyte-ede7d330-0d26-41fe-b3be-19a89dceaf30" released by "delete_volume" :: held 0.909s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:58 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-e1aed5b2-5b08-492a-b586-ccb50c94500e tempest-VolumesSnapshotTestJSON-50191109 None] Created reservations ['030bf4f6-1032-4e98-82fe-657732fa4b0f', 'a9f95e05-25eb-4773-b2d7-65c1efdfc46c', '5b697e24-7b6a-4513-a6bf-a233996957dc', 'c0fd98ea-c31c-4599-aabf-7f076a669c7d'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:46:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e1aed5b2-5b08-492a-b586-ccb50c94500e tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e1aed5b2-5b08-492a-b586-ccb50c94500e tempest-VolumesSnapshotTestJSON-50191109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:58 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e1aed5b2-5b08-492a-b586-ccb50c94500e tempest-VolumesSnapshotTestJSON-50191109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:46:58 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e1aed5b2-5b08-492a-b586-ccb50c94500e tempest-VolumesSnapshotTestJSON-50191109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:46:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e1aed5b2-5b08-492a-b586-ccb50c94500e tempest-VolumesSnapshotTestJSON-50191109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e1aed5b2-5b08-492a-b586-ccb50c94500e tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:58 devstack sudo[101066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:46:58 devstack sudo[101066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:58 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-63fe2264-2ea8-4247-b5c5-628e035f4732 tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "cinder-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:58 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-63fe2264-2ea8-4247-b5c5-628e035f4732 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:58 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-63fe2264-2ea8-4247-b5c5-628e035f4732 tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "cinder-quobyte-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:58 devstack sudo[101062]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2478afe9-04fc-46fd-9522-36a24514b7b4 1G" returned: 0 in 0.452s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:58 devstack cinder-volume[88413]: DEBUG cinder.volume.volume_utils [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Downloaded image 3c7ac9f7-f638-43c1-9c8d-41f36b0aec05 ((None, [{'url': 'file:///opt/stack/data/glance/images/3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'metadata': {}}])) to volume 2478afe9-04fc-46fd-9522-36a24514b7b4 successfully. {{(pid=88413) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 28 10:46:58 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Temporary image 3c7ac9f7-f638-43c1-9c8d-41f36b0aec05 for user 70cf4e4ca5244750938450ed583a20bf is deleted. {{(pid=88413) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 28 10:46:58 devstack cinder-volume[88413]: DEBUG cinder.volume.volume_utils [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Marking volume 2478afe9-04fc-46fd-9522-36a24514b7b4 as bootable. {{(pid=88413) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 28 10:46:58 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-63fe2264-2ea8-4247-b5c5-628e035f4732 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-quobyte-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e" acquired by "delete_volume" :: waited 0.039s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:46:58 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Copying metadata from image 3c7ac9f7-f638-43c1-9c8d-41f36b0aec05 to 2478afe9-04fc-46fd-9522-36a24514b7b4. {{(pid=88413) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 28 10:46:58 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Creating volume glance metadata for volume 2478afe9-04fc-46fd-9522-36a24514b7b4 backed by image 3c7ac9f7-f638-43c1-9c8d-41f36b0aec05 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88413) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 28 10:46:58 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad626b2e-cf15-441d-be70-b3aea74c0a43]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:46:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-63fe2264-2ea8-4247-b5c5-628e035f4732 tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:58 devstack sudo[101066]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e1aed5b2-5b08-492a-b586-ccb50c94500e tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.355s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:58 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-e1aed5b2-5b08-492a-b586-ccb50c94500e tempest-VolumesSnapshotTestJSON-50191109 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:46:58 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-e1aed5b2-5b08-492a-b586-ccb50c94500e tempest-VolumesSnapshotTestJSON-50191109 None] Deleted volume successfully. Jul 28 10:46:58 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e1aed5b2-5b08-492a-b586-ccb50c94500e tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-ede7d330-0d26-41fe-b3be-19a89dceaf30-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:58 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d323183-d130-447d-8e6b-d34e837ec57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2478afe9-04fc-46fd-9522-36a24514b7b4', 'volume_size': 1, 'image_id': '3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b606c34dd1dc45a6a010943235754dcb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'created_at': datetime.datetime(2026, 7, 28, 8, 30, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 8, 30, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c7ac9f7-f638-43c1-9c8d-41f36b0aec05/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:58 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1162b15-e748-41e7-a159-0b7aecd3e7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:46:58 devstack sudo[101070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e Jul 28 10:46:58 devstack sudo[101070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:58 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Volume volume-2478afe9-04fc-46fd-9522-36a24514b7b4 (2478afe9-04fc-46fd-9522-36a24514b7b4): created successfully Jul 28 10:46:58 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1162b15-e748-41e7-a159-0b7aecd3e7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:46:58 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Flow 'volume_create_manager' (ce994e06-1ebd-4c2f-8acb-5a92d1aafd5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:46:58 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-60660a62-94ec-440a-8775-db56575df754 tempest-VolumesImageMetadata-1424458891 None] Created volume successfully. Jul 28 10:46:59 devstack sudo[101070]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-63fe2264-2ea8-4247-b5c5-628e035f4732 tempest-VolumesSnapshotTestJSON-50191109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e" returned: 0 in 0.426s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-63fe2264-2ea8-4247-b5c5-628e035f4732 tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:59 devstack sudo[101076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e Jul 28 10:46:59 devstack sudo[101076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:59 devstack sudo[101076]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-63fe2264-2ea8-4247-b5c5-628e035f4732 tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e" returned: 0 in 0.254s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:59 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-63fe2264-2ea8-4247-b5c5-628e035f4732 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-quobyte-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e" released by "delete_volume" :: held 0.751s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:46:59 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-63fe2264-2ea8-4247-b5c5-628e035f4732 tempest-VolumesSnapshotTestJSON-50191109 None] Created reservations ['a5a7d86d-4e03-4283-858f-de808ddec5de', 'f30600c3-209a-43ff-b306-115ab395e26e', '01558e13-7324-4b75-94e0-9de9178b9f27', '701bfdeb-844b-4318-8018-932ed9d334e4'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:46:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-63fe2264-2ea8-4247-b5c5-628e035f4732 tempest-VolumesSnapshotTestJSON-50191109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:46:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-63fe2264-2ea8-4247-b5c5-628e035f4732 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:46:59 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-63fe2264-2ea8-4247-b5c5-628e035f4732 tempest-VolumesSnapshotTestJSON-50191109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:46:59 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-63fe2264-2ea8-4247-b5c5-628e035f4732 tempest-VolumesSnapshotTestJSON-50191109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:46:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-63fe2264-2ea8-4247-b5c5-628e035f4732 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:46:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-63fe2264-2ea8-4247-b5c5-628e035f4732 tempest-VolumesSnapshotTestJSON-50191109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:46:59 devstack sudo[101080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:46:59 devstack sudo[101080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:46:59 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e51254ba-8562-4602-9f07-98a85eca0d51 tempest-VolumesImageMetadata-1424458891 None] Acquiring lock "cinder-2478afe9-04fc-46fd-9522-36a24514b7b4-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:46:59 devstack sudo[101080]: pam_unix(sudo:session): session closed for user root Jul 28 10:46:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-63fe2264-2ea8-4247-b5c5-628e035f4732 tempest-VolumesSnapshotTestJSON-50191109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.344s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:46:59 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-63fe2264-2ea8-4247-b5c5-628e035f4732 tempest-VolumesSnapshotTestJSON-50191109 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:46:59 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e51254ba-8562-4602-9f07-98a85eca0d51 tempest-VolumesImageMetadata-1424458891 None] Lock "cinder-2478afe9-04fc-46fd-9522-36a24514b7b4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:47:00 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-63fe2264-2ea8-4247-b5c5-628e035f4732 tempest-VolumesSnapshotTestJSON-50191109 None] Deleted volume successfully. Jul 28 10:47:00 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-63fe2264-2ea8-4247-b5c5-628e035f4732 tempest-VolumesSnapshotTestJSON-50191109 None] Lock "cinder-aeef515e-ee70-42e3-ad35-7b8edc9b2d6e-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:47:00 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e51254ba-8562-4602-9f07-98a85eca0d51 tempest-VolumesImageMetadata-1424458891 None] Acquiring lock "cinder-quobyte-2478afe9-04fc-46fd-9522-36a24514b7b4" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:47:00 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e51254ba-8562-4602-9f07-98a85eca0d51 tempest-VolumesImageMetadata-1424458891 None] Lock "cinder-quobyte-2478afe9-04fc-46fd-9522-36a24514b7b4" acquired by "delete_volume" :: waited 0.023s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:47:00 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e959c2-36d2-4a80-85ea-77f153d5f329]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:47:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e51254ba-8562-4602-9f07-98a85eca0d51 tempest-VolumesImageMetadata-1424458891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2478afe9-04fc-46fd-9522-36a24514b7b4 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:00 devstack sudo[101084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2478afe9-04fc-46fd-9522-36a24514b7b4 Jul 28 10:47:00 devstack sudo[101084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:00 devstack sudo[101084]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e51254ba-8562-4602-9f07-98a85eca0d51 tempest-VolumesImageMetadata-1424458891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2478afe9-04fc-46fd-9522-36a24514b7b4" returned: 0 in 0.385s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e51254ba-8562-4602-9f07-98a85eca0d51 tempest-VolumesImageMetadata-1424458891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2478afe9-04fc-46fd-9522-36a24514b7b4 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:00 devstack sudo[101089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2478afe9-04fc-46fd-9522-36a24514b7b4 Jul 28 10:47:00 devstack sudo[101089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:00 devstack sudo[101089]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e51254ba-8562-4602-9f07-98a85eca0d51 tempest-VolumesImageMetadata-1424458891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2478afe9-04fc-46fd-9522-36a24514b7b4" returned: 0 in 0.303s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:00 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e51254ba-8562-4602-9f07-98a85eca0d51 tempest-VolumesImageMetadata-1424458891 None] Lock "cinder-quobyte-2478afe9-04fc-46fd-9522-36a24514b7b4" released by "delete_volume" :: held 0.731s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:47:00 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-e51254ba-8562-4602-9f07-98a85eca0d51 tempest-VolumesImageMetadata-1424458891 None] Created reservations ['e3bf8a6f-a24e-451d-bed6-a626d141f4b9', 'e09c7340-b45c-44ca-b1a1-b67ecdb7a376', '7f5a0c14-3e6e-4cd6-92ed-cb8a19f2cbdc', 'fd134d76-95f2-481f-998c-52de28a85cc7'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:47:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e51254ba-8562-4602-9f07-98a85eca0d51 tempest-VolumesImageMetadata-1424458891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:47:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e51254ba-8562-4602-9f07-98a85eca0d51 tempest-VolumesImageMetadata-1424458891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:47:00 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e51254ba-8562-4602-9f07-98a85eca0d51 tempest-VolumesImageMetadata-1424458891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:47:00 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e51254ba-8562-4602-9f07-98a85eca0d51 tempest-VolumesImageMetadata-1424458891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:47:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e51254ba-8562-4602-9f07-98a85eca0d51 tempest-VolumesImageMetadata-1424458891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:47:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e51254ba-8562-4602-9f07-98a85eca0d51 tempest-VolumesImageMetadata-1424458891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:00 devstack sudo[101094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:47:00 devstack sudo[101094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:01 devstack sudo[101094]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e51254ba-8562-4602-9f07-98a85eca0d51 tempest-VolumesImageMetadata-1424458891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.434s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:01 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-e51254ba-8562-4602-9f07-98a85eca0d51 tempest-VolumesImageMetadata-1424458891 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:47:01 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-e51254ba-8562-4602-9f07-98a85eca0d51 tempest-VolumesImageMetadata-1424458891 None] Deleted volume successfully. Jul 28 10:47:01 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e51254ba-8562-4602-9f07-98a85eca0d51 tempest-VolumesImageMetadata-1424458891 None] Lock "cinder-2478afe9-04fc-46fd-9522-36a24514b7b4-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:47:04 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=189,cinder:INSERT=66,cinder:UPDATE=230,cinder:DELETE=25 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:47:04 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-be652a34-8469-4b35-b3a5-e6d1a3d79fde tempest-VolumesMetadataTest-382172548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:47:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-be652a34-8469-4b35-b3a5-e6d1a3d79fde tempest-VolumesMetadataTest-382172548 None] Flow 'volume_create_manager' (b317b751-d062-4110-8d8a-81c0bbb5ecd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:47:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-be652a34-8469-4b35-b3a5-e6d1a3d79fde tempest-VolumesMetadataTest-382172548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05d6d62f-25c2-47b6-93d0-9f4ed6beb7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-be652a34-8469-4b35-b3a5-e6d1a3d79fde tempest-VolumesMetadataTest-382172548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05d6d62f-25c2-47b6-93d0-9f4ed6beb7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1479681892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02dcd3fd-fcae-42e6-8d9e-48d853890ba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab5faa076b7244fbb0d60790c82e2ea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:47:05Z,use_quota=True,user_id='980a75d7e64e4a1787e581fb85477208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:47:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-be652a34-8469-4b35-b3a5-e6d1a3d79fde tempest-VolumesMetadataTest-382172548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51230f4f-80b5-45bf-8b59-aec28c6452b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-be652a34-8469-4b35-b3a5-e6d1a3d79fde tempest-VolumesMetadataTest-382172548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51230f4f-80b5-45bf-8b59-aec28c6452b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:47:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-be652a34-8469-4b35-b3a5-e6d1a3d79fde tempest-VolumesMetadataTest-382172548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85e82bb6-1111-46d8-b8c3-02d7cea17e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-be652a34-8469-4b35-b3a5-e6d1a3d79fde tempest-VolumesMetadataTest-382172548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85e82bb6-1111-46d8-b8c3-02d7cea17e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02dcd3fd-fcae-42e6-8d9e-48d853890ba0', 'volume_name': 'volume-02dcd3fd-fcae-42e6-8d9e-48d853890ba0', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:47:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-be652a34-8469-4b35-b3a5-e6d1a3d79fde tempest-VolumesMetadataTest-382172548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a9d70ba-2588-4b7c-8888-6bc3717c83b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-be652a34-8469-4b35-b3a5-e6d1a3d79fde tempest-VolumesMetadataTest-382172548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a9d70ba-2588-4b7c-8888-6bc3717c83b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:47:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-be652a34-8469-4b35-b3a5-e6d1a3d79fde tempest-VolumesMetadataTest-382172548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e61731c5-ff2d-4e7a-923d-e4e9102e5632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:04 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-be652a34-8469-4b35-b3a5-e6d1a3d79fde tempest-VolumesMetadataTest-382172548 None] Volume 02dcd3fd-fcae-42e6-8d9e-48d853890ba0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02dcd3fd-fcae-42e6-8d9e-48d853890ba0', 'volume_size': 1} Jul 28 10:47:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-be652a34-8469-4b35-b3a5-e6d1a3d79fde tempest-VolumesMetadataTest-382172548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:47:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-be652a34-8469-4b35-b3a5-e6d1a3d79fde tempest-VolumesMetadataTest-382172548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:47:04 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-be652a34-8469-4b35-b3a5-e6d1a3d79fde tempest-VolumesMetadataTest-382172548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1479681892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02dcd3fd-fcae-42e6-8d9e-48d853890ba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab5faa076b7244fbb0d60790c82e2ea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:47:05Z,use_quota=True,user_id='980a75d7e64e4a1787e581fb85477208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:47:04 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-be652a34-8469-4b35-b3a5-e6d1a3d79fde tempest-VolumesMetadataTest-382172548 None] Creating volume 02dcd3fd-fcae-42e6-8d9e-48d853890ba0 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:47:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-be652a34-8469-4b35-b3a5-e6d1a3d79fde tempest-VolumesMetadataTest-382172548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:47:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-be652a34-8469-4b35-b3a5-e6d1a3d79fde tempest-VolumesMetadataTest-382172548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:47:04 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-be652a34-8469-4b35-b3a5-e6d1a3d79fde tempest-VolumesMetadataTest-382172548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:47:04 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-be652a34-8469-4b35-b3a5-e6d1a3d79fde tempest-VolumesMetadataTest-382172548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:47:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-be652a34-8469-4b35-b3a5-e6d1a3d79fde tempest-VolumesMetadataTest-382172548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:47:04 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-be652a34-8469-4b35-b3a5-e6d1a3d79fde tempest-VolumesMetadataTest-382172548 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:47:04 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-be652a34-8469-4b35-b3a5-e6d1a3d79fde tempest-VolumesMetadataTest-382172548 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:47:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-be652a34-8469-4b35-b3a5-e6d1a3d79fde tempest-VolumesMetadataTest-382172548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-02dcd3fd-fcae-42e6-8d9e-48d853890ba0 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:05 devstack sudo[101100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-02dcd3fd-fcae-42e6-8d9e-48d853890ba0 1073741824 Jul 28 10:47:05 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:05 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-be652a34-8469-4b35-b3a5-e6d1a3d79fde tempest-VolumesMetadataTest-382172548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-02dcd3fd-fcae-42e6-8d9e-48d853890ba0 1073741824" returned: 0 in 0.520s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:05 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:UPDATE=256,cinder:SELECT=194,cinder:INSERT=64,cinder:DELETE=15 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:47:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-be652a34-8469-4b35-b3a5-e6d1a3d79fde tempest-VolumesMetadataTest-382172548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-02dcd3fd-fcae-42e6-8d9e-48d853890ba0 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:05 devstack sudo[101106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-02dcd3fd-fcae-42e6-8d9e-48d853890ba0 Jul 28 10:47:05 devstack sudo[101106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:05 devstack sudo[101106]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-be652a34-8469-4b35-b3a5-e6d1a3d79fde tempest-VolumesMetadataTest-382172548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-02dcd3fd-fcae-42e6-8d9e-48d853890ba0" returned: 0 in 0.270s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:05 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-be652a34-8469-4b35-b3a5-e6d1a3d79fde tempest-VolumesMetadataTest-382172548 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:47:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-be652a34-8469-4b35-b3a5-e6d1a3d79fde tempest-VolumesMetadataTest-382172548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:47:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-be652a34-8469-4b35-b3a5-e6d1a3d79fde tempest-VolumesMetadataTest-382172548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e61731c5-ff2d-4e7a-923d-e4e9102e5632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02dcd3fd-fcae-42e6-8d9e-48d853890ba0', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:47:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-be652a34-8469-4b35-b3a5-e6d1a3d79fde tempest-VolumesMetadataTest-382172548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1dfde39-b32e-4593-abc0-117efbdd4b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:05 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-be652a34-8469-4b35-b3a5-e6d1a3d79fde tempest-VolumesMetadataTest-382172548 None] Volume volume-02dcd3fd-fcae-42e6-8d9e-48d853890ba0 (02dcd3fd-fcae-42e6-8d9e-48d853890ba0): created successfully Jul 28 10:47:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-be652a34-8469-4b35-b3a5-e6d1a3d79fde tempest-VolumesMetadataTest-382172548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1dfde39-b32e-4593-abc0-117efbdd4b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:47:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-be652a34-8469-4b35-b3a5-e6d1a3d79fde tempest-VolumesMetadataTest-382172548 None] Flow 'volume_create_manager' (b317b751-d062-4110-8d8a-81c0bbb5ecd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:47:05 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-be652a34-8469-4b35-b3a5-e6d1a3d79fde tempest-VolumesMetadataTest-382172548 None] Created volume successfully. Jul 28 10:47:07 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e70ccce-cdaf-41a2-b2e6-f5e3a0a4af54 tempest-VolumesSnapshotListTestJSON-281662468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:47:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7e70ccce-cdaf-41a2-b2e6-f5e3a0a4af54 tempest-VolumesSnapshotListTestJSON-281662468 None] Flow 'volume_create_manager' (624aca4a-b7e7-47a3-961c-364ddd9353a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:47:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7e70ccce-cdaf-41a2-b2e6-f5e3a0a4af54 tempest-VolumesSnapshotListTestJSON-281662468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb7d16dd-e162-40e5-9404-165e15e4f770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7e70ccce-cdaf-41a2-b2e6-f5e3a0a4af54 tempest-VolumesSnapshotListTestJSON-281662468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb7d16dd-e162-40e5-9404-165e15e4f770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-880994192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30a19fb9-b73c-4cbf-8ba0-10c5810cc595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33aab168fd94c2eb643f2fff072be61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:47:07Z,use_quota=True,user_id='a27cc765842143389262493e6fe79067',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:47:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7e70ccce-cdaf-41a2-b2e6-f5e3a0a4af54 tempest-VolumesSnapshotListTestJSON-281662468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f36a74-0cfa-4c20-bda7-9a9a2c1dc681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7e70ccce-cdaf-41a2-b2e6-f5e3a0a4af54 tempest-VolumesSnapshotListTestJSON-281662468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f36a74-0cfa-4c20-bda7-9a9a2c1dc681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:47:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7e70ccce-cdaf-41a2-b2e6-f5e3a0a4af54 tempest-VolumesSnapshotListTestJSON-281662468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5824b590-8bbb-42dd-adcf-ee3035abc5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7e70ccce-cdaf-41a2-b2e6-f5e3a0a4af54 tempest-VolumesSnapshotListTestJSON-281662468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5824b590-8bbb-42dd-adcf-ee3035abc5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30a19fb9-b73c-4cbf-8ba0-10c5810cc595', 'volume_name': 'volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:47:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7e70ccce-cdaf-41a2-b2e6-f5e3a0a4af54 tempest-VolumesSnapshotListTestJSON-281662468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f691265-46c2-42e9-980b-fa15037062df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7e70ccce-cdaf-41a2-b2e6-f5e3a0a4af54 tempest-VolumesSnapshotListTestJSON-281662468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f691265-46c2-42e9-980b-fa15037062df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:47:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7e70ccce-cdaf-41a2-b2e6-f5e3a0a4af54 tempest-VolumesSnapshotListTestJSON-281662468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (076c6096-14d8-4a34-98c6-396607c41f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:07 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-7e70ccce-cdaf-41a2-b2e6-f5e3a0a4af54 tempest-VolumesSnapshotListTestJSON-281662468 None] Volume 30a19fb9-b73c-4cbf-8ba0-10c5810cc595: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595', 'volume_size': 1} Jul 28 10:47:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7e70ccce-cdaf-41a2-b2e6-f5e3a0a4af54 tempest-VolumesSnapshotListTestJSON-281662468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:47:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7e70ccce-cdaf-41a2-b2e6-f5e3a0a4af54 tempest-VolumesSnapshotListTestJSON-281662468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:47:07 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7e70ccce-cdaf-41a2-b2e6-f5e3a0a4af54 tempest-VolumesSnapshotListTestJSON-281662468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-880994192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30a19fb9-b73c-4cbf-8ba0-10c5810cc595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33aab168fd94c2eb643f2fff072be61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:47:07Z,use_quota=True,user_id='a27cc765842143389262493e6fe79067',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:47:07 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-7e70ccce-cdaf-41a2-b2e6-f5e3a0a4af54 tempest-VolumesSnapshotListTestJSON-281662468 None] Creating volume 30a19fb9-b73c-4cbf-8ba0-10c5810cc595 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:47:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7e70ccce-cdaf-41a2-b2e6-f5e3a0a4af54 tempest-VolumesSnapshotListTestJSON-281662468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:47:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7e70ccce-cdaf-41a2-b2e6-f5e3a0a4af54 tempest-VolumesSnapshotListTestJSON-281662468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:47:07 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7e70ccce-cdaf-41a2-b2e6-f5e3a0a4af54 tempest-VolumesSnapshotListTestJSON-281662468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:47:07 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7e70ccce-cdaf-41a2-b2e6-f5e3a0a4af54 tempest-VolumesSnapshotListTestJSON-281662468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:47:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7e70ccce-cdaf-41a2-b2e6-f5e3a0a4af54 tempest-VolumesSnapshotListTestJSON-281662468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:47:07 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7e70ccce-cdaf-41a2-b2e6-f5e3a0a4af54 tempest-VolumesSnapshotListTestJSON-281662468 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:47:07 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-7e70ccce-cdaf-41a2-b2e6-f5e3a0a4af54 tempest-VolumesSnapshotListTestJSON-281662468 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:47:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7e70ccce-cdaf-41a2-b2e6-f5e3a0a4af54 tempest-VolumesSnapshotListTestJSON-281662468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:07 devstack sudo[101109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595 1073741824 Jul 28 10:47:07 devstack sudo[101109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:07 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-971e6b06-9405-4c45-92bc-c12186dbf9f1 tempest-VolumesMetadataTest-382172548 None] Acquiring lock "cinder-02dcd3fd-fcae-42e6-8d9e-48d853890ba0-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:47:07 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-971e6b06-9405-4c45-92bc-c12186dbf9f1 tempest-VolumesMetadataTest-382172548 None] Lock "cinder-02dcd3fd-fcae-42e6-8d9e-48d853890ba0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:47:07 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-971e6b06-9405-4c45-92bc-c12186dbf9f1 tempest-VolumesMetadataTest-382172548 None] Acquiring lock "cinder-quobyte-02dcd3fd-fcae-42e6-8d9e-48d853890ba0" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:47:07 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-971e6b06-9405-4c45-92bc-c12186dbf9f1 tempest-VolumesMetadataTest-382172548 None] Lock "cinder-quobyte-02dcd3fd-fcae-42e6-8d9e-48d853890ba0" acquired by "delete_volume" :: waited 0.018s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:47:07 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea89a078-1134-4046-a2e4-a3f41f4ef3d4]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:47:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-971e6b06-9405-4c45-92bc-c12186dbf9f1 tempest-VolumesMetadataTest-382172548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-02dcd3fd-fcae-42e6-8d9e-48d853890ba0 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:07 devstack sudo[101109]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7e70ccce-cdaf-41a2-b2e6-f5e3a0a4af54 tempest-VolumesSnapshotListTestJSON-281662468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595 1073741824" returned: 0 in 0.545s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:07 devstack sudo[101115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-02dcd3fd-fcae-42e6-8d9e-48d853890ba0 Jul 28 10:47:07 devstack sudo[101115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7e70ccce-cdaf-41a2-b2e6-f5e3a0a4af54 tempest-VolumesSnapshotListTestJSON-281662468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:08 devstack sudo[101117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595 Jul 28 10:47:08 devstack sudo[101117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:08 devstack sudo[101117]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7e70ccce-cdaf-41a2-b2e6-f5e3a0a4af54 tempest-VolumesSnapshotListTestJSON-281662468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595" returned: 0 in 0.279s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:08 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7e70ccce-cdaf-41a2-b2e6-f5e3a0a4af54 tempest-VolumesSnapshotListTestJSON-281662468 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:47:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7e70ccce-cdaf-41a2-b2e6-f5e3a0a4af54 tempest-VolumesSnapshotListTestJSON-281662468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:47:08 devstack sudo[101115]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7e70ccce-cdaf-41a2-b2e6-f5e3a0a4af54 tempest-VolumesSnapshotListTestJSON-281662468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (076c6096-14d8-4a34-98c6-396607c41f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:47:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7e70ccce-cdaf-41a2-b2e6-f5e3a0a4af54 tempest-VolumesSnapshotListTestJSON-281662468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfa44604-8a5f-48ef-9299-9024876e2b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-971e6b06-9405-4c45-92bc-c12186dbf9f1 tempest-VolumesMetadataTest-382172548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-02dcd3fd-fcae-42e6-8d9e-48d853890ba0" returned: 0 in 0.487s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-971e6b06-9405-4c45-92bc-c12186dbf9f1 tempest-VolumesMetadataTest-382172548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-02dcd3fd-fcae-42e6-8d9e-48d853890ba0 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:08 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-7e70ccce-cdaf-41a2-b2e6-f5e3a0a4af54 tempest-VolumesSnapshotListTestJSON-281662468 None] Volume volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595 (30a19fb9-b73c-4cbf-8ba0-10c5810cc595): created successfully Jul 28 10:47:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7e70ccce-cdaf-41a2-b2e6-f5e3a0a4af54 tempest-VolumesSnapshotListTestJSON-281662468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfa44604-8a5f-48ef-9299-9024876e2b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:47:08 devstack sudo[101124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-02dcd3fd-fcae-42e6-8d9e-48d853890ba0 Jul 28 10:47:08 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7e70ccce-cdaf-41a2-b2e6-f5e3a0a4af54 tempest-VolumesSnapshotListTestJSON-281662468 None] Flow 'volume_create_manager' (624aca4a-b7e7-47a3-961c-364ddd9353a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:47:08 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-7e70ccce-cdaf-41a2-b2e6-f5e3a0a4af54 tempest-VolumesSnapshotListTestJSON-281662468 None] Created volume successfully. Jul 28 10:47:08 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-971e6b06-9405-4c45-92bc-c12186dbf9f1 tempest-VolumesMetadataTest-382172548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-02dcd3fd-fcae-42e6-8d9e-48d853890ba0" returned: 0 in 0.268s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:08 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-971e6b06-9405-4c45-92bc-c12186dbf9f1 tempest-VolumesMetadataTest-382172548 None] Lock "cinder-quobyte-02dcd3fd-fcae-42e6-8d9e-48d853890ba0" released by "delete_volume" :: held 0.801s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:47:08 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-971e6b06-9405-4c45-92bc-c12186dbf9f1 tempest-VolumesMetadataTest-382172548 None] Created reservations ['228068f0-0418-4e1a-bdf8-cef492b77bfe', 'b260dbdc-120a-441d-b937-1c55a3134e16', '14f48dad-194d-4d94-9b29-0af8d50546db', 'c16267f3-dc95-4f5a-8907-fff353ddc1d8'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:47:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-971e6b06-9405-4c45-92bc-c12186dbf9f1 tempest-VolumesMetadataTest-382172548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:47:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-971e6b06-9405-4c45-92bc-c12186dbf9f1 tempest-VolumesMetadataTest-382172548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:47:08 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-971e6b06-9405-4c45-92bc-c12186dbf9f1 tempest-VolumesMetadataTest-382172548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:47:08 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-971e6b06-9405-4c45-92bc-c12186dbf9f1 tempest-VolumesMetadataTest-382172548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:47:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-971e6b06-9405-4c45-92bc-c12186dbf9f1 tempest-VolumesMetadataTest-382172548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:47:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-971e6b06-9405-4c45-92bc-c12186dbf9f1 tempest-VolumesMetadataTest-382172548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:08 devstack sudo[101127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:47:08 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:08 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-971e6b06-9405-4c45-92bc-c12186dbf9f1 tempest-VolumesMetadataTest-382172548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.253s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:09 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-971e6b06-9405-4c45-92bc-c12186dbf9f1 tempest-VolumesMetadataTest-382172548 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:47:09 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-971e6b06-9405-4c45-92bc-c12186dbf9f1 tempest-VolumesMetadataTest-382172548 None] Deleted volume successfully. Jul 28 10:47:09 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-971e6b06-9405-4c45-92bc-c12186dbf9f1 tempest-VolumesMetadataTest-382172548 None] Lock "cinder-02dcd3fd-fcae-42e6-8d9e-48d853890ba0-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:47:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0c4047cc-1594-42ae-b7ad-a2c93d7797a7 tempest-VolumesSnapshotListTestJSON-281662468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:47:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0c4047cc-1594-42ae-b7ad-a2c93d7797a7 tempest-VolumesSnapshotListTestJSON-281662468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:47:09 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-0c4047cc-1594-42ae-b7ad-a2c93d7797a7 tempest-VolumesSnapshotListTestJSON-281662468 None] Creating offline snapshot 70e67770-9d63-4473-af21-362cbaaa1b8b of volume 30a19fb9-b73c-4cbf-8ba0-10c5810cc595 {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:47:09 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[757c0d9e-1fbf-4e20-9a64-ce6c96565446]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:47:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0c4047cc-1594-42ae-b7ad-a2c93d7797a7 tempest-VolumesSnapshotListTestJSON-281662468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:09 devstack sudo[101131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595 Jul 28 10:47:09 devstack sudo[101131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:10 devstack sudo[101131]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0c4047cc-1594-42ae-b7ad-a2c93d7797a7 tempest-VolumesSnapshotListTestJSON-281662468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595" returned: 0 in 0.414s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0c4047cc-1594-42ae-b7ad-a2c93d7797a7 tempest-VolumesSnapshotListTestJSON-281662468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.70e67770-9d63-4473-af21-362cbaaa1b8b 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:10 devstack sudo[101136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.70e67770-9d63-4473-af21-362cbaaa1b8b 1G Jul 28 10:47:10 devstack sudo[101136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:10 devstack sudo[101136]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0c4047cc-1594-42ae-b7ad-a2c93d7797a7 tempest-VolumesSnapshotListTestJSON-281662468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.70e67770-9d63-4473-af21-362cbaaa1b8b 1G" returned: 0 in 0.514s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0c4047cc-1594-42ae-b7ad-a2c93d7797a7 tempest-VolumesSnapshotListTestJSON-281662468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.70e67770-9d63-4473-af21-362cbaaa1b8b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:10 devstack sudo[101142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.70e67770-9d63-4473-af21-362cbaaa1b8b Jul 28 10:47:10 devstack sudo[101142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:10 devstack sudo[101142]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0c4047cc-1594-42ae-b7ad-a2c93d7797a7 tempest-VolumesSnapshotListTestJSON-281662468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.70e67770-9d63-4473-af21-362cbaaa1b8b" returned: 0 in 0.320s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:10 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-0c4047cc-1594-42ae-b7ad-a2c93d7797a7 tempest-VolumesSnapshotListTestJSON-281662468 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.70e67770-9d63-4473-af21-362cbaaa1b8b is being set with open permissions: ugo+rw Jul 28 10:47:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0c4047cc-1594-42ae-b7ad-a2c93d7797a7 tempest-VolumesSnapshotListTestJSON-281662468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.70e67770-9d63-4473-af21-362cbaaa1b8b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:10 devstack sudo[101147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.70e67770-9d63-4473-af21-362cbaaa1b8b Jul 28 10:47:10 devstack sudo[101147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:11 devstack sudo[101147]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0c4047cc-1594-42ae-b7ad-a2c93d7797a7 tempest-VolumesSnapshotListTestJSON-281662468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.70e67770-9d63-4473-af21-362cbaaa1b8b" returned: 0 in 0.345s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0c4047cc-1594-42ae-b7ad-a2c93d7797a7 tempest-VolumesSnapshotListTestJSON-281662468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:11 devstack sudo[101150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.info Jul 28 10:47:11 devstack sudo[101150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:11 devstack sudo[101150]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0c4047cc-1594-42ae-b7ad-a2c93d7797a7 tempest-VolumesSnapshotListTestJSON-281662468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.info" returned: 0 in 0.292s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:11 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-0c4047cc-1594-42ae-b7ad-a2c93d7797a7 tempest-VolumesSnapshotListTestJSON-281662468 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.info is being set with open permissions: ugo+rw Jul 28 10:47:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0c4047cc-1594-42ae-b7ad-a2c93d7797a7 tempest-VolumesSnapshotListTestJSON-281662468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:11 devstack sudo[101153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.info Jul 28 10:47:11 devstack sudo[101153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:11 devstack sudo[101153]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0c4047cc-1594-42ae-b7ad-a2c93d7797a7 tempest-VolumesSnapshotListTestJSON-281662468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.info" returned: 0 in 0.298s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0c4047cc-1594-42ae-b7ad-a2c93d7797a7 tempest-VolumesSnapshotListTestJSON-281662468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.341s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:47:11 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-0c4047cc-1594-42ae-b7ad-a2c93d7797a7 tempest-VolumesSnapshotListTestJSON-281662468 None] Create snapshot completed successfully Jul 28 10:47:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-15e3d79f-4701-4eb9-9e1b-fbf858c2d375 tempest-VolumesSnapshotListTestJSON-281662468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:47:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-15e3d79f-4701-4eb9-9e1b-fbf858c2d375 tempest-VolumesSnapshotListTestJSON-281662468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:47:13 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-15e3d79f-4701-4eb9-9e1b-fbf858c2d375 tempest-VolumesSnapshotListTestJSON-281662468 None] Creating offline snapshot c5da11bf-8170-477a-a8da-7b4ceeb0324a of volume 30a19fb9-b73c-4cbf-8ba0-10c5810cc595 {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:47:13 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[09dccc4e-fe5f-45b4-9a29-97063d71444b]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:47:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-15e3d79f-4701-4eb9-9e1b-fbf858c2d375 tempest-VolumesSnapshotListTestJSON-281662468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.70e67770-9d63-4473-af21-362cbaaa1b8b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:13 devstack sudo[101156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.70e67770-9d63-4473-af21-362cbaaa1b8b Jul 28 10:47:13 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:13 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-15e3d79f-4701-4eb9-9e1b-fbf858c2d375 tempest-VolumesSnapshotListTestJSON-281662468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.70e67770-9d63-4473-af21-362cbaaa1b8b" returned: 0 in 0.460s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:13 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-15e3d79f-4701-4eb9-9e1b-fbf858c2d375 tempest-VolumesSnapshotListTestJSON-281662468 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:47:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-15e3d79f-4701-4eb9-9e1b-fbf858c2d375 tempest-VolumesSnapshotListTestJSON-281662468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.70e67770-9d63-4473-af21-362cbaaa1b8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.c5da11bf-8170-477a-a8da-7b4ceeb0324a 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:13 devstack sudo[101161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.70e67770-9d63-4473-af21-362cbaaa1b8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.c5da11bf-8170-477a-a8da-7b4ceeb0324a 1G Jul 28 10:47:13 devstack sudo[101161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:14 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-600e17a1-1dee-49a8-9e1d-74cc729ab37b tempest-VolumesTransfersV355Test-270409330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:47:14 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-600e17a1-1dee-49a8-9e1d-74cc729ab37b tempest-VolumesTransfersV355Test-270409330 None] Flow 'volume_create_manager' (3deb68ed-888c-4726-adc4-cbe13b75d6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:47:14 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-600e17a1-1dee-49a8-9e1d-74cc729ab37b tempest-VolumesTransfersV355Test-270409330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dd9c57b-46b3-4522-b97a-8a7bb8bb12ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:14 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-600e17a1-1dee-49a8-9e1d-74cc729ab37b tempest-VolumesTransfersV355Test-270409330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dd9c57b-46b3-4522-b97a-8a7bb8bb12ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1650480142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04eb212f-2e56-4657-99fa-dc64118ff634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d47916e77b44ea78ae45a19d268e13d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:47:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:47:14Z,use_quota=True,user_id='5a3afe377eee48bba86d660b06566610',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:47:14 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-600e17a1-1dee-49a8-9e1d-74cc729ab37b tempest-VolumesTransfersV355Test-270409330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d8660b3-9909-426f-a2af-7942a4712f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:14 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-600e17a1-1dee-49a8-9e1d-74cc729ab37b tempest-VolumesTransfersV355Test-270409330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d8660b3-9909-426f-a2af-7942a4712f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:47:14 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-600e17a1-1dee-49a8-9e1d-74cc729ab37b tempest-VolumesTransfersV355Test-270409330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (352600f2-3a2a-480d-b385-289ff407424a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:14 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-600e17a1-1dee-49a8-9e1d-74cc729ab37b tempest-VolumesTransfersV355Test-270409330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (352600f2-3a2a-480d-b385-289ff407424a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04eb212f-2e56-4657-99fa-dc64118ff634', 'volume_name': 'volume-04eb212f-2e56-4657-99fa-dc64118ff634', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:47:14 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-600e17a1-1dee-49a8-9e1d-74cc729ab37b tempest-VolumesTransfersV355Test-270409330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbbf65bc-c5df-46e3-8e8e-ff9ab5606264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:14 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-600e17a1-1dee-49a8-9e1d-74cc729ab37b tempest-VolumesTransfersV355Test-270409330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbbf65bc-c5df-46e3-8e8e-ff9ab5606264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:47:14 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-600e17a1-1dee-49a8-9e1d-74cc729ab37b tempest-VolumesTransfersV355Test-270409330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25fdaa84-3236-429f-898b-07c5f5ed5847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:14 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-600e17a1-1dee-49a8-9e1d-74cc729ab37b tempest-VolumesTransfersV355Test-270409330 None] Volume 04eb212f-2e56-4657-99fa-dc64118ff634: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04eb212f-2e56-4657-99fa-dc64118ff634', 'volume_size': 1} Jul 28 10:47:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-600e17a1-1dee-49a8-9e1d-74cc729ab37b tempest-VolumesTransfersV355Test-270409330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:47:14 devstack sudo[101161]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-15e3d79f-4701-4eb9-9e1b-fbf858c2d375 tempest-VolumesSnapshotListTestJSON-281662468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.70e67770-9d63-4473-af21-362cbaaa1b8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.c5da11bf-8170-477a-a8da-7b4ceeb0324a 1G" returned: 0 in 0.721s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-15e3d79f-4701-4eb9-9e1b-fbf858c2d375 tempest-VolumesSnapshotListTestJSON-281662468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.70e67770-9d63-4473-af21-362cbaaa1b8b -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.c5da11bf-8170-477a-a8da-7b4ceeb0324a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:14 devstack sudo[101169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.70e67770-9d63-4473-af21-362cbaaa1b8b -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.c5da11bf-8170-477a-a8da-7b4ceeb0324a Jul 28 10:47:14 devstack sudo[101169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:14 devstack sudo[101169]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-15e3d79f-4701-4eb9-9e1b-fbf858c2d375 tempest-VolumesSnapshotListTestJSON-281662468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.70e67770-9d63-4473-af21-362cbaaa1b8b -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.c5da11bf-8170-477a-a8da-7b4ceeb0324a" returned: 0 in 0.359s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:14 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-15e3d79f-4701-4eb9-9e1b-fbf858c2d375 tempest-VolumesSnapshotListTestJSON-281662468 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.c5da11bf-8170-477a-a8da-7b4ceeb0324a is being set with open permissions: ugo+rw Jul 28 10:47:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-15e3d79f-4701-4eb9-9e1b-fbf858c2d375 tempest-VolumesSnapshotListTestJSON-281662468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.c5da11bf-8170-477a-a8da-7b4ceeb0324a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:14 devstack sudo[101175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.c5da11bf-8170-477a-a8da-7b4ceeb0324a Jul 28 10:47:14 devstack sudo[101175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:14 devstack sudo[101175]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-15e3d79f-4701-4eb9-9e1b-fbf858c2d375 tempest-VolumesSnapshotListTestJSON-281662468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.c5da11bf-8170-477a-a8da-7b4ceeb0324a" returned: 0 in 0.309s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-15e3d79f-4701-4eb9-9e1b-fbf858c2d375 tempest-VolumesSnapshotListTestJSON-281662468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.022s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:47:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-600e17a1-1dee-49a8-9e1d-74cc729ab37b tempest-VolumesTransfersV355Test-270409330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.829s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:47:15 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-600e17a1-1dee-49a8-9e1d-74cc729ab37b tempest-VolumesTransfersV355Test-270409330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1650480142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04eb212f-2e56-4657-99fa-dc64118ff634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d47916e77b44ea78ae45a19d268e13d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:47:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:47:14Z,use_quota=True,user_id='5a3afe377eee48bba86d660b06566610',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:47:15 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-600e17a1-1dee-49a8-9e1d-74cc729ab37b tempest-VolumesTransfersV355Test-270409330 None] Creating volume 04eb212f-2e56-4657-99fa-dc64118ff634 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:47:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-600e17a1-1dee-49a8-9e1d-74cc729ab37b tempest-VolumesTransfersV355Test-270409330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:47:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-600e17a1-1dee-49a8-9e1d-74cc729ab37b tempest-VolumesTransfersV355Test-270409330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:47:15 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-600e17a1-1dee-49a8-9e1d-74cc729ab37b tempest-VolumesTransfersV355Test-270409330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:47:15 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-600e17a1-1dee-49a8-9e1d-74cc729ab37b tempest-VolumesTransfersV355Test-270409330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:47:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-600e17a1-1dee-49a8-9e1d-74cc729ab37b tempest-VolumesTransfersV355Test-270409330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:47:15 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-600e17a1-1dee-49a8-9e1d-74cc729ab37b tempest-VolumesTransfersV355Test-270409330 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:47:15 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-600e17a1-1dee-49a8-9e1d-74cc729ab37b tempest-VolumesTransfersV355Test-270409330 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:47:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-600e17a1-1dee-49a8-9e1d-74cc729ab37b tempest-VolumesTransfersV355Test-270409330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-04eb212f-2e56-4657-99fa-dc64118ff634 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:15 devstack sudo[101178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-04eb212f-2e56-4657-99fa-dc64118ff634 1073741824 Jul 28 10:47:15 devstack sudo[101178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:15 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-15e3d79f-4701-4eb9-9e1b-fbf858c2d375 tempest-VolumesSnapshotListTestJSON-281662468 None] Create snapshot completed successfully Jul 28 10:47:15 devstack sudo[101178]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-600e17a1-1dee-49a8-9e1d-74cc729ab37b tempest-VolumesTransfersV355Test-270409330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-04eb212f-2e56-4657-99fa-dc64118ff634 1073741824" returned: 0 in 0.552s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-600e17a1-1dee-49a8-9e1d-74cc729ab37b tempest-VolumesTransfersV355Test-270409330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-04eb212f-2e56-4657-99fa-dc64118ff634 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:15 devstack sudo[101184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-04eb212f-2e56-4657-99fa-dc64118ff634 Jul 28 10:47:15 devstack sudo[101184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:15 devstack sudo[101184]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-600e17a1-1dee-49a8-9e1d-74cc729ab37b tempest-VolumesTransfersV355Test-270409330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-04eb212f-2e56-4657-99fa-dc64118ff634" returned: 0 in 0.256s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:15 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-600e17a1-1dee-49a8-9e1d-74cc729ab37b tempest-VolumesTransfersV355Test-270409330 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:47:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-600e17a1-1dee-49a8-9e1d-74cc729ab37b tempest-VolumesTransfersV355Test-270409330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:47:15 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-600e17a1-1dee-49a8-9e1d-74cc729ab37b tempest-VolumesTransfersV355Test-270409330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25fdaa84-3236-429f-898b-07c5f5ed5847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04eb212f-2e56-4657-99fa-dc64118ff634', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:47:15 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-600e17a1-1dee-49a8-9e1d-74cc729ab37b tempest-VolumesTransfersV355Test-270409330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b40cea-6f25-4976-b79a-1d6ccf964d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:15 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-600e17a1-1dee-49a8-9e1d-74cc729ab37b tempest-VolumesTransfersV355Test-270409330 None] Volume volume-04eb212f-2e56-4657-99fa-dc64118ff634 (04eb212f-2e56-4657-99fa-dc64118ff634): created successfully Jul 28 10:47:15 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-600e17a1-1dee-49a8-9e1d-74cc729ab37b tempest-VolumesTransfersV355Test-270409330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b40cea-6f25-4976-b79a-1d6ccf964d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:47:15 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-600e17a1-1dee-49a8-9e1d-74cc729ab37b tempest-VolumesTransfersV355Test-270409330 None] Flow 'volume_create_manager' (3deb68ed-888c-4726-adc4-cbe13b75d6d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:47:15 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-600e17a1-1dee-49a8-9e1d-74cc729ab37b tempest-VolumesTransfersV355Test-270409330 None] Created volume successfully. Jul 28 10:47:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-595b3848-17a1-4a9e-9238-6395129bc3cb tempest-VolumesSnapshotListTestJSON-281662468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:47:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-595b3848-17a1-4a9e-9238-6395129bc3cb tempest-VolumesSnapshotListTestJSON-281662468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:47:16 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-595b3848-17a1-4a9e-9238-6395129bc3cb tempest-VolumesSnapshotListTestJSON-281662468 None] Creating offline snapshot b8dcb53e-0900-4858-98e1-0e0a932b3726 of volume 30a19fb9-b73c-4cbf-8ba0-10c5810cc595 {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:47:16 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[17dd88f2-ac6a-403e-bb31-81d6f2fe7ce8]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:47:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-595b3848-17a1-4a9e-9238-6395129bc3cb tempest-VolumesSnapshotListTestJSON-281662468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.c5da11bf-8170-477a-a8da-7b4ceeb0324a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:16 devstack sudo[101187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.c5da11bf-8170-477a-a8da-7b4ceeb0324a Jul 28 10:47:16 devstack sudo[101187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:16 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-7ff88907-693c-47f2-9c34-c26a7e2cc631 tempest-VolumesTransfersV355Test-477273162 None] Transfer volume completed successfully. Jul 28 10:47:16 devstack sudo[101187]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-595b3848-17a1-4a9e-9238-6395129bc3cb tempest-VolumesSnapshotListTestJSON-281662468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.c5da11bf-8170-477a-a8da-7b4ceeb0324a" returned: 0 in 0.424s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:16 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-595b3848-17a1-4a9e-9238-6395129bc3cb tempest-VolumesSnapshotListTestJSON-281662468 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:47:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-595b3848-17a1-4a9e-9238-6395129bc3cb tempest-VolumesSnapshotListTestJSON-281662468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.c5da11bf-8170-477a-a8da-7b4ceeb0324a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.b8dcb53e-0900-4858-98e1-0e0a932b3726 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:16 devstack sudo[101193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.c5da11bf-8170-477a-a8da-7b4ceeb0324a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.b8dcb53e-0900-4858-98e1-0e0a932b3726 1G Jul 28 10:47:16 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:17 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-595b3848-17a1-4a9e-9238-6395129bc3cb tempest-VolumesSnapshotListTestJSON-281662468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.c5da11bf-8170-477a-a8da-7b4ceeb0324a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.b8dcb53e-0900-4858-98e1-0e0a932b3726 1G" returned: 0 in 0.600s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-595b3848-17a1-4a9e-9238-6395129bc3cb tempest-VolumesSnapshotListTestJSON-281662468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.c5da11bf-8170-477a-a8da-7b4ceeb0324a -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.b8dcb53e-0900-4858-98e1-0e0a932b3726 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:17 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ec7d2b35-3032-42df-a1b5-5b17aa664958 tempest-VolumesTransfersV355Test-1342427884 None] Acquiring lock "cinder-04eb212f-2e56-4657-99fa-dc64118ff634-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:47:17 devstack sudo[101201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.c5da11bf-8170-477a-a8da-7b4ceeb0324a -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.b8dcb53e-0900-4858-98e1-0e0a932b3726 Jul 28 10:47:17 devstack sudo[101201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:17 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ec7d2b35-3032-42df-a1b5-5b17aa664958 tempest-VolumesTransfersV355Test-1342427884 None] Lock "cinder-04eb212f-2e56-4657-99fa-dc64118ff634-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:47:17 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ec7d2b35-3032-42df-a1b5-5b17aa664958 tempest-VolumesTransfersV355Test-1342427884 None] Acquiring lock "cinder-quobyte-04eb212f-2e56-4657-99fa-dc64118ff634" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:47:17 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ec7d2b35-3032-42df-a1b5-5b17aa664958 tempest-VolumesTransfersV355Test-1342427884 None] Lock "cinder-quobyte-04eb212f-2e56-4657-99fa-dc64118ff634" acquired by "delete_volume" :: waited 0.015s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:47:17 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62fe366-04e8-4981-82dd-8cb773f60ee9]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:47:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ec7d2b35-3032-42df-a1b5-5b17aa664958 tempest-VolumesTransfersV355Test-1342427884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-04eb212f-2e56-4657-99fa-dc64118ff634 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:17 devstack sudo[101203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-04eb212f-2e56-4657-99fa-dc64118ff634 Jul 28 10:47:17 devstack sudo[101203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:17 devstack sudo[101201]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-595b3848-17a1-4a9e-9238-6395129bc3cb tempest-VolumesSnapshotListTestJSON-281662468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.c5da11bf-8170-477a-a8da-7b4ceeb0324a -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.b8dcb53e-0900-4858-98e1-0e0a932b3726" returned: 0 in 0.361s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:17 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-595b3848-17a1-4a9e-9238-6395129bc3cb tempest-VolumesSnapshotListTestJSON-281662468 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.b8dcb53e-0900-4858-98e1-0e0a932b3726 is being set with open permissions: ugo+rw Jul 28 10:47:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-595b3848-17a1-4a9e-9238-6395129bc3cb tempest-VolumesSnapshotListTestJSON-281662468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.b8dcb53e-0900-4858-98e1-0e0a932b3726 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:17 devstack sudo[101208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.b8dcb53e-0900-4858-98e1-0e0a932b3726 Jul 28 10:47:17 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:18 devstack sudo[101203]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ec7d2b35-3032-42df-a1b5-5b17aa664958 tempest-VolumesTransfersV355Test-1342427884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-04eb212f-2e56-4657-99fa-dc64118ff634" returned: 0 in 0.413s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ec7d2b35-3032-42df-a1b5-5b17aa664958 tempest-VolumesTransfersV355Test-1342427884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-04eb212f-2e56-4657-99fa-dc64118ff634 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:18 devstack sudo[101213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-04eb212f-2e56-4657-99fa-dc64118ff634 Jul 28 10:47:18 devstack sudo[101213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:18 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-595b3848-17a1-4a9e-9238-6395129bc3cb tempest-VolumesSnapshotListTestJSON-281662468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.b8dcb53e-0900-4858-98e1-0e0a932b3726" returned: 0 in 0.280s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-595b3848-17a1-4a9e-9238-6395129bc3cb tempest-VolumesSnapshotListTestJSON-281662468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.791s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:47:18 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-595b3848-17a1-4a9e-9238-6395129bc3cb tempest-VolumesSnapshotListTestJSON-281662468 None] Create snapshot completed successfully Jul 28 10:47:18 devstack sudo[101213]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ec7d2b35-3032-42df-a1b5-5b17aa664958 tempest-VolumesTransfersV355Test-1342427884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-04eb212f-2e56-4657-99fa-dc64118ff634" returned: 0 in 0.282s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:18 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ec7d2b35-3032-42df-a1b5-5b17aa664958 tempest-VolumesTransfersV355Test-1342427884 None] Lock "cinder-quobyte-04eb212f-2e56-4657-99fa-dc64118ff634" released by "delete_volume" :: held 0.747s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:47:18 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-ec7d2b35-3032-42df-a1b5-5b17aa664958 tempest-VolumesTransfersV355Test-1342427884 None] Created reservations ['e55d2849-ced7-4cd2-b417-51d4c866d210', '5abb99e8-e4fd-40fe-be7e-cd56ff97dadd', 'df2333cf-4d39-45fc-9eff-5f1be6d99c2c', 'be9a7896-8830-4571-b936-5ac9dca489c0'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:47:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ec7d2b35-3032-42df-a1b5-5b17aa664958 tempest-VolumesTransfersV355Test-1342427884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:47:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ec7d2b35-3032-42df-a1b5-5b17aa664958 tempest-VolumesTransfersV355Test-1342427884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:47:18 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-ec7d2b35-3032-42df-a1b5-5b17aa664958 tempest-VolumesTransfersV355Test-1342427884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:47:18 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-ec7d2b35-3032-42df-a1b5-5b17aa664958 tempest-VolumesTransfersV355Test-1342427884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:47:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ec7d2b35-3032-42df-a1b5-5b17aa664958 tempest-VolumesTransfersV355Test-1342427884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:47:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ec7d2b35-3032-42df-a1b5-5b17aa664958 tempest-VolumesTransfersV355Test-1342427884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:18 devstack sudo[101217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:47:18 devstack sudo[101217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:18 devstack sudo[101217]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ec7d2b35-3032-42df-a1b5-5b17aa664958 tempest-VolumesTransfersV355Test-1342427884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.337s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:18 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-ec7d2b35-3032-42df-a1b5-5b17aa664958 tempest-VolumesTransfersV355Test-1342427884 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:47:18 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-ec7d2b35-3032-42df-a1b5-5b17aa664958 tempest-VolumesTransfersV355Test-1342427884 None] Deleted volume successfully. Jul 28 10:47:18 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ec7d2b35-3032-42df-a1b5-5b17aa664958 tempest-VolumesTransfersV355Test-1342427884 None] Lock "cinder-04eb212f-2e56-4657-99fa-dc64118ff634-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:47:19 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f9e0bd6-cc83-4d9f-903a-5039ac242135 tempest-VolumesTransfersV355Test-270409330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:47:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4f9e0bd6-cc83-4d9f-903a-5039ac242135 tempest-VolumesTransfersV355Test-270409330 None] Flow 'volume_create_manager' (467d9c0a-ff6d-4073-8b5c-19aa46ed8073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:47:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4f9e0bd6-cc83-4d9f-903a-5039ac242135 tempest-VolumesTransfersV355Test-270409330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd349cd6-6cc7-4e1e-aa5e-fef2ec687110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4f9e0bd6-cc83-4d9f-903a-5039ac242135 tempest-VolumesTransfersV355Test-270409330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd349cd6-6cc7-4e1e-aa5e-fef2ec687110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2137680204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=870621e8-acc0-47dc-8a76-41d8f7f97721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d47916e77b44ea78ae45a19d268e13d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:47:19Z,use_quota=True,user_id='5a3afe377eee48bba86d660b06566610',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:47:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4f9e0bd6-cc83-4d9f-903a-5039ac242135 tempest-VolumesTransfersV355Test-270409330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f126c6b4-c27d-4a39-8bd3-d2807174015f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4f9e0bd6-cc83-4d9f-903a-5039ac242135 tempest-VolumesTransfersV355Test-270409330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f126c6b4-c27d-4a39-8bd3-d2807174015f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:47:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4f9e0bd6-cc83-4d9f-903a-5039ac242135 tempest-VolumesTransfersV355Test-270409330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de3b45f0-22cf-4c85-9aa2-b4d7056bef3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4f9e0bd6-cc83-4d9f-903a-5039ac242135 tempest-VolumesTransfersV355Test-270409330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de3b45f0-22cf-4c85-9aa2-b4d7056bef3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '870621e8-acc0-47dc-8a76-41d8f7f97721', 'volume_name': 'volume-870621e8-acc0-47dc-8a76-41d8f7f97721', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:47:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4f9e0bd6-cc83-4d9f-903a-5039ac242135 tempest-VolumesTransfersV355Test-270409330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c84c9bb1-537d-48aa-8f57-a0b36ca5db2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4f9e0bd6-cc83-4d9f-903a-5039ac242135 tempest-VolumesTransfersV355Test-270409330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c84c9bb1-537d-48aa-8f57-a0b36ca5db2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:47:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4f9e0bd6-cc83-4d9f-903a-5039ac242135 tempest-VolumesTransfersV355Test-270409330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9ae081c-20a9-4e0e-b18b-2e89292a586b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:19 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-4f9e0bd6-cc83-4d9f-903a-5039ac242135 tempest-VolumesTransfersV355Test-270409330 None] Volume 870621e8-acc0-47dc-8a76-41d8f7f97721: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-870621e8-acc0-47dc-8a76-41d8f7f97721', 'volume_size': 1} Jul 28 10:47:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-4f9e0bd6-cc83-4d9f-903a-5039ac242135 tempest-VolumesTransfersV355Test-270409330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:47:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-4f9e0bd6-cc83-4d9f-903a-5039ac242135 tempest-VolumesTransfersV355Test-270409330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:47:19 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-4f9e0bd6-cc83-4d9f-903a-5039ac242135 tempest-VolumesTransfersV355Test-270409330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2137680204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=870621e8-acc0-47dc-8a76-41d8f7f97721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d47916e77b44ea78ae45a19d268e13d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:47:19Z,use_quota=True,user_id='5a3afe377eee48bba86d660b06566610',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:47:19 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-4f9e0bd6-cc83-4d9f-903a-5039ac242135 tempest-VolumesTransfersV355Test-270409330 None] Creating volume 870621e8-acc0-47dc-8a76-41d8f7f97721 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:47:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-4f9e0bd6-cc83-4d9f-903a-5039ac242135 tempest-VolumesTransfersV355Test-270409330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:47:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-4f9e0bd6-cc83-4d9f-903a-5039ac242135 tempest-VolumesTransfersV355Test-270409330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:47:19 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-4f9e0bd6-cc83-4d9f-903a-5039ac242135 tempest-VolumesTransfersV355Test-270409330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:47:19 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-4f9e0bd6-cc83-4d9f-903a-5039ac242135 tempest-VolumesTransfersV355Test-270409330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:47:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-4f9e0bd6-cc83-4d9f-903a-5039ac242135 tempest-VolumesTransfersV355Test-270409330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:47:19 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-4f9e0bd6-cc83-4d9f-903a-5039ac242135 tempest-VolumesTransfersV355Test-270409330 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:47:19 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-4f9e0bd6-cc83-4d9f-903a-5039ac242135 tempest-VolumesTransfersV355Test-270409330 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:47:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4f9e0bd6-cc83-4d9f-903a-5039ac242135 tempest-VolumesTransfersV355Test-270409330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-870621e8-acc0-47dc-8a76-41d8f7f97721 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:19 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f5738b9a-a95d-45a6-9afe-97bd83ee139c tempest-VolumesSnapshotListTestJSON-281662468 None] Acquiring lock "cinder-b8dcb53e-0900-4858-98e1-0e0a932b3726-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:47:19 devstack sudo[101220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-870621e8-acc0-47dc-8a76-41d8f7f97721 1073741824 Jul 28 10:47:19 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:19 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f5738b9a-a95d-45a6-9afe-97bd83ee139c tempest-VolumesSnapshotListTestJSON-281662468 None] Lock "cinder-b8dcb53e-0900-4858-98e1-0e0a932b3726-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:47:19 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f5738b9a-a95d-45a6-9afe-97bd83ee139c tempest-VolumesSnapshotListTestJSON-281662468 None] Acquiring lock "cinder-quobyte-30a19fb9-b73c-4cbf-8ba0-10c5810cc595" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:47:19 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f5738b9a-a95d-45a6-9afe-97bd83ee139c tempest-VolumesSnapshotListTestJSON-281662468 None] Lock "cinder-quobyte-30a19fb9-b73c-4cbf-8ba0-10c5810cc595" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:47:19 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f5738b9a-a95d-45a6-9afe-97bd83ee139c tempest-VolumesSnapshotListTestJSON-281662468 None] Acquiring lock "cinder-quobyte-b8dcb53e-0900-4858-98e1-0e0a932b3726" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:47:19 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f5738b9a-a95d-45a6-9afe-97bd83ee139c tempest-VolumesSnapshotListTestJSON-281662468 None] Lock "cinder-quobyte-b8dcb53e-0900-4858-98e1-0e0a932b3726" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:47:19 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-f5738b9a-a95d-45a6-9afe-97bd83ee139c tempest-VolumesSnapshotListTestJSON-281662468 None] Deleting offline snapshot b8dcb53e-0900-4858-98e1-0e0a932b3726 of volume 30a19fb9-b73c-4cbf-8ba0-10c5810cc595 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:47:19 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-f5738b9a-a95d-45a6-9afe-97bd83ee139c tempest-VolumesSnapshotListTestJSON-281662468 None] snapshot_file for this snap is: volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.b8dcb53e-0900-4858-98e1-0e0a932b3726 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:47:19 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f52870-164e-49ab-a7fd-11c9020aeece]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:47:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f5738b9a-a95d-45a6-9afe-97bd83ee139c tempest-VolumesSnapshotListTestJSON-281662468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.b8dcb53e-0900-4858-98e1-0e0a932b3726 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:19 devstack sudo[101222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.b8dcb53e-0900-4858-98e1-0e0a932b3726 Jul 28 10:47:19 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:20 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f5738b9a-a95d-45a6-9afe-97bd83ee139c tempest-VolumesSnapshotListTestJSON-281662468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.b8dcb53e-0900-4858-98e1-0e0a932b3726" returned: 0 in 0.413s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:20 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-f5738b9a-a95d-45a6-9afe-97bd83ee139c tempest-VolumesSnapshotListTestJSON-281662468 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:47:20 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4f9e0bd6-cc83-4d9f-903a-5039ac242135 tempest-VolumesTransfersV355Test-270409330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-870621e8-acc0-47dc-8a76-41d8f7f97721 1073741824" returned: 0 in 0.573s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:20 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e7b003-8171-4631-86a2-7e3604bb064b]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:47:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f5738b9a-a95d-45a6-9afe-97bd83ee139c tempest-VolumesSnapshotListTestJSON-281662468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.c5da11bf-8170-477a-a8da-7b4ceeb0324a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4f9e0bd6-cc83-4d9f-903a-5039ac242135 tempest-VolumesTransfersV355Test-270409330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-870621e8-acc0-47dc-8a76-41d8f7f97721 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:20 devstack sudo[101234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-870621e8-acc0-47dc-8a76-41d8f7f97721 Jul 28 10:47:20 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:20 devstack sudo[101233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.c5da11bf-8170-477a-a8da-7b4ceeb0324a Jul 28 10:47:20 devstack sudo[101233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:20 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4f9e0bd6-cc83-4d9f-903a-5039ac242135 tempest-VolumesTransfersV355Test-270409330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-870621e8-acc0-47dc-8a76-41d8f7f97721" returned: 0 in 0.272s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:20 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-4f9e0bd6-cc83-4d9f-903a-5039ac242135 tempest-VolumesTransfersV355Test-270409330 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:47:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-4f9e0bd6-cc83-4d9f-903a-5039ac242135 tempest-VolumesTransfersV355Test-270409330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:47:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4f9e0bd6-cc83-4d9f-903a-5039ac242135 tempest-VolumesTransfersV355Test-270409330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9ae081c-20a9-4e0e-b18b-2e89292a586b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-870621e8-acc0-47dc-8a76-41d8f7f97721', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:47:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4f9e0bd6-cc83-4d9f-903a-5039ac242135 tempest-VolumesTransfersV355Test-270409330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6ba6bf2-2ed5-4a85-b28d-b2b172cf9dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:20 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-4f9e0bd6-cc83-4d9f-903a-5039ac242135 tempest-VolumesTransfersV355Test-270409330 None] Volume volume-870621e8-acc0-47dc-8a76-41d8f7f97721 (870621e8-acc0-47dc-8a76-41d8f7f97721): created successfully Jul 28 10:47:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4f9e0bd6-cc83-4d9f-903a-5039ac242135 tempest-VolumesTransfersV355Test-270409330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6ba6bf2-2ed5-4a85-b28d-b2b172cf9dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:47:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4f9e0bd6-cc83-4d9f-903a-5039ac242135 tempest-VolumesTransfersV355Test-270409330 None] Flow 'volume_create_manager' (467d9c0a-ff6d-4073-8b5c-19aa46ed8073) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:47:20 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-4f9e0bd6-cc83-4d9f-903a-5039ac242135 tempest-VolumesTransfersV355Test-270409330 None] Created volume successfully. Jul 28 10:47:20 devstack sudo[101233]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f5738b9a-a95d-45a6-9afe-97bd83ee139c tempest-VolumesSnapshotListTestJSON-281662468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.c5da11bf-8170-477a-a8da-7b4ceeb0324a" returned: 0 in 0.407s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:20 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-f5738b9a-a95d-45a6-9afe-97bd83ee139c tempest-VolumesSnapshotListTestJSON-281662468 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:47:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f5738b9a-a95d-45a6-9afe-97bd83ee139c tempest-VolumesSnapshotListTestJSON-281662468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.b8dcb53e-0900-4858-98e1-0e0a932b3726 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:20 devstack sudo[101242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.b8dcb53e-0900-4858-98e1-0e0a932b3726 Jul 28 10:47:20 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:20 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f5738b9a-a95d-45a6-9afe-97bd83ee139c tempest-VolumesSnapshotListTestJSON-281662468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.b8dcb53e-0900-4858-98e1-0e0a932b3726" returned: 0 in 0.400s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f5738b9a-a95d-45a6-9afe-97bd83ee139c tempest-VolumesSnapshotListTestJSON-281662468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.b8dcb53e-0900-4858-98e1-0e0a932b3726 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:20 devstack sudo[101248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.b8dcb53e-0900-4858-98e1-0e0a932b3726 Jul 28 10:47:20 devstack sudo[101248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:21 devstack sudo[101248]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f5738b9a-a95d-45a6-9afe-97bd83ee139c tempest-VolumesSnapshotListTestJSON-281662468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.b8dcb53e-0900-4858-98e1-0e0a932b3726" returned: 0 in 0.360s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:21 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f5738b9a-a95d-45a6-9afe-97bd83ee139c tempest-VolumesSnapshotListTestJSON-281662468 None] Lock "cinder-quobyte-b8dcb53e-0900-4858-98e1-0e0a932b3726" released by "_delete_snapshot" :: held 1.718s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:47:21 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f5738b9a-a95d-45a6-9afe-97bd83ee139c tempest-VolumesSnapshotListTestJSON-281662468 None] Lock "cinder-quobyte-30a19fb9-b73c-4cbf-8ba0-10c5810cc595" released by "delete_snapshot" :: held 1.743s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:47:21 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-f5738b9a-a95d-45a6-9afe-97bd83ee139c tempest-VolumesSnapshotListTestJSON-281662468 None] Created reservations ['b5e2d04b-0bc2-43f8-9d3d-30ef09a1e0ee', 'e31b2c9a-0755-413c-a506-47c47206683a', '8a1f864d-da56-4330-a38b-b545bb0949e9', 'af8c1eac-0784-4873-9368-f4727b6d9a7f'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:47:21 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-f5738b9a-a95d-45a6-9afe-97bd83ee139c tempest-VolumesSnapshotListTestJSON-281662468 None] Delete snapshot completed successfully. Jul 28 10:47:21 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f5738b9a-a95d-45a6-9afe-97bd83ee139c tempest-VolumesSnapshotListTestJSON-281662468 None] Lock "cinder-b8dcb53e-0900-4858-98e1-0e0a932b3726-delete_snapshot" released by "delete_snapshot" :: held 1.941s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:47:21 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-d9251e58-9906-4c77-b394-3eea740f7889 tempest-VolumesSnapshotListTestJSON-281662468 None] Acquiring lock "cinder-c5da11bf-8170-477a-a8da-7b4ceeb0324a-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:47:21 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-d9251e58-9906-4c77-b394-3eea740f7889 tempest-VolumesSnapshotListTestJSON-281662468 None] Lock "cinder-c5da11bf-8170-477a-a8da-7b4ceeb0324a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:47:21 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-d9251e58-9906-4c77-b394-3eea740f7889 tempest-VolumesSnapshotListTestJSON-281662468 None] Acquiring lock "cinder-quobyte-30a19fb9-b73c-4cbf-8ba0-10c5810cc595" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:47:21 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-d9251e58-9906-4c77-b394-3eea740f7889 tempest-VolumesSnapshotListTestJSON-281662468 None] Lock "cinder-quobyte-30a19fb9-b73c-4cbf-8ba0-10c5810cc595" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:47:21 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-d9251e58-9906-4c77-b394-3eea740f7889 tempest-VolumesSnapshotListTestJSON-281662468 None] Acquiring lock "cinder-quobyte-c5da11bf-8170-477a-a8da-7b4ceeb0324a" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:47:21 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-d9251e58-9906-4c77-b394-3eea740f7889 tempest-VolumesSnapshotListTestJSON-281662468 None] Lock "cinder-quobyte-c5da11bf-8170-477a-a8da-7b4ceeb0324a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:47:21 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-d9251e58-9906-4c77-b394-3eea740f7889 tempest-VolumesSnapshotListTestJSON-281662468 None] Deleting offline snapshot c5da11bf-8170-477a-a8da-7b4ceeb0324a of volume 30a19fb9-b73c-4cbf-8ba0-10c5810cc595 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:47:21 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-d9251e58-9906-4c77-b394-3eea740f7889 tempest-VolumesSnapshotListTestJSON-281662468 None] snapshot_file for this snap is: volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.c5da11bf-8170-477a-a8da-7b4ceeb0324a {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:47:21 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1f3984e9-64fd-4d50-aaa5-4746fe86e224 tempest-VolumesTransfersV355Test-1342427884 None] Acquiring lock "cinder-870621e8-acc0-47dc-8a76-41d8f7f97721-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:47:21 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[c843c0d0-e172-4788-a66e-95d1bbb88c10]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:47:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d9251e58-9906-4c77-b394-3eea740f7889 tempest-VolumesSnapshotListTestJSON-281662468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.c5da11bf-8170-477a-a8da-7b4ceeb0324a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:21 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1f3984e9-64fd-4d50-aaa5-4746fe86e224 tempest-VolumesTransfersV355Test-1342427884 None] Lock "cinder-870621e8-acc0-47dc-8a76-41d8f7f97721-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:47:21 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1f3984e9-64fd-4d50-aaa5-4746fe86e224 tempest-VolumesTransfersV355Test-1342427884 None] Acquiring lock "cinder-quobyte-870621e8-acc0-47dc-8a76-41d8f7f97721" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:47:21 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1f3984e9-64fd-4d50-aaa5-4746fe86e224 tempest-VolumesTransfersV355Test-1342427884 None] Lock "cinder-quobyte-870621e8-acc0-47dc-8a76-41d8f7f97721" acquired by "delete_volume" :: waited 0.017s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:47:21 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db2b2f1-b929-4ff3-9341-7024bd7bec3e]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:47:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1f3984e9-64fd-4d50-aaa5-4746fe86e224 tempest-VolumesTransfersV355Test-1342427884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-870621e8-acc0-47dc-8a76-41d8f7f97721 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:21 devstack sudo[101251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.c5da11bf-8170-477a-a8da-7b4ceeb0324a Jul 28 10:47:21 devstack sudo[101251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:22 devstack sudo[101252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-870621e8-acc0-47dc-8a76-41d8f7f97721 Jul 28 10:47:22 devstack sudo[101252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:22 devstack sudo[101251]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d9251e58-9906-4c77-b394-3eea740f7889 tempest-VolumesSnapshotListTestJSON-281662468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.c5da11bf-8170-477a-a8da-7b4ceeb0324a" returned: 0 in 0.429s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:22 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-d9251e58-9906-4c77-b394-3eea740f7889 tempest-VolumesSnapshotListTestJSON-281662468 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:47:22 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e11ae1-6574-487d-8152-48eab9f8efea]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:47:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d9251e58-9906-4c77-b394-3eea740f7889 tempest-VolumesSnapshotListTestJSON-281662468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.70e67770-9d63-4473-af21-362cbaaa1b8b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:22 devstack sudo[101252]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1f3984e9-64fd-4d50-aaa5-4746fe86e224 tempest-VolumesTransfersV355Test-1342427884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-870621e8-acc0-47dc-8a76-41d8f7f97721" returned: 0 in 0.388s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1f3984e9-64fd-4d50-aaa5-4746fe86e224 tempest-VolumesTransfersV355Test-1342427884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-870621e8-acc0-47dc-8a76-41d8f7f97721 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:22 devstack sudo[101262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-870621e8-acc0-47dc-8a76-41d8f7f97721 Jul 28 10:47:22 devstack sudo[101262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:22 devstack sudo[101261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.70e67770-9d63-4473-af21-362cbaaa1b8b Jul 28 10:47:22 devstack sudo[101261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:22 devstack sudo[101262]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1f3984e9-64fd-4d50-aaa5-4746fe86e224 tempest-VolumesTransfersV355Test-1342427884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-870621e8-acc0-47dc-8a76-41d8f7f97721" returned: 0 in 0.282s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:22 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1f3984e9-64fd-4d50-aaa5-4746fe86e224 tempest-VolumesTransfersV355Test-1342427884 None] Lock "cinder-quobyte-870621e8-acc0-47dc-8a76-41d8f7f97721" released by "delete_volume" :: held 0.718s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:47:22 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-1f3984e9-64fd-4d50-aaa5-4746fe86e224 tempest-VolumesTransfersV355Test-1342427884 None] Created reservations ['32cd2fd8-9f0c-420f-af74-f58e44dca86a', '4873f124-caf6-4cae-828c-bb7c6306e78b', '03046d5f-5128-4165-9409-2824e0212139', '81362149-cc1e-4964-834e-b103587205f7'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:47:22 devstack sudo[101261]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d9251e58-9906-4c77-b394-3eea740f7889 tempest-VolumesSnapshotListTestJSON-281662468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.70e67770-9d63-4473-af21-362cbaaa1b8b" returned: 0 in 0.466s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:22 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-d9251e58-9906-4c77-b394-3eea740f7889 tempest-VolumesSnapshotListTestJSON-281662468 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:47:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d9251e58-9906-4c77-b394-3eea740f7889 tempest-VolumesSnapshotListTestJSON-281662468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.c5da11bf-8170-477a-a8da-7b4ceeb0324a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:22 devstack sudo[101304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.c5da11bf-8170-477a-a8da-7b4ceeb0324a Jul 28 10:47:22 devstack sudo[101304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1f3984e9-64fd-4d50-aaa5-4746fe86e224 tempest-VolumesTransfersV355Test-1342427884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:47:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1f3984e9-64fd-4d50-aaa5-4746fe86e224 tempest-VolumesTransfersV355Test-1342427884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:47:22 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-1f3984e9-64fd-4d50-aaa5-4746fe86e224 tempest-VolumesTransfersV355Test-1342427884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:47:22 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-1f3984e9-64fd-4d50-aaa5-4746fe86e224 tempest-VolumesTransfersV355Test-1342427884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:47:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1f3984e9-64fd-4d50-aaa5-4746fe86e224 tempest-VolumesTransfersV355Test-1342427884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:47:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1f3984e9-64fd-4d50-aaa5-4746fe86e224 tempest-VolumesTransfersV355Test-1342427884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:22 devstack sudo[101306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:47:22 devstack sudo[101306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:23 devstack sudo[101306]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1f3984e9-64fd-4d50-aaa5-4746fe86e224 tempest-VolumesTransfersV355Test-1342427884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.448s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:23 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-1f3984e9-64fd-4d50-aaa5-4746fe86e224 tempest-VolumesTransfersV355Test-1342427884 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:47:23 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-1f3984e9-64fd-4d50-aaa5-4746fe86e224 tempest-VolumesTransfersV355Test-1342427884 None] Deleted volume successfully. Jul 28 10:47:23 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1f3984e9-64fd-4d50-aaa5-4746fe86e224 tempest-VolumesTransfersV355Test-1342427884 None] Lock "cinder-870621e8-acc0-47dc-8a76-41d8f7f97721-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:47:23 devstack sudo[101304]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d9251e58-9906-4c77-b394-3eea740f7889 tempest-VolumesSnapshotListTestJSON-281662468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.c5da11bf-8170-477a-a8da-7b4ceeb0324a" returned: 0 in 0.622s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d9251e58-9906-4c77-b394-3eea740f7889 tempest-VolumesSnapshotListTestJSON-281662468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.c5da11bf-8170-477a-a8da-7b4ceeb0324a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:23 devstack sudo[101315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.c5da11bf-8170-477a-a8da-7b4ceeb0324a Jul 28 10:47:23 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:23 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d9251e58-9906-4c77-b394-3eea740f7889 tempest-VolumesSnapshotListTestJSON-281662468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.c5da11bf-8170-477a-a8da-7b4ceeb0324a" returned: 0 in 0.329s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:23 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-d9251e58-9906-4c77-b394-3eea740f7889 tempest-VolumesSnapshotListTestJSON-281662468 None] Lock "cinder-quobyte-c5da11bf-8170-477a-a8da-7b4ceeb0324a" released by "_delete_snapshot" :: held 1.990s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:47:23 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-d9251e58-9906-4c77-b394-3eea740f7889 tempest-VolumesSnapshotListTestJSON-281662468 None] Lock "cinder-quobyte-30a19fb9-b73c-4cbf-8ba0-10c5810cc595" released by "delete_snapshot" :: held 2.016s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:47:23 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-d9251e58-9906-4c77-b394-3eea740f7889 tempest-VolumesSnapshotListTestJSON-281662468 None] Created reservations ['bee34ee0-e6df-4ceb-8092-78bd97d4daed', 'c2178dbc-54c6-4329-8454-ba24c88745bd', '5fa47433-8bc6-4b24-a9a6-88c22ea81280', '90e9285f-e6de-49e1-bd35-ef4f24fc43d6'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:47:23 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-d9251e58-9906-4c77-b394-3eea740f7889 tempest-VolumesSnapshotListTestJSON-281662468 None] Delete snapshot completed successfully. Jul 28 10:47:23 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-d9251e58-9906-4c77-b394-3eea740f7889 tempest-VolumesSnapshotListTestJSON-281662468 None] Lock "cinder-c5da11bf-8170-477a-a8da-7b4ceeb0324a-delete_snapshot" released by "delete_snapshot" :: held 2.190s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:47:24 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-56f2f06b-bc1d-46fc-9e31-d898f7d0945e tempest-VolumesSnapshotListTestJSON-281662468 None] Acquiring lock "cinder-70e67770-9d63-4473-af21-362cbaaa1b8b-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:47:24 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-56f2f06b-bc1d-46fc-9e31-d898f7d0945e tempest-VolumesSnapshotListTestJSON-281662468 None] Lock "cinder-70e67770-9d63-4473-af21-362cbaaa1b8b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:47:24 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-56f2f06b-bc1d-46fc-9e31-d898f7d0945e tempest-VolumesSnapshotListTestJSON-281662468 None] Acquiring lock "cinder-quobyte-30a19fb9-b73c-4cbf-8ba0-10c5810cc595" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:47:24 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-56f2f06b-bc1d-46fc-9e31-d898f7d0945e tempest-VolumesSnapshotListTestJSON-281662468 None] Lock "cinder-quobyte-30a19fb9-b73c-4cbf-8ba0-10c5810cc595" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:47:24 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-56f2f06b-bc1d-46fc-9e31-d898f7d0945e tempest-VolumesSnapshotListTestJSON-281662468 None] Acquiring lock "cinder-quobyte-70e67770-9d63-4473-af21-362cbaaa1b8b" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:47:24 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-56f2f06b-bc1d-46fc-9e31-d898f7d0945e tempest-VolumesSnapshotListTestJSON-281662468 None] Lock "cinder-quobyte-70e67770-9d63-4473-af21-362cbaaa1b8b" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:47:25 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-56f2f06b-bc1d-46fc-9e31-d898f7d0945e tempest-VolumesSnapshotListTestJSON-281662468 None] Deleting offline snapshot 70e67770-9d63-4473-af21-362cbaaa1b8b of volume 30a19fb9-b73c-4cbf-8ba0-10c5810cc595 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:47:25 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-56f2f06b-bc1d-46fc-9e31-d898f7d0945e tempest-VolumesSnapshotListTestJSON-281662468 None] snapshot_file for this snap is: volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.70e67770-9d63-4473-af21-362cbaaa1b8b {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:47:25 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[09dc90de-e573-4e53-81f7-252aa8ce76a3]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:47:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-56f2f06b-bc1d-46fc-9e31-d898f7d0945e tempest-VolumesSnapshotListTestJSON-281662468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.70e67770-9d63-4473-af21-362cbaaa1b8b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:25 devstack sudo[101318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.70e67770-9d63-4473-af21-362cbaaa1b8b Jul 28 10:47:25 devstack sudo[101318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:25 devstack sudo[101318]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-56f2f06b-bc1d-46fc-9e31-d898f7d0945e tempest-VolumesSnapshotListTestJSON-281662468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.70e67770-9d63-4473-af21-362cbaaa1b8b" returned: 0 in 0.483s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:25 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-56f2f06b-bc1d-46fc-9e31-d898f7d0945e tempest-VolumesSnapshotListTestJSON-281662468 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:47:25 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb091c9-3748-4e0c-b838-ff06a36e5b47]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:47:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-56f2f06b-bc1d-46fc-9e31-d898f7d0945e tempest-VolumesSnapshotListTestJSON-281662468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:25 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595 Jul 28 10:47:25 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:25 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-56f2f06b-bc1d-46fc-9e31-d898f7d0945e tempest-VolumesSnapshotListTestJSON-281662468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595" returned: 0 in 0.374s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-56f2f06b-bc1d-46fc-9e31-d898f7d0945e tempest-VolumesSnapshotListTestJSON-281662468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.70e67770-9d63-4473-af21-362cbaaa1b8b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:26 devstack sudo[101328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.70e67770-9d63-4473-af21-362cbaaa1b8b Jul 28 10:47:26 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:26 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-56f2f06b-bc1d-46fc-9e31-d898f7d0945e tempest-VolumesSnapshotListTestJSON-281662468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.70e67770-9d63-4473-af21-362cbaaa1b8b" returned: 0 in 0.421s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-56f2f06b-bc1d-46fc-9e31-d898f7d0945e tempest-VolumesSnapshotListTestJSON-281662468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.70e67770-9d63-4473-af21-362cbaaa1b8b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:26 devstack sudo[101333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.70e67770-9d63-4473-af21-362cbaaa1b8b Jul 28 10:47:26 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:26 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-56f2f06b-bc1d-46fc-9e31-d898f7d0945e tempest-VolumesSnapshotListTestJSON-281662468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595.70e67770-9d63-4473-af21-362cbaaa1b8b" returned: 0 in 0.258s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:26 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-56f2f06b-bc1d-46fc-9e31-d898f7d0945e tempest-VolumesSnapshotListTestJSON-281662468 None] Lock "cinder-quobyte-70e67770-9d63-4473-af21-362cbaaa1b8b" released by "_delete_snapshot" :: held 1.751s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:47:26 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-56f2f06b-bc1d-46fc-9e31-d898f7d0945e tempest-VolumesSnapshotListTestJSON-281662468 None] Lock "cinder-quobyte-30a19fb9-b73c-4cbf-8ba0-10c5810cc595" released by "delete_snapshot" :: held 1.793s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:47:26 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-56f2f06b-bc1d-46fc-9e31-d898f7d0945e tempest-VolumesSnapshotListTestJSON-281662468 None] Created reservations ['51f2f586-8f48-4588-a1d7-2aec2390041a', 'fe8f4ee7-61ae-4b07-b384-0d88f6fc3db7', '443c4a1c-9262-400d-bb4c-859aef21320b', 'b1b43044-1ec8-448a-b200-0098224e903d'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:47:26 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-56f2f06b-bc1d-46fc-9e31-d898f7d0945e tempest-VolumesSnapshotListTestJSON-281662468 None] Delete snapshot completed successfully. Jul 28 10:47:26 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-56f2f06b-bc1d-46fc-9e31-d898f7d0945e tempest-VolumesSnapshotListTestJSON-281662468 None] Lock "cinder-70e67770-9d63-4473-af21-362cbaaa1b8b-delete_snapshot" released by "delete_snapshot" :: held 1.974s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:47:27 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1afeecdc-907e-4665-9799-7c31bdd7b045 tempest-VolumesSnapshotListTestJSON-281662468 None] Acquiring lock "cinder-30a19fb9-b73c-4cbf-8ba0-10c5810cc595-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:47:27 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1afeecdc-907e-4665-9799-7c31bdd7b045 tempest-VolumesSnapshotListTestJSON-281662468 None] Lock "cinder-30a19fb9-b73c-4cbf-8ba0-10c5810cc595-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:47:27 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1afeecdc-907e-4665-9799-7c31bdd7b045 tempest-VolumesSnapshotListTestJSON-281662468 None] Acquiring lock "cinder-quobyte-30a19fb9-b73c-4cbf-8ba0-10c5810cc595" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:47:27 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1afeecdc-907e-4665-9799-7c31bdd7b045 tempest-VolumesSnapshotListTestJSON-281662468 None] Lock "cinder-quobyte-30a19fb9-b73c-4cbf-8ba0-10c5810cc595" acquired by "delete_volume" :: waited 0.025s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:47:27 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ddbf8c8-6c41-4215-812f-759485cba143]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:47:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1afeecdc-907e-4665-9799-7c31bdd7b045 tempest-VolumesSnapshotListTestJSON-281662468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:27 devstack sudo[101336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595 Jul 28 10:47:27 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:27 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1afeecdc-907e-4665-9799-7c31bdd7b045 tempest-VolumesSnapshotListTestJSON-281662468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595" returned: 0 in 0.433s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1afeecdc-907e-4665-9799-7c31bdd7b045 tempest-VolumesSnapshotListTestJSON-281662468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:27 devstack sudo[101341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595 Jul 28 10:47:27 devstack sudo[101341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:28 devstack sudo[101341]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1afeecdc-907e-4665-9799-7c31bdd7b045 tempest-VolumesSnapshotListTestJSON-281662468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-30a19fb9-b73c-4cbf-8ba0-10c5810cc595" returned: 0 in 0.337s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:28 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1afeecdc-907e-4665-9799-7c31bdd7b045 tempest-VolumesSnapshotListTestJSON-281662468 None] Lock "cinder-quobyte-30a19fb9-b73c-4cbf-8ba0-10c5810cc595" released by "delete_volume" :: held 0.860s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:47:28 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-1afeecdc-907e-4665-9799-7c31bdd7b045 tempest-VolumesSnapshotListTestJSON-281662468 None] Created reservations ['9f14cf55-0f9b-4634-8a6f-b0bad060413c', '41cee4af-4829-4923-84e7-d657f8a999b2', 'cdec822c-6aeb-45f7-b0b3-8506666c1325', 'e6530ac8-57c9-45a8-a13b-fbb420bec793'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:47:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1afeecdc-907e-4665-9799-7c31bdd7b045 tempest-VolumesSnapshotListTestJSON-281662468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:47:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1afeecdc-907e-4665-9799-7c31bdd7b045 tempest-VolumesSnapshotListTestJSON-281662468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:47:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-1afeecdc-907e-4665-9799-7c31bdd7b045 tempest-VolumesSnapshotListTestJSON-281662468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:47:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-1afeecdc-907e-4665-9799-7c31bdd7b045 tempest-VolumesSnapshotListTestJSON-281662468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:47:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1afeecdc-907e-4665-9799-7c31bdd7b045 tempest-VolumesSnapshotListTestJSON-281662468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:47:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1afeecdc-907e-4665-9799-7c31bdd7b045 tempest-VolumesSnapshotListTestJSON-281662468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:28 devstack sudo[101344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:47:28 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:28 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:47:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:47:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:47:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:47:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:47:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:47:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:28 devstack sudo[101346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:47:28 devstack sudo[101346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:28 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1afeecdc-907e-4665-9799-7c31bdd7b045 tempest-VolumesSnapshotListTestJSON-281662468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.355s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:28 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-1afeecdc-907e-4665-9799-7c31bdd7b045 tempest-VolumesSnapshotListTestJSON-281662468 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:47:28 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-1afeecdc-907e-4665-9799-7c31bdd7b045 tempest-VolumesSnapshotListTestJSON-281662468 None] Deleted volume successfully. Jul 28 10:47:28 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1afeecdc-907e-4665-9799-7c31bdd7b045 tempest-VolumesSnapshotListTestJSON-281662468 None] Lock "cinder-30a19fb9-b73c-4cbf-8ba0-10c5810cc595-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:47:28 devstack sudo[101346]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.467s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:28 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:47:28 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager._thread_info {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:47:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread count: 29 {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 10:47:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread info: [<_MainThread(MainThread, started 137939890385024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 10:47:29 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-da3ce25c-eb7a-4a83-903b-b0568c956b16 tempest-TestImageHashVerification-1549765354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:47:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-da3ce25c-eb7a-4a83-903b-b0568c956b16 tempest-TestImageHashVerification-1549765354 None] Flow 'volume_create_manager' (571a6978-82d3-4dab-a37e-de33f5c89b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:47:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-da3ce25c-eb7a-4a83-903b-b0568c956b16 tempest-TestImageHashVerification-1549765354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c457d7d4-0ed1-4262-9a19-0854589a59c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-da3ce25c-eb7a-4a83-903b-b0568c956b16 tempest-TestImageHashVerification-1549765354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c457d7d4-0ed1-4262-9a19-0854589a59c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-579005844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=189f7fea-27c7-4ad5-b992-693a41ec12e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35a419b444354bc18a0363064cb7a21c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:47:29Z,use_quota=True,user_id='8e7dc98949514862ab7373a002828483',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:47:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-da3ce25c-eb7a-4a83-903b-b0568c956b16 tempest-TestImageHashVerification-1549765354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a88d35ec-a3a2-4f2e-b5ec-fed157242143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-da3ce25c-eb7a-4a83-903b-b0568c956b16 tempest-TestImageHashVerification-1549765354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a88d35ec-a3a2-4f2e-b5ec-fed157242143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:47:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-da3ce25c-eb7a-4a83-903b-b0568c956b16 tempest-TestImageHashVerification-1549765354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ed7acd7-b99b-4ebe-84c0-4ee04ef844dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-da3ce25c-eb7a-4a83-903b-b0568c956b16 tempest-TestImageHashVerification-1549765354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ed7acd7-b99b-4ebe-84c0-4ee04ef844dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '189f7fea-27c7-4ad5-b992-693a41ec12e7', 'volume_name': 'volume-189f7fea-27c7-4ad5-b992-693a41ec12e7', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:47:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-da3ce25c-eb7a-4a83-903b-b0568c956b16 tempest-TestImageHashVerification-1549765354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3660aa2c-78f7-4e49-bd9c-3e71e1f1802e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-da3ce25c-eb7a-4a83-903b-b0568c956b16 tempest-TestImageHashVerification-1549765354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3660aa2c-78f7-4e49-bd9c-3e71e1f1802e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:47:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-da3ce25c-eb7a-4a83-903b-b0568c956b16 tempest-TestImageHashVerification-1549765354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf914c54-756d-40ca-9fb1-83f83f714d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:29 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-da3ce25c-eb7a-4a83-903b-b0568c956b16 tempest-TestImageHashVerification-1549765354 None] Volume 189f7fea-27c7-4ad5-b992-693a41ec12e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-189f7fea-27c7-4ad5-b992-693a41ec12e7', 'volume_size': 1} Jul 28 10:47:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-da3ce25c-eb7a-4a83-903b-b0568c956b16 tempest-TestImageHashVerification-1549765354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:47:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-da3ce25c-eb7a-4a83-903b-b0568c956b16 tempest-TestImageHashVerification-1549765354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:47:29 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-da3ce25c-eb7a-4a83-903b-b0568c956b16 tempest-TestImageHashVerification-1549765354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-579005844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=189f7fea-27c7-4ad5-b992-693a41ec12e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35a419b444354bc18a0363064cb7a21c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:47:29Z,use_quota=True,user_id='8e7dc98949514862ab7373a002828483',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:47:29 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-da3ce25c-eb7a-4a83-903b-b0568c956b16 tempest-TestImageHashVerification-1549765354 None] Creating volume 189f7fea-27c7-4ad5-b992-693a41ec12e7 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:47:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-da3ce25c-eb7a-4a83-903b-b0568c956b16 tempest-TestImageHashVerification-1549765354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:47:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-da3ce25c-eb7a-4a83-903b-b0568c956b16 tempest-TestImageHashVerification-1549765354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:47:29 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-da3ce25c-eb7a-4a83-903b-b0568c956b16 tempest-TestImageHashVerification-1549765354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:47:29 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-da3ce25c-eb7a-4a83-903b-b0568c956b16 tempest-TestImageHashVerification-1549765354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:47:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-da3ce25c-eb7a-4a83-903b-b0568c956b16 tempest-TestImageHashVerification-1549765354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:47:29 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-da3ce25c-eb7a-4a83-903b-b0568c956b16 tempest-TestImageHashVerification-1549765354 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:47:29 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-da3ce25c-eb7a-4a83-903b-b0568c956b16 tempest-TestImageHashVerification-1549765354 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:47:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-da3ce25c-eb7a-4a83-903b-b0568c956b16 tempest-TestImageHashVerification-1549765354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-189f7fea-27c7-4ad5-b992-693a41ec12e7 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:29 devstack sudo[101350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-189f7fea-27c7-4ad5-b992-693a41ec12e7 1073741824 Jul 28 10:47:29 devstack sudo[101350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:29 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fa83dc4-0fed-4875-8209-b7a121d7dea1 tempest-VolumesCloneNegativeTest-1761357426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:47:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5fa83dc4-0fed-4875-8209-b7a121d7dea1 tempest-VolumesCloneNegativeTest-1761357426 None] Flow 'volume_create_manager' (0a120dbd-2ca0-4e25-bdeb-561823e2a226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:47:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5fa83dc4-0fed-4875-8209-b7a121d7dea1 tempest-VolumesCloneNegativeTest-1761357426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aababb5d-e4e4-4dd4-be05-cb52dffb9516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5fa83dc4-0fed-4875-8209-b7a121d7dea1 tempest-VolumesCloneNegativeTest-1761357426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aababb5d-e4e4-4dd4-be05-cb52dffb9516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1748981772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51022338-0cd2-4ca1-a570-7ab659050514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa2fba498faa49acbed38a5c59b394c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:47:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:47:30Z,use_quota=True,user_id='300038241c124cc182049c372e571f7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:47:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5fa83dc4-0fed-4875-8209-b7a121d7dea1 tempest-VolumesCloneNegativeTest-1761357426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1735c670-1aaf-45df-a17b-8d16030f6fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5fa83dc4-0fed-4875-8209-b7a121d7dea1 tempest-VolumesCloneNegativeTest-1761357426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1735c670-1aaf-45df-a17b-8d16030f6fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:47:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5fa83dc4-0fed-4875-8209-b7a121d7dea1 tempest-VolumesCloneNegativeTest-1761357426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ed8199-cc0f-4fc5-81a0-e6eb4a1e10ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5fa83dc4-0fed-4875-8209-b7a121d7dea1 tempest-VolumesCloneNegativeTest-1761357426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ed8199-cc0f-4fc5-81a0-e6eb4a1e10ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51022338-0cd2-4ca1-a570-7ab659050514', 'volume_name': 'volume-51022338-0cd2-4ca1-a570-7ab659050514', 'volume_size': 2}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:47:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5fa83dc4-0fed-4875-8209-b7a121d7dea1 tempest-VolumesCloneNegativeTest-1761357426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05eb3ec2-9f91-4931-9a0f-4d1eedc5cbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5fa83dc4-0fed-4875-8209-b7a121d7dea1 tempest-VolumesCloneNegativeTest-1761357426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05eb3ec2-9f91-4931-9a0f-4d1eedc5cbe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:47:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5fa83dc4-0fed-4875-8209-b7a121d7dea1 tempest-VolumesCloneNegativeTest-1761357426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4bf1e00-770f-4d01-b803-b814c8d7a3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:29 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-5fa83dc4-0fed-4875-8209-b7a121d7dea1 tempest-VolumesCloneNegativeTest-1761357426 None] Volume 51022338-0cd2-4ca1-a570-7ab659050514: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51022338-0cd2-4ca1-a570-7ab659050514', 'volume_size': 2} Jul 28 10:47:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5fa83dc4-0fed-4875-8209-b7a121d7dea1 tempest-VolumesCloneNegativeTest-1761357426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:47:29 devstack sudo[101350]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-da3ce25c-eb7a-4a83-903b-b0568c956b16 tempest-TestImageHashVerification-1549765354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-189f7fea-27c7-4ad5-b992-693a41ec12e7 1073741824" returned: 0 in 0.560s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-da3ce25c-eb7a-4a83-903b-b0568c956b16 tempest-TestImageHashVerification-1549765354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-189f7fea-27c7-4ad5-b992-693a41ec12e7 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:29 devstack sudo[101357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-189f7fea-27c7-4ad5-b992-693a41ec12e7 Jul 28 10:47:29 devstack sudo[101357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:30 devstack sudo[101357]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-da3ce25c-eb7a-4a83-903b-b0568c956b16 tempest-TestImageHashVerification-1549765354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-189f7fea-27c7-4ad5-b992-693a41ec12e7" returned: 0 in 0.261s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:30 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-da3ce25c-eb7a-4a83-903b-b0568c956b16 tempest-TestImageHashVerification-1549765354 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:47:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-da3ce25c-eb7a-4a83-903b-b0568c956b16 tempest-TestImageHashVerification-1549765354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:47:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5fa83dc4-0fed-4875-8209-b7a121d7dea1 tempest-VolumesCloneNegativeTest-1761357426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.353s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:47:30 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5fa83dc4-0fed-4875-8209-b7a121d7dea1 tempest-VolumesCloneNegativeTest-1761357426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1748981772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51022338-0cd2-4ca1-a570-7ab659050514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa2fba498faa49acbed38a5c59b394c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:47:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:47:30Z,use_quota=True,user_id='300038241c124cc182049c372e571f7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:47:30 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-5fa83dc4-0fed-4875-8209-b7a121d7dea1 tempest-VolumesCloneNegativeTest-1761357426 None] Creating volume 51022338-0cd2-4ca1-a570-7ab659050514 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:47:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5fa83dc4-0fed-4875-8209-b7a121d7dea1 tempest-VolumesCloneNegativeTest-1761357426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:47:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5fa83dc4-0fed-4875-8209-b7a121d7dea1 tempest-VolumesCloneNegativeTest-1761357426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:47:30 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5fa83dc4-0fed-4875-8209-b7a121d7dea1 tempest-VolumesCloneNegativeTest-1761357426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:47:30 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5fa83dc4-0fed-4875-8209-b7a121d7dea1 tempest-VolumesCloneNegativeTest-1761357426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:47:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5fa83dc4-0fed-4875-8209-b7a121d7dea1 tempest-VolumesCloneNegativeTest-1761357426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:47:30 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5fa83dc4-0fed-4875-8209-b7a121d7dea1 tempest-VolumesCloneNegativeTest-1761357426 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:47:30 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-5fa83dc4-0fed-4875-8209-b7a121d7dea1 tempest-VolumesCloneNegativeTest-1761357426 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:47:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5fa83dc4-0fed-4875-8209-b7a121d7dea1 tempest-VolumesCloneNegativeTest-1761357426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-51022338-0cd2-4ca1-a570-7ab659050514 2147483648 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-da3ce25c-eb7a-4a83-903b-b0568c956b16 tempest-TestImageHashVerification-1549765354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf914c54-756d-40ca-9fb1-83f83f714d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-189f7fea-27c7-4ad5-b992-693a41ec12e7', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:47:30 devstack sudo[101360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-51022338-0cd2-4ca1-a570-7ab659050514 2147483648 Jul 28 10:47:30 devstack sudo[101360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-da3ce25c-eb7a-4a83-903b-b0568c956b16 tempest-TestImageHashVerification-1549765354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd1aa7d7-bdd0-4c80-9aff-fe796362d30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:30 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-da3ce25c-eb7a-4a83-903b-b0568c956b16 tempest-TestImageHashVerification-1549765354 None] Volume volume-189f7fea-27c7-4ad5-b992-693a41ec12e7 (189f7fea-27c7-4ad5-b992-693a41ec12e7): created successfully Jul 28 10:47:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-da3ce25c-eb7a-4a83-903b-b0568c956b16 tempest-TestImageHashVerification-1549765354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd1aa7d7-bdd0-4c80-9aff-fe796362d30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:47:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-da3ce25c-eb7a-4a83-903b-b0568c956b16 tempest-TestImageHashVerification-1549765354 None] Flow 'volume_create_manager' (571a6978-82d3-4dab-a37e-de33f5c89b96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:47:30 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-da3ce25c-eb7a-4a83-903b-b0568c956b16 tempest-TestImageHashVerification-1549765354 None] Created volume successfully. Jul 28 10:47:30 devstack sudo[101360]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5fa83dc4-0fed-4875-8209-b7a121d7dea1 tempest-VolumesCloneNegativeTest-1761357426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-51022338-0cd2-4ca1-a570-7ab659050514 2147483648" returned: 0 in 0.548s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5fa83dc4-0fed-4875-8209-b7a121d7dea1 tempest-VolumesCloneNegativeTest-1761357426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-51022338-0cd2-4ca1-a570-7ab659050514 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:30 devstack sudo[101366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-51022338-0cd2-4ca1-a570-7ab659050514 Jul 28 10:47:30 devstack sudo[101366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:30 devstack sudo[101366]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5fa83dc4-0fed-4875-8209-b7a121d7dea1 tempest-VolumesCloneNegativeTest-1761357426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-51022338-0cd2-4ca1-a570-7ab659050514" returned: 0 in 0.257s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:30 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5fa83dc4-0fed-4875-8209-b7a121d7dea1 tempest-VolumesCloneNegativeTest-1761357426 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:47:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5fa83dc4-0fed-4875-8209-b7a121d7dea1 tempest-VolumesCloneNegativeTest-1761357426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:47:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5fa83dc4-0fed-4875-8209-b7a121d7dea1 tempest-VolumesCloneNegativeTest-1761357426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4bf1e00-770f-4d01-b803-b814c8d7a3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51022338-0cd2-4ca1-a570-7ab659050514', 'volume_size': 2}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:47:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5fa83dc4-0fed-4875-8209-b7a121d7dea1 tempest-VolumesCloneNegativeTest-1761357426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63b44871-88b4-404b-a845-fcd984c144b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:30 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-5fa83dc4-0fed-4875-8209-b7a121d7dea1 tempest-VolumesCloneNegativeTest-1761357426 None] Volume volume-51022338-0cd2-4ca1-a570-7ab659050514 (51022338-0cd2-4ca1-a570-7ab659050514): created successfully Jul 28 10:47:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5fa83dc4-0fed-4875-8209-b7a121d7dea1 tempest-VolumesCloneNegativeTest-1761357426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63b44871-88b4-404b-a845-fcd984c144b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:47:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5fa83dc4-0fed-4875-8209-b7a121d7dea1 tempest-VolumesCloneNegativeTest-1761357426 None] Flow 'volume_create_manager' (0a120dbd-2ca0-4e25-bdeb-561823e2a226) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:47:30 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-5fa83dc4-0fed-4875-8209-b7a121d7dea1 tempest-VolumesCloneNegativeTest-1761357426 None] Created volume successfully. Jul 28 10:47:31 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-53c4e691-3e84-424c-ba57-db840fcd417b tempest-VolumesCloneNegativeTest-1761357426 None] Acquiring lock "cinder-51022338-0cd2-4ca1-a570-7ab659050514-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:47:31 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-53c4e691-3e84-424c-ba57-db840fcd417b tempest-VolumesCloneNegativeTest-1761357426 None] Lock "cinder-51022338-0cd2-4ca1-a570-7ab659050514-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:47:31 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-53c4e691-3e84-424c-ba57-db840fcd417b tempest-VolumesCloneNegativeTest-1761357426 None] Acquiring lock "cinder-quobyte-51022338-0cd2-4ca1-a570-7ab659050514" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:47:31 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-53c4e691-3e84-424c-ba57-db840fcd417b tempest-VolumesCloneNegativeTest-1761357426 None] Lock "cinder-quobyte-51022338-0cd2-4ca1-a570-7ab659050514" acquired by "delete_volume" :: waited 0.015s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:47:31 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d67790-c771-4008-bb92-080a98dae8ba]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:47:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-53c4e691-3e84-424c-ba57-db840fcd417b tempest-VolumesCloneNegativeTest-1761357426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-51022338-0cd2-4ca1-a570-7ab659050514 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:32 devstack sudo[101369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-51022338-0cd2-4ca1-a570-7ab659050514 Jul 28 10:47:32 devstack sudo[101369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-92e085bc-2446-4a75-9e0e-554f361e4a02 tempest-TestImageHashVerification-1549765354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:47:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-92e085bc-2446-4a75-9e0e-554f361e4a02 tempest-TestImageHashVerification-1549765354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:47:32 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ee41df-d527-4ebd-af33-ee0ed6be5e11]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:47:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-92e085bc-2446-4a75-9e0e-554f361e4a02 tempest-TestImageHashVerification-1549765354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-189f7fea-27c7-4ad5-b992-693a41ec12e7 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:32 devstack sudo[101371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-189f7fea-27c7-4ad5-b992-693a41ec12e7 Jul 28 10:47:32 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:32 devstack sudo[101369]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-53c4e691-3e84-424c-ba57-db840fcd417b tempest-VolumesCloneNegativeTest-1761357426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-51022338-0cd2-4ca1-a570-7ab659050514" returned: 0 in 0.441s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-53c4e691-3e84-424c-ba57-db840fcd417b tempest-VolumesCloneNegativeTest-1761357426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-51022338-0cd2-4ca1-a570-7ab659050514 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:32 devstack sudo[101376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-51022338-0cd2-4ca1-a570-7ab659050514 Jul 28 10:47:32 devstack sudo[101376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:32 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-92e085bc-2446-4a75-9e0e-554f361e4a02 tempest-TestImageHashVerification-1549765354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-189f7fea-27c7-4ad5-b992-693a41ec12e7" returned: 0 in 0.396s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:32 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[98064b68-bd48-4e7c-9472-da2651a3c8cd]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:47:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-92e085bc-2446-4a75-9e0e-554f361e4a02 tempest-TestImageHashVerification-1549765354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-189f7fea-27c7-4ad5-b992-693a41ec12e7 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:32 devstack sudo[101376]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-53c4e691-3e84-424c-ba57-db840fcd417b tempest-VolumesCloneNegativeTest-1761357426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-51022338-0cd2-4ca1-a570-7ab659050514" returned: 0 in 0.268s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:32 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-53c4e691-3e84-424c-ba57-db840fcd417b tempest-VolumesCloneNegativeTest-1761357426 None] Lock "cinder-quobyte-51022338-0cd2-4ca1-a570-7ab659050514" released by "delete_volume" :: held 0.770s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:47:32 devstack sudo[101381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-189f7fea-27c7-4ad5-b992-693a41ec12e7 Jul 28 10:47:32 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:32 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-53c4e691-3e84-424c-ba57-db840fcd417b tempest-VolumesCloneNegativeTest-1761357426 None] Created reservations ['39717446-86d4-4612-8503-9cb1300e01f9', 'cdda04bc-a6f8-419d-9236-21629a6f1420', '6a4e522d-92f4-4795-ba5d-280b03e3f986', 'c6d35e41-6c37-40c5-987c-292298e09a32'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:47:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-53c4e691-3e84-424c-ba57-db840fcd417b tempest-VolumesCloneNegativeTest-1761357426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:47:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-53c4e691-3e84-424c-ba57-db840fcd417b tempest-VolumesCloneNegativeTest-1761357426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:47:32 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-53c4e691-3e84-424c-ba57-db840fcd417b tempest-VolumesCloneNegativeTest-1761357426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:47:32 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-53c4e691-3e84-424c-ba57-db840fcd417b tempest-VolumesCloneNegativeTest-1761357426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:47:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-53c4e691-3e84-424c-ba57-db840fcd417b tempest-VolumesCloneNegativeTest-1761357426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:47:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-53c4e691-3e84-424c-ba57-db840fcd417b tempest-VolumesCloneNegativeTest-1761357426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:32 devstack sudo[101384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:47:32 devstack sudo[101384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:32 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-92e085bc-2446-4a75-9e0e-554f361e4a02 tempest-TestImageHashVerification-1549765354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-189f7fea-27c7-4ad5-b992-693a41ec12e7" returned: 0 in 0.425s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-92e085bc-2446-4a75-9e0e-554f361e4a02 tempest-TestImageHashVerification-1549765354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-189f7fea-27c7-4ad5-b992-693a41ec12e7 /opt/stack/data/cinder/conversion/189f7fea-27c7-4ad5-b992-693a41ec12e7.temp_image.c155a42c-a8e4-42ee-b7a8-022a1544c78euvo3kn_v.img {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:33 devstack sudo[101389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-189f7fea-27c7-4ad5-b992-693a41ec12e7 /opt/stack/data/cinder/conversion/189f7fea-27c7-4ad5-b992-693a41ec12e7.temp_image.c155a42c-a8e4-42ee-b7a8-022a1544c78euvo3kn_v.img Jul 28 10:47:33 devstack sudo[101389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:33 devstack sudo[101384]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-53c4e691-3e84-424c-ba57-db840fcd417b tempest-VolumesCloneNegativeTest-1761357426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.268s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:33 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-53c4e691-3e84-424c-ba57-db840fcd417b tempest-VolumesCloneNegativeTest-1761357426 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:47:33 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-53c4e691-3e84-424c-ba57-db840fcd417b tempest-VolumesCloneNegativeTest-1761357426 None] Deleted volume successfully. Jul 28 10:47:33 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-53c4e691-3e84-424c-ba57-db840fcd417b tempest-VolumesCloneNegativeTest-1761357426 None] Lock "cinder-51022338-0cd2-4ca1-a570-7ab659050514-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:47:37 devstack sudo[101389]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-92e085bc-2446-4a75-9e0e-554f361e4a02 tempest-TestImageHashVerification-1549765354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-189f7fea-27c7-4ad5-b992-693a41ec12e7 /opt/stack/data/cinder/conversion/189f7fea-27c7-4ad5-b992-693a41ec12e7.temp_image.c155a42c-a8e4-42ee-b7a8-022a1544c78euvo3kn_v.img" returned: 0 in 4.712s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:37 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f435d6e-ccec-43b4-a887-788f151af87c]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:47:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-92e085bc-2446-4a75-9e0e-554f361e4a02 tempest-TestImageHashVerification-1549765354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-189f7fea-27c7-4ad5-b992-693a41ec12e7 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:47:37 devstack sudo[101410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-189f7fea-27c7-4ad5-b992-693a41ec12e7 Jul 28 10:47:37 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:47:38 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root Jul 28 10:47:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-92e085bc-2446-4a75-9e0e-554f361e4a02 tempest-TestImageHashVerification-1549765354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-189f7fea-27c7-4ad5-b992-693a41ec12e7" returned: 0 in 0.605s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:47:38 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-92e085bc-2446-4a75-9e0e-554f361e4a02 tempest-TestImageHashVerification-1549765354 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-189f7fea-27c7-4ad5-b992-693a41ec12e7, size 1024.00 MB, duration 4.71 sec, destination /opt/stack/data/cinder/conversion/189f7fea-27c7-4ad5-b992-693a41ec12e7.temp_image.c155a42c-a8e4-42ee-b7a8-022a1544c78euvo3kn_v.img {{(pid=88413) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 10:47:38 devstack cinder-volume[88413]: INFO cinder.image.image_utils [None req-92e085bc-2446-4a75-9e0e-554f361e4a02 tempest-TestImageHashVerification-1549765354 None] Converted 1024.00 MB image at 217.26 MB/s Jul 28 10:47:38 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-92e085bc-2446-4a75-9e0e-554f361e4a02 tempest-TestImageHashVerification-1549765354 None] c155a42c-a8e4-42ee-b7a8-022a1544c78e was raw, no need to convert to raw {{(pid=88413) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 28 10:47:43 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-c88a12a2-5509-43d6-a8cf-61dc7d696480 tempest-VolumesNegativeTest-1640280002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:47:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c88a12a2-5509-43d6-a8cf-61dc7d696480 tempest-VolumesNegativeTest-1640280002 None] Flow 'volume_create_manager' (47e3b10f-2c8c-450d-9d76-a34578d2d6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:47:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c88a12a2-5509-43d6-a8cf-61dc7d696480 tempest-VolumesNegativeTest-1640280002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4cf41ad-8e55-4ee0-8055-fdd7cfcaca4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c88a12a2-5509-43d6-a8cf-61dc7d696480 tempest-VolumesNegativeTest-1640280002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4cf41ad-8e55-4ee0-8055-fdd7cfcaca4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2058562864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a9e45b6-e016-4324-b9d7-8183f0e0ee20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='696077d8b8104076acf451e911f95e68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:47:43Z,use_quota=True,user_id='4f509fdc1cb445548aaf00fe97d873d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:47:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c88a12a2-5509-43d6-a8cf-61dc7d696480 tempest-VolumesNegativeTest-1640280002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d889f68a-48a5-4e6e-af27-8fccf93751dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c88a12a2-5509-43d6-a8cf-61dc7d696480 tempest-VolumesNegativeTest-1640280002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d889f68a-48a5-4e6e-af27-8fccf93751dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:47:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c88a12a2-5509-43d6-a8cf-61dc7d696480 tempest-VolumesNegativeTest-1640280002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cceebdab-80f4-40f1-950e-ed82b312b885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c88a12a2-5509-43d6-a8cf-61dc7d696480 tempest-VolumesNegativeTest-1640280002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cceebdab-80f4-40f1-950e-ed82b312b885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a9e45b6-e016-4324-b9d7-8183f0e0ee20', 'volume_name': 'volume-9a9e45b6-e016-4324-b9d7-8183f0e0ee20', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:47:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c88a12a2-5509-43d6-a8cf-61dc7d696480 tempest-VolumesNegativeTest-1640280002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26d9d530-7e38-46ac-b1fe-c01fd9308949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c88a12a2-5509-43d6-a8cf-61dc7d696480 tempest-VolumesNegativeTest-1640280002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26d9d530-7e38-46ac-b1fe-c01fd9308949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:47:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c88a12a2-5509-43d6-a8cf-61dc7d696480 tempest-VolumesNegativeTest-1640280002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f27a9ca6-bf9d-40c0-b88a-0d3ab84578e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:47:43 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-c88a12a2-5509-43d6-a8cf-61dc7d696480 tempest-VolumesNegativeTest-1640280002 None] Volume 9a9e45b6-e016-4324-b9d7-8183f0e0ee20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a9e45b6-e016-4324-b9d7-8183f0e0ee20', 'volume_size': 1} Jul 28 10:47:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c88a12a2-5509-43d6-a8cf-61dc7d696480 tempest-VolumesNegativeTest-1640280002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:47:53 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:UPDATE=79,cinder:SELECT=65,cinder:INSERT=20,cinder:DELETE=10 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:47:53 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:UPDATE=78,cinder:SELECT=59,cinder:INSERT=19,cinder:DELETE=4 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:48:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-92e085bc-2446-4a75-9e0e-554f361e4a02 tempest-TestImageHashVerification-1549765354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.442s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:48:00 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-92e085bc-2446-4a75-9e0e-554f361e4a02 tempest-TestImageHashVerification-1549765354 None] Uploaded volume to glance image-id: c155a42c-a8e4-42ee-b7a8-022a1544c78e. {{(pid=88413) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 28 10:48:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c88a12a2-5509-43d6-a8cf-61dc7d696480 tempest-VolumesNegativeTest-1640280002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.055s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:48:00 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c88a12a2-5509-43d6-a8cf-61dc7d696480 tempest-VolumesNegativeTest-1640280002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2058562864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a9e45b6-e016-4324-b9d7-8183f0e0ee20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='696077d8b8104076acf451e911f95e68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:47:43Z,use_quota=True,user_id='4f509fdc1cb445548aaf00fe97d873d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:48:00 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-c88a12a2-5509-43d6-a8cf-61dc7d696480 tempest-VolumesNegativeTest-1640280002 None] Creating volume 9a9e45b6-e016-4324-b9d7-8183f0e0ee20 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:48:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c88a12a2-5509-43d6-a8cf-61dc7d696480 tempest-VolumesNegativeTest-1640280002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:48:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c88a12a2-5509-43d6-a8cf-61dc7d696480 tempest-VolumesNegativeTest-1640280002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:48:00 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c88a12a2-5509-43d6-a8cf-61dc7d696480 tempest-VolumesNegativeTest-1640280002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:48:00 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c88a12a2-5509-43d6-a8cf-61dc7d696480 tempest-VolumesNegativeTest-1640280002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:48:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c88a12a2-5509-43d6-a8cf-61dc7d696480 tempest-VolumesNegativeTest-1640280002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:48:00 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c88a12a2-5509-43d6-a8cf-61dc7d696480 tempest-VolumesNegativeTest-1640280002 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:48:00 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-c88a12a2-5509-43d6-a8cf-61dc7d696480 tempest-VolumesNegativeTest-1640280002 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:48:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c88a12a2-5509-43d6-a8cf-61dc7d696480 tempest-VolumesNegativeTest-1640280002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a9e45b6-e016-4324-b9d7-8183f0e0ee20 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:00 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-92e085bc-2446-4a75-9e0e-554f361e4a02 tempest-TestImageHashVerification-1549765354 None] Copy volume to image completed successfully. Jul 28 10:48:00 devstack sudo[101439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a9e45b6-e016-4324-b9d7-8183f0e0ee20 1073741824 Jul 28 10:48:00 devstack sudo[101439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:01 devstack sudo[101439]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c88a12a2-5509-43d6-a8cf-61dc7d696480 tempest-VolumesNegativeTest-1640280002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a9e45b6-e016-4324-b9d7-8183f0e0ee20 1073741824" returned: 0 in 0.644s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c88a12a2-5509-43d6-a8cf-61dc7d696480 tempest-VolumesNegativeTest-1640280002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a9e45b6-e016-4324-b9d7-8183f0e0ee20 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:01 devstack sudo[101460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a9e45b6-e016-4324-b9d7-8183f0e0ee20 Jul 28 10:48:01 devstack sudo[101460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:01 devstack sudo[101460]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c88a12a2-5509-43d6-a8cf-61dc7d696480 tempest-VolumesNegativeTest-1640280002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a9e45b6-e016-4324-b9d7-8183f0e0ee20" returned: 0 in 0.294s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:01 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c88a12a2-5509-43d6-a8cf-61dc7d696480 tempest-VolumesNegativeTest-1640280002 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:48:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c88a12a2-5509-43d6-a8cf-61dc7d696480 tempest-VolumesNegativeTest-1640280002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:48:01 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c88a12a2-5509-43d6-a8cf-61dc7d696480 tempest-VolumesNegativeTest-1640280002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f27a9ca6-bf9d-40c0-b88a-0d3ab84578e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a9e45b6-e016-4324-b9d7-8183f0e0ee20', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:01 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c88a12a2-5509-43d6-a8cf-61dc7d696480 tempest-VolumesNegativeTest-1640280002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48783234-dff2-4153-b7fa-5448838575d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:01 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-c88a12a2-5509-43d6-a8cf-61dc7d696480 tempest-VolumesNegativeTest-1640280002 None] Volume volume-9a9e45b6-e016-4324-b9d7-8183f0e0ee20 (9a9e45b6-e016-4324-b9d7-8183f0e0ee20): created successfully Jul 28 10:48:01 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c88a12a2-5509-43d6-a8cf-61dc7d696480 tempest-VolumesNegativeTest-1640280002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48783234-dff2-4153-b7fa-5448838575d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:01 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c88a12a2-5509-43d6-a8cf-61dc7d696480 tempest-VolumesNegativeTest-1640280002 None] Flow 'volume_create_manager' (47e3b10f-2c8c-450d-9d76-a34578d2d6a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:48:01 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-c88a12a2-5509-43d6-a8cf-61dc7d696480 tempest-VolumesNegativeTest-1640280002 None] Created volume successfully. Jul 28 10:48:01 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-97d4162c-dfa8-4e7e-a235-afe15956d491 tempest-TestImageHashVerification-1549765354 None] Acquiring lock "cinder-189f7fea-27c7-4ad5-b992-693a41ec12e7-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:48:01 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-97d4162c-dfa8-4e7e-a235-afe15956d491 tempest-TestImageHashVerification-1549765354 None] Lock "cinder-189f7fea-27c7-4ad5-b992-693a41ec12e7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:48:01 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-97d4162c-dfa8-4e7e-a235-afe15956d491 tempest-TestImageHashVerification-1549765354 None] Acquiring lock "cinder-quobyte-189f7fea-27c7-4ad5-b992-693a41ec12e7" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:48:01 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-97d4162c-dfa8-4e7e-a235-afe15956d491 tempest-TestImageHashVerification-1549765354 None] Lock "cinder-quobyte-189f7fea-27c7-4ad5-b992-693a41ec12e7" acquired by "delete_volume" :: waited 0.020s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:48:01 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ca047a-d569-4dd4-b8de-de7628fae26d]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:48:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-97d4162c-dfa8-4e7e-a235-afe15956d491 tempest-TestImageHashVerification-1549765354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-189f7fea-27c7-4ad5-b992-693a41ec12e7 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:01 devstack sudo[101470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-189f7fea-27c7-4ad5-b992-693a41ec12e7 Jul 28 10:48:01 devstack sudo[101470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:02 devstack sudo[101470]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-97d4162c-dfa8-4e7e-a235-afe15956d491 tempest-TestImageHashVerification-1549765354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-189f7fea-27c7-4ad5-b992-693a41ec12e7" returned: 0 in 0.546s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-97d4162c-dfa8-4e7e-a235-afe15956d491 tempest-TestImageHashVerification-1549765354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-189f7fea-27c7-4ad5-b992-693a41ec12e7 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:02 devstack sudo[101489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-189f7fea-27c7-4ad5-b992-693a41ec12e7 Jul 28 10:48:02 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:02 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-97d4162c-dfa8-4e7e-a235-afe15956d491 tempest-TestImageHashVerification-1549765354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-189f7fea-27c7-4ad5-b992-693a41ec12e7" returned: 0 in 0.482s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:02 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-97d4162c-dfa8-4e7e-a235-afe15956d491 tempest-TestImageHashVerification-1549765354 None] Lock "cinder-quobyte-189f7fea-27c7-4ad5-b992-693a41ec12e7" released by "delete_volume" :: held 1.090s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:48:03 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-97d4162c-dfa8-4e7e-a235-afe15956d491 tempest-TestImageHashVerification-1549765354 None] Created reservations ['72a6f357-a8ae-4bcc-a254-e563fdcc932e', '7316ca12-1e47-4978-a83d-a4f55b6dc98d', 'c5807f59-020c-4dc7-adf9-d983d33c08d9', '01c82d03-0b2b-45cf-94c5-7b4d20e0ce6a'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:48:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-97d4162c-dfa8-4e7e-a235-afe15956d491 tempest-TestImageHashVerification-1549765354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:48:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-97d4162c-dfa8-4e7e-a235-afe15956d491 tempest-TestImageHashVerification-1549765354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:48:03 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-97d4162c-dfa8-4e7e-a235-afe15956d491 tempest-TestImageHashVerification-1549765354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:48:03 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-97d4162c-dfa8-4e7e-a235-afe15956d491 tempest-TestImageHashVerification-1549765354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:48:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-97d4162c-dfa8-4e7e-a235-afe15956d491 tempest-TestImageHashVerification-1549765354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:48:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-97d4162c-dfa8-4e7e-a235-afe15956d491 tempest-TestImageHashVerification-1549765354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:03 devstack sudo[101535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:48:03 devstack sudo[101535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:03 devstack sudo[101535]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-97d4162c-dfa8-4e7e-a235-afe15956d491 tempest-TestImageHashVerification-1549765354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.317s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:03 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-97d4162c-dfa8-4e7e-a235-afe15956d491 tempest-TestImageHashVerification-1549765354 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:48:03 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-97d4162c-dfa8-4e7e-a235-afe15956d491 tempest-TestImageHashVerification-1549765354 None] Deleted volume successfully. Jul 28 10:48:03 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-97d4162c-dfa8-4e7e-a235-afe15956d491 tempest-TestImageHashVerification-1549765354 None] Lock "cinder-189f7fea-27c7-4ad5-b992-693a41ec12e7-delete_volume" released by "delete_volume" :: held 1.898s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:48:12 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aa22853-27f4-4432-9528-bda15f19b356 tempest-TestMinimumBasicScenario-1637923331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:48:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0aa22853-27f4-4432-9528-bda15f19b356 tempest-TestMinimumBasicScenario-1637923331 None] Flow 'volume_create_manager' (c126e168-b9f4-407c-a3f8-3d27f811dbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:48:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0aa22853-27f4-4432-9528-bda15f19b356 tempest-TestMinimumBasicScenario-1637923331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d08db3-332a-465a-93db-2714368627f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0aa22853-27f4-4432-9528-bda15f19b356 tempest-TestMinimumBasicScenario-1637923331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d08db3-332a-465a-93db-2714368627f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-851835851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0246bbd-7659-4c95-b3a6-1e76292d2bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5858200e6dcf4e49ba07ce0db26db847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:48:13Z,use_quota=True,user_id='99b65612235b4811b5e5e9af1dbf899a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0aa22853-27f4-4432-9528-bda15f19b356 tempest-TestMinimumBasicScenario-1637923331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b5f81c3-8cc1-4c1e-9a76-4d35d99c5e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0aa22853-27f4-4432-9528-bda15f19b356 tempest-TestMinimumBasicScenario-1637923331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b5f81c3-8cc1-4c1e-9a76-4d35d99c5e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0aa22853-27f4-4432-9528-bda15f19b356 tempest-TestMinimumBasicScenario-1637923331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14f497ae-7116-4221-a5ee-1c82733eb861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0aa22853-27f4-4432-9528-bda15f19b356 tempest-TestMinimumBasicScenario-1637923331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14f497ae-7116-4221-a5ee-1c82733eb861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0246bbd-7659-4c95-b3a6-1e76292d2bb8', 'volume_name': 'volume-c0246bbd-7659-4c95-b3a6-1e76292d2bb8', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0aa22853-27f4-4432-9528-bda15f19b356 tempest-TestMinimumBasicScenario-1637923331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86e6c7eb-2b1a-4acf-a339-a6560b190f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0aa22853-27f4-4432-9528-bda15f19b356 tempest-TestMinimumBasicScenario-1637923331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86e6c7eb-2b1a-4acf-a339-a6560b190f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0aa22853-27f4-4432-9528-bda15f19b356 tempest-TestMinimumBasicScenario-1637923331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db2ca4fe-38da-4477-9ba2-8047303af67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:13 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-0aa22853-27f4-4432-9528-bda15f19b356 tempest-TestMinimumBasicScenario-1637923331 None] Volume c0246bbd-7659-4c95-b3a6-1e76292d2bb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0246bbd-7659-4c95-b3a6-1e76292d2bb8', 'volume_size': 1} Jul 28 10:48:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0aa22853-27f4-4432-9528-bda15f19b356 tempest-TestMinimumBasicScenario-1637923331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:48:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0aa22853-27f4-4432-9528-bda15f19b356 tempest-TestMinimumBasicScenario-1637923331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:48:13 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0aa22853-27f4-4432-9528-bda15f19b356 tempest-TestMinimumBasicScenario-1637923331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-851835851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0246bbd-7659-4c95-b3a6-1e76292d2bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5858200e6dcf4e49ba07ce0db26db847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:48:13Z,use_quota=True,user_id='99b65612235b4811b5e5e9af1dbf899a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:48:13 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-0aa22853-27f4-4432-9528-bda15f19b356 tempest-TestMinimumBasicScenario-1637923331 None] Creating volume c0246bbd-7659-4c95-b3a6-1e76292d2bb8 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:48:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0aa22853-27f4-4432-9528-bda15f19b356 tempest-TestMinimumBasicScenario-1637923331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:48:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0aa22853-27f4-4432-9528-bda15f19b356 tempest-TestMinimumBasicScenario-1637923331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:48:13 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0aa22853-27f4-4432-9528-bda15f19b356 tempest-TestMinimumBasicScenario-1637923331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:48:13 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0aa22853-27f4-4432-9528-bda15f19b356 tempest-TestMinimumBasicScenario-1637923331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:48:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0aa22853-27f4-4432-9528-bda15f19b356 tempest-TestMinimumBasicScenario-1637923331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:48:13 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0aa22853-27f4-4432-9528-bda15f19b356 tempest-TestMinimumBasicScenario-1637923331 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:48:13 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-0aa22853-27f4-4432-9528-bda15f19b356 tempest-TestMinimumBasicScenario-1637923331 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:48:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0aa22853-27f4-4432-9528-bda15f19b356 tempest-TestMinimumBasicScenario-1637923331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c0246bbd-7659-4c95-b3a6-1e76292d2bb8 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:13 devstack sudo[101674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c0246bbd-7659-4c95-b3a6-1e76292d2bb8 1073741824 Jul 28 10:48:13 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:13 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0aa22853-27f4-4432-9528-bda15f19b356 tempest-TestMinimumBasicScenario-1637923331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c0246bbd-7659-4c95-b3a6-1e76292d2bb8 1073741824" returned: 0 in 0.927s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0aa22853-27f4-4432-9528-bda15f19b356 tempest-TestMinimumBasicScenario-1637923331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c0246bbd-7659-4c95-b3a6-1e76292d2bb8 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:14 devstack sudo[101680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c0246bbd-7659-4c95-b3a6-1e76292d2bb8 Jul 28 10:48:14 devstack sudo[101680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:14 devstack sudo[101680]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0aa22853-27f4-4432-9528-bda15f19b356 tempest-TestMinimumBasicScenario-1637923331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c0246bbd-7659-4c95-b3a6-1e76292d2bb8" returned: 0 in 0.387s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:14 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0aa22853-27f4-4432-9528-bda15f19b356 tempest-TestMinimumBasicScenario-1637923331 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:48:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0aa22853-27f4-4432-9528-bda15f19b356 tempest-TestMinimumBasicScenario-1637923331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:48:14 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0aa22853-27f4-4432-9528-bda15f19b356 tempest-TestMinimumBasicScenario-1637923331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db2ca4fe-38da-4477-9ba2-8047303af67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0246bbd-7659-4c95-b3a6-1e76292d2bb8', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:14 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0aa22853-27f4-4432-9528-bda15f19b356 tempest-TestMinimumBasicScenario-1637923331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1e4a4e7-0a69-4016-aa12-5c27bc854dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:14 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-0aa22853-27f4-4432-9528-bda15f19b356 tempest-TestMinimumBasicScenario-1637923331 None] Volume volume-c0246bbd-7659-4c95-b3a6-1e76292d2bb8 (c0246bbd-7659-4c95-b3a6-1e76292d2bb8): created successfully Jul 28 10:48:14 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0aa22853-27f4-4432-9528-bda15f19b356 tempest-TestMinimumBasicScenario-1637923331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1e4a4e7-0a69-4016-aa12-5c27bc854dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:14 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0aa22853-27f4-4432-9528-bda15f19b356 tempest-TestMinimumBasicScenario-1637923331 None] Flow 'volume_create_manager' (c126e168-b9f4-407c-a3f8-3d27f811dbf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:48:14 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-0aa22853-27f4-4432-9528-bda15f19b356 tempest-TestMinimumBasicScenario-1637923331 None] Created volume successfully. Jul 28 10:48:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-f2eb1a70-441e-455c-b72d-44ff99418a76 req-84241902-9e45-4499-811a-7d0b7fe56aef tempest-TestMinimumBasicScenario-1637923331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:48:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-f2eb1a70-441e-455c-b72d-44ff99418a76 req-84241902-9e45-4499-811a-7d0b7fe56aef tempest-TestMinimumBasicScenario-1637923331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:48:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-f2eb1a70-441e-455c-b72d-44ff99418a76 req-84241902-9e45-4499-811a-7d0b7fe56aef tempest-TestMinimumBasicScenario-1637923331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:48:16 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-f2eb1a70-441e-455c-b72d-44ff99418a76 req-84241902-9e45-4499-811a-7d0b7fe56aef tempest-TestMinimumBasicScenario-1637923331 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7', 'name': 'volume-c0246bbd-7659-4c95-b3a6-1e76292d2bb8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0aa633f1-e8ef-4603-9c13-04de66112280', 'enforce_multipath': True} {{(pid=88413) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 10:48:16 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-f2eb1a70-441e-455c-b72d-44ff99418a76 req-84241902-9e45-4499-811a-7d0b7fe56aef tempest-TestMinimumBasicScenario-1637923331 None] attachment_update completed successfully. Jul 28 10:48:25 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f61d3c14-2e77-4910-a189-58115f5c59f0 tempest-VolumesNegativeTest-1640280002 None] Acquiring lock "cinder-9a9e45b6-e016-4324-b9d7-8183f0e0ee20-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:48:25 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f61d3c14-2e77-4910-a189-58115f5c59f0 tempest-VolumesNegativeTest-1640280002 None] Lock "cinder-9a9e45b6-e016-4324-b9d7-8183f0e0ee20-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:48:25 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f61d3c14-2e77-4910-a189-58115f5c59f0 tempest-VolumesNegativeTest-1640280002 None] Acquiring lock "cinder-quobyte-9a9e45b6-e016-4324-b9d7-8183f0e0ee20" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:48:25 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f61d3c14-2e77-4910-a189-58115f5c59f0 tempest-VolumesNegativeTest-1640280002 None] Lock "cinder-quobyte-9a9e45b6-e016-4324-b9d7-8183f0e0ee20" acquired by "delete_volume" :: waited 0.015s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:48:25 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d28bf8-13ec-4b77-aa86-5bebe1290839]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:48:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f61d3c14-2e77-4910-a189-58115f5c59f0 tempest-VolumesNegativeTest-1640280002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a9e45b6-e016-4324-b9d7-8183f0e0ee20 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:25 devstack sudo[102191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a9e45b6-e016-4324-b9d7-8183f0e0ee20 Jul 28 10:48:25 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:25 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:48:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Flow 'volume_create_manager' (a6d5a4f0-0c7c-4569-924b-3bb97d4d6efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:48:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5671d519-98be-49e4-82f5-a7af3a197bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5671d519-98be-49e4-82f5-a7af3a197bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b0f3a5a-f024-4abf-b611-3ed190e21143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a33a22f314d45b3b049543da810fc8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:48:25Z,use_quota=True,user_id='d0c59c7d04d642688fc43fd38645b36f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9118a6bc-2923-4869-a276-71eec8e953a2),volume_type_id=9118a6bc-2923-4869-a276-71eec8e953a2)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73809fee-9e4a-4b8b-a771-abda23ee73dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73809fee-9e4a-4b8b-a771-abda23ee73dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39105aec-2cf4-45ba-8009-93ad54f869f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:25 devstack cinder-volume[88413]: DEBUG cinder.image.glance [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Creating Keystone auth plugin from conf {{(pid=88413) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 28 10:48:25 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f61d3c14-2e77-4910-a189-58115f5c59f0 tempest-VolumesNegativeTest-1640280002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a9e45b6-e016-4324-b9d7-8183f0e0ee20" returned: 0 in 0.564s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f61d3c14-2e77-4910-a189-58115f5c59f0 tempest-VolumesNegativeTest-1640280002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a9e45b6-e016-4324-b9d7-8183f0e0ee20 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:25 devstack sudo[102197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a9e45b6-e016-4324-b9d7-8183f0e0ee20 Jul 28 10:48:25 devstack sudo[102197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39105aec-2cf4-45ba-8009-93ad54f869f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5b0f3a5a-f024-4abf-b611-3ed190e21143', 'volume_name': 'volume-5b0f3a5a-f024-4abf-b611-3ed190e21143', 'volume_size': 1, 'image_id': 'c7b85cca-ca1f-46df-87d8-3768bebf70fe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c7b85cca-ca1f-46df-87d8-3768bebf70fe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '27bf1c387edd0f64407e22018cff404a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0a33a22f314d45b3b049543da810fc8e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '64f3322c147807034cc07d007fd7031de7f506e1b766c7bb50da46a6904c9887c76066e1de438c88ea3a28e853784ffd875356ba6473a779d88a3900a3010b2d', 'id': 'c7b85cca-ca1f-46df-87d8-3768bebf70fe', 'created_at': datetime.datetime(2026, 7, 28, 8, 48, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 8, 48, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c7b85cca-ca1f-46df-87d8-3768bebf70fe/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42a3dae2-623c-4682-84c7-d419f7396435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42a3dae2-623c-4682-84c7-d419f7396435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2114dc64-d1a2-4575-90ac-dc6b0b1ad55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:25 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Volume 5b0f3a5a-f024-4abf-b611-3ed190e21143: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5b0f3a5a-f024-4abf-b611-3ed190e21143', 'volume_size': 1, 'image_id': 'c7b85cca-ca1f-46df-87d8-3768bebf70fe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c7b85cca-ca1f-46df-87d8-3768bebf70fe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '27bf1c387edd0f64407e22018cff404a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0a33a22f314d45b3b049543da810fc8e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '64f3322c147807034cc07d007fd7031de7f506e1b766c7bb50da46a6904c9887c76066e1de438c88ea3a28e853784ffd875356ba6473a779d88a3900a3010b2d', 'id': 'c7b85cca-ca1f-46df-87d8-3768bebf70fe', 'created_at': datetime.datetime(2026, 7, 28, 8, 48, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 8, 48, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c7b85cca-ca1f-46df-87d8-3768bebf70fe/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 28 10:48:25 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Trying to clone 5b0f3a5a-f024-4abf-b611-3ed190e21143 from image c7b85cca-ca1f-46df-87d8-3768bebf70fe at location (None, [{'url': 'file:///opt/stack/data/glance/images/c7b85cca-ca1f-46df-87d8-3768bebf70fe', 'metadata': {}}]). {{(pid=88413) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 28 10:48:26 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c7b85cca-ca1f-46df-87d8-3768bebf70fe_twhjkpt9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88413) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 28 10:48:26 devstack cinder-volume[88413]: INFO cinder.image.image_utils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Image download 0.00 MB at 0.00 MB/s Jul 28 10:48:26 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[6966d146-e4b5-4fa4-9181-43bd73f0e3b7]: (4, 'raw') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:48:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c7b85cca-ca1f-46df-87d8-3768bebf70fe_twhjkpt9devstack@QuobyteHD {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:26 devstack sudo[102197]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f61d3c14-2e77-4910-a189-58115f5c59f0 tempest-VolumesNegativeTest-1640280002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9a9e45b6-e016-4324-b9d7-8183f0e0ee20" returned: 0 in 0.440s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:26 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f61d3c14-2e77-4910-a189-58115f5c59f0 tempest-VolumesNegativeTest-1640280002 None] Lock "cinder-quobyte-9a9e45b6-e016-4324-b9d7-8183f0e0ee20" released by "delete_volume" :: held 1.080s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:48:26 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-f61d3c14-2e77-4910-a189-58115f5c59f0 tempest-VolumesNegativeTest-1640280002 None] Created reservations ['20225573-e23f-48c1-b0a5-d105a8b33798', 'dbff4a01-49f3-4e88-9b29-f7d2a14be81d', 'bb81834e-c495-4c81-9395-d6ed1ca2dc19', '48cd7d46-b840-4522-9de2-2fe68b636c4a'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:48:26 devstack sudo[102200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c7b85cca-ca1f-46df-87d8-3768bebf70fe_twhjkpt9devstack@QuobyteHD Jul 28 10:48:26 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f61d3c14-2e77-4910-a189-58115f5c59f0 tempest-VolumesNegativeTest-1640280002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:48:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f61d3c14-2e77-4910-a189-58115f5c59f0 tempest-VolumesNegativeTest-1640280002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:48:26 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f61d3c14-2e77-4910-a189-58115f5c59f0 tempest-VolumesNegativeTest-1640280002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:48:26 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f61d3c14-2e77-4910-a189-58115f5c59f0 tempest-VolumesNegativeTest-1640280002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:48:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f61d3c14-2e77-4910-a189-58115f5c59f0 tempest-VolumesNegativeTest-1640280002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:48:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f61d3c14-2e77-4910-a189-58115f5c59f0 tempest-VolumesNegativeTest-1640280002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:26 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:48:26 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:26 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c7b85cca-ca1f-46df-87d8-3768bebf70fe_twhjkpt9devstack@QuobyteHD" returned: 0 in 0.445s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7b85cca-ca1f-46df-87d8-3768bebf70fe_twhjkpt9devstack@QuobyteHD {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:26 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f61d3c14-2e77-4910-a189-58115f5c59f0 tempest-VolumesNegativeTest-1640280002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.297s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:26 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-f61d3c14-2e77-4910-a189-58115f5c59f0 tempest-VolumesNegativeTest-1640280002 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:48:26 devstack sudo[102206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7b85cca-ca1f-46df-87d8-3768bebf70fe_twhjkpt9devstack@QuobyteHD Jul 28 10:48:26 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:26 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-f61d3c14-2e77-4910-a189-58115f5c59f0 tempest-VolumesNegativeTest-1640280002 None] Deleted volume successfully. Jul 28 10:48:26 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f61d3c14-2e77-4910-a189-58115f5c59f0 tempest-VolumesNegativeTest-1640280002 None] Lock "cinder-9a9e45b6-e016-4324-b9d7-8183f0e0ee20-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:48:26 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7b85cca-ca1f-46df-87d8-3768bebf70fe_twhjkpt9devstack@QuobyteHD" returned: 1 in 0.352s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7b85cca-ca1f-46df-87d8-3768bebf70fe_twhjkpt9devstack@QuobyteHD' failed. Not Retrying. {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 10:48:26 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Temporary image c7b85cca-ca1f-46df-87d8-3768bebf70fe is fetched for user d0c59c7d04d642688fc43fd38645b36f. {{(pid=88413) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 28 10:48:27 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71b32ed-d720-4fd1-86d5-9e935a12f2b8]: (4, 'raw') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:48:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c7b85cca-ca1f-46df-87d8-3768bebf70fe_twhjkpt9devstack@QuobyteHD {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:27 devstack sudo[102212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c7b85cca-ca1f-46df-87d8-3768bebf70fe_twhjkpt9devstack@QuobyteHD Jul 28 10:48:27 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:27 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c7b85cca-ca1f-46df-87d8-3768bebf70fe_twhjkpt9devstack@QuobyteHD" returned: 0 in 0.360s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7b85cca-ca1f-46df-87d8-3768bebf70fe_twhjkpt9devstack@QuobyteHD {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:27 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7b85cca-ca1f-46df-87d8-3768bebf70fe_twhjkpt9devstack@QuobyteHD Jul 28 10:48:27 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:27 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7b85cca-ca1f-46df-87d8-3768bebf70fe_twhjkpt9devstack@QuobyteHD" returned: 1 in 0.346s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7b85cca-ca1f-46df-87d8-3768bebf70fe_twhjkpt9devstack@QuobyteHD' failed. Not Retrying. {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 10:48:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:48:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:48:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b0f3a5a-f024-4abf-b611-3ed190e21143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a33a22f314d45b3b049543da810fc8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:48:25Z,use_quota=True,user_id='d0c59c7d04d642688fc43fd38645b36f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9118a6bc-2923-4869-a276-71eec8e953a2),volume_type_id=9118a6bc-2923-4869-a276-71eec8e953a2)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:48:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Creating volume 5b0f3a5a-f024-4abf-b611-3ed190e21143 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:48:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:48:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:48:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:48:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:48:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:48:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:48:27 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:48:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5b0f3a5a-f024-4abf-b611-3ed190e21143 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:27 devstack sudo[102221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5b0f3a5a-f024-4abf-b611-3ed190e21143 1073741824 Jul 28 10:48:27 devstack sudo[102221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:28 devstack sudo[102221]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5b0f3a5a-f024-4abf-b611-3ed190e21143 1073741824" returned: 0 in 0.500s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5b0f3a5a-f024-4abf-b611-3ed190e21143 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:28 devstack sudo[102227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5b0f3a5a-f024-4abf-b611-3ed190e21143 Jul 28 10:48:28 devstack sudo[102227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:28 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:48:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:48:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:48:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:48:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:48:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:48:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:28 devstack sudo[102229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:48:28 devstack sudo[102229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:28 devstack sudo[102227]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5b0f3a5a-f024-4abf-b611-3ed190e21143" returned: 0 in 0.273s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:48:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:48:28 devstack cinder-volume[88413]: DEBUG cinder.volume.volume_utils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Attempting download of c7b85cca-ca1f-46df-87d8-3768bebf70fe ((None, [{'url': 'file:///opt/stack/data/glance/images/c7b85cca-ca1f-46df-87d8-3768bebf70fe', 'metadata': {}}])) to volume 5b0f3a5a-f024-4abf-b611-3ed190e21143. {{(pid=88413) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 28 10:48:28 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e9042a-8db7-404f-a072-c5816f142283]: (4, 'raw') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:48:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c7b85cca-ca1f-46df-87d8-3768bebf70fe_zdmessml {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:28 devstack sudo[102229]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.261s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:28 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:48:28 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager._thread_info {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:48:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread count: 29 {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 10:48:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread info: [<_MainThread(MainThread, started 137939890385024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 10:48:28 devstack sudo[102233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c7b85cca-ca1f-46df-87d8-3768bebf70fe_zdmessml Jul 28 10:48:28 devstack sudo[102233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:29 devstack sudo[102233]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c7b85cca-ca1f-46df-87d8-3768bebf70fe_zdmessml" returned: 0 in 0.393s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c7b85cca-ca1f-46df-87d8-3768bebf70fe_zdmessml {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:29 devstack sudo[102239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c7b85cca-ca1f-46df-87d8-3768bebf70fe_zdmessml Jul 28 10:48:29 devstack sudo[102239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:29 devstack sudo[102239]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c7b85cca-ca1f-46df-87d8-3768bebf70fe_zdmessml" returned: 1 in 0.413s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c7b85cca-ca1f-46df-87d8-3768bebf70fe_zdmessml' failed. Not Retrying. {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 10:48:29 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a73c79-1a1c-4324-a1f4-905072390204]: (4, 'raw') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:48:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c7b85cca-ca1f-46df-87d8-3768bebf70fe_twhjkpt9devstack@QuobyteHD {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:29 devstack sudo[102243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c7b85cca-ca1f-46df-87d8-3768bebf70fe_twhjkpt9devstack@QuobyteHD Jul 28 10:48:29 devstack sudo[102243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:29 devstack sudo[102243]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c7b85cca-ca1f-46df-87d8-3768bebf70fe_twhjkpt9devstack@QuobyteHD" returned: 0 in 0.395s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7b85cca-ca1f-46df-87d8-3768bebf70fe_twhjkpt9devstack@QuobyteHD {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:29 devstack sudo[102248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7b85cca-ca1f-46df-87d8-3768bebf70fe_twhjkpt9devstack@QuobyteHD Jul 28 10:48:29 devstack sudo[102248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:30 devstack sudo[102248]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7b85cca-ca1f-46df-87d8-3768bebf70fe_twhjkpt9devstack@QuobyteHD" returned: 1 in 0.360s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7b85cca-ca1f-46df-87d8-3768bebf70fe_twhjkpt9devstack@QuobyteHD' failed. Not Retrying. {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 10:48:30 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] c7b85cca-ca1f-46df-87d8-3768bebf70fe was raw, converting to qcow2 {{(pid=88413) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 28 10:48:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c7b85cca-ca1f-46df-87d8-3768bebf70fe_twhjkpt9devstack@QuobyteHD /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5b0f3a5a-f024-4abf-b611-3ed190e21143 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:30 devstack sudo[102253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c7b85cca-ca1f-46df-87d8-3768bebf70fe_twhjkpt9devstack@QuobyteHD /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5b0f3a5a-f024-4abf-b611-3ed190e21143 Jul 28 10:48:30 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:30 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-a349658f-9ef1-4160-8ecc-3f7be1175a29 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:48:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a349658f-9ef1-4160-8ecc-3f7be1175a29 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Flow 'volume_create_manager' (835b2164-9e64-452b-99c9-963a5f63996c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:48:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a349658f-9ef1-4160-8ecc-3f7be1175a29 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c37cc7-f6a7-4ac9-831b-54b84646b3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a349658f-9ef1-4160-8ecc-3f7be1175a29 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c37cc7-f6a7-4ac9-831b-54b84646b3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1530019203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dd37b32-9549-4457-80ad-4545977f3ca9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82b82a4d68be425995e097bc49d21f96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:48:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:48:30Z,use_quota=True,user_id='2d4b986f4c2346fa809785e5f35ea6a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a349658f-9ef1-4160-8ecc-3f7be1175a29 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d81086d-3c5e-4823-b120-4f5bd2c617e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a349658f-9ef1-4160-8ecc-3f7be1175a29 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d81086d-3c5e-4823-b120-4f5bd2c617e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a349658f-9ef1-4160-8ecc-3f7be1175a29 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (351b7ec1-f6fc-4fb3-9fb9-5f7f318765b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a349658f-9ef1-4160-8ecc-3f7be1175a29 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (351b7ec1-f6fc-4fb3-9fb9-5f7f318765b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dd37b32-9549-4457-80ad-4545977f3ca9', 'volume_name': 'volume-4dd37b32-9549-4457-80ad-4545977f3ca9', 'volume_size': 2}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a349658f-9ef1-4160-8ecc-3f7be1175a29 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b1b45e6-a555-4ac3-81d1-93b4f9460994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a349658f-9ef1-4160-8ecc-3f7be1175a29 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b1b45e6-a555-4ac3-81d1-93b4f9460994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a349658f-9ef1-4160-8ecc-3f7be1175a29 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6434d44a-455f-47f7-857e-ce7b88f58a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:30 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-a349658f-9ef1-4160-8ecc-3f7be1175a29 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Volume 4dd37b32-9549-4457-80ad-4545977f3ca9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dd37b32-9549-4457-80ad-4545977f3ca9', 'volume_size': 2} Jul 28 10:48:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a349658f-9ef1-4160-8ecc-3f7be1175a29 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:48:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a349658f-9ef1-4160-8ecc-3f7be1175a29 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:48:30 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-a349658f-9ef1-4160-8ecc-3f7be1175a29 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1530019203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dd37b32-9549-4457-80ad-4545977f3ca9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82b82a4d68be425995e097bc49d21f96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:48:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:48:30Z,use_quota=True,user_id='2d4b986f4c2346fa809785e5f35ea6a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:48:30 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-a349658f-9ef1-4160-8ecc-3f7be1175a29 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Creating volume 4dd37b32-9549-4457-80ad-4545977f3ca9 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:48:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a349658f-9ef1-4160-8ecc-3f7be1175a29 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:48:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a349658f-9ef1-4160-8ecc-3f7be1175a29 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:48:30 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-a349658f-9ef1-4160-8ecc-3f7be1175a29 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:48:30 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-a349658f-9ef1-4160-8ecc-3f7be1175a29 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:48:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a349658f-9ef1-4160-8ecc-3f7be1175a29 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:48:30 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-a349658f-9ef1-4160-8ecc-3f7be1175a29 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:48:30 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-a349658f-9ef1-4160-8ecc-3f7be1175a29 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:48:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a349658f-9ef1-4160-8ecc-3f7be1175a29 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9 2147483648 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:30 devstack sudo[102255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9 2147483648 Jul 28 10:48:30 devstack sudo[102255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:30 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c7b85cca-ca1f-46df-87d8-3768bebf70fe_twhjkpt9devstack@QuobyteHD /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5b0f3a5a-f024-4abf-b611-3ed190e21143" returned: 0 in 0.495s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:30 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c7b85cca-ca1f-46df-87d8-3768bebf70fe_twhjkpt9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5b0f3a5a-f024-4abf-b611-3ed190e21143 {{(pid=88413) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 10:48:30 devstack cinder-volume[88413]: INFO cinder.image.image_utils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Converted 0.00 MB image at 0.00 MB/s Jul 28 10:48:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5b0f3a5a-f024-4abf-b611-3ed190e21143 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:30 devstack sudo[102265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5b0f3a5a-f024-4abf-b611-3ed190e21143 1G Jul 28 10:48:30 devstack sudo[102265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:30 devstack sudo[102255]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a349658f-9ef1-4160-8ecc-3f7be1175a29 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9 2147483648" returned: 0 in 0.506s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a349658f-9ef1-4160-8ecc-3f7be1175a29 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:30 devstack sudo[102267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9 Jul 28 10:48:30 devstack sudo[102267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:31 devstack sudo[102265]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5b0f3a5a-f024-4abf-b611-3ed190e21143 1G" returned: 0 in 0.327s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:31 devstack cinder-volume[88413]: DEBUG cinder.volume.volume_utils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Downloaded image c7b85cca-ca1f-46df-87d8-3768bebf70fe ((None, [{'url': 'file:///opt/stack/data/glance/images/c7b85cca-ca1f-46df-87d8-3768bebf70fe', 'metadata': {}}])) to volume 5b0f3a5a-f024-4abf-b611-3ed190e21143 successfully. {{(pid=88413) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 28 10:48:31 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Temporary image c7b85cca-ca1f-46df-87d8-3768bebf70fe for user d0c59c7d04d642688fc43fd38645b36f is deleted. {{(pid=88413) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 28 10:48:31 devstack cinder-volume[88413]: DEBUG cinder.volume.volume_utils [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Marking volume 5b0f3a5a-f024-4abf-b611-3ed190e21143 as bootable. {{(pid=88413) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 28 10:48:31 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Copying metadata from image c7b85cca-ca1f-46df-87d8-3768bebf70fe to 5b0f3a5a-f024-4abf-b611-3ed190e21143. {{(pid=88413) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 28 10:48:31 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Creating volume glance metadata for volume 5b0f3a5a-f024-4abf-b611-3ed190e21143 backed by image c7b85cca-ca1f-46df-87d8-3768bebf70fe with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c7b85cca-ca1f-46df-87d8-3768bebf70fe', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '27bf1c387edd0f64407e22018cff404a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88413) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 28 10:48:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2114dc64-d1a2-4575-90ac-dc6b0b1ad55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b0f3a5a-f024-4abf-b611-3ed190e21143', 'volume_size': 1, 'image_id': 'c7b85cca-ca1f-46df-87d8-3768bebf70fe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c7b85cca-ca1f-46df-87d8-3768bebf70fe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '27bf1c387edd0f64407e22018cff404a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0a33a22f314d45b3b049543da810fc8e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '64f3322c147807034cc07d007fd7031de7f506e1b766c7bb50da46a6904c9887c76066e1de438c88ea3a28e853784ffd875356ba6473a779d88a3900a3010b2d', 'id': 'c7b85cca-ca1f-46df-87d8-3768bebf70fe', 'created_at': datetime.datetime(2026, 7, 28, 8, 48, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 8, 48, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c7b85cca-ca1f-46df-87d8-3768bebf70fe/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34c58b16-0f4c-4712-aa89-d97eb749cee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:31 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Volume volume-5b0f3a5a-f024-4abf-b611-3ed190e21143 (5b0f3a5a-f024-4abf-b611-3ed190e21143): created successfully Jul 28 10:48:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34c58b16-0f4c-4712-aa89-d97eb749cee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Flow 'volume_create_manager' (a6d5a4f0-0c7c-4569-924b-3bb97d4d6efd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:48:31 devstack sudo[102267]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a349658f-9ef1-4160-8ecc-3f7be1175a29 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9" returned: 0 in 0.259s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:31 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-a349658f-9ef1-4160-8ecc-3f7be1175a29 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:48:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a349658f-9ef1-4160-8ecc-3f7be1175a29 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:48:31 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-5d802d99-8ec3-40d5-a8e0-9634fb469a42 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Created volume successfully. Jul 28 10:48:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a349658f-9ef1-4160-8ecc-3f7be1175a29 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6434d44a-455f-47f7-857e-ce7b88f58a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dd37b32-9549-4457-80ad-4545977f3ca9', 'volume_size': 2}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a349658f-9ef1-4160-8ecc-3f7be1175a29 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d89e24c-f5eb-4dd5-966d-a88095b62aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:31 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-a349658f-9ef1-4160-8ecc-3f7be1175a29 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Volume volume-4dd37b32-9549-4457-80ad-4545977f3ca9 (4dd37b32-9549-4457-80ad-4545977f3ca9): created successfully Jul 28 10:48:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a349658f-9ef1-4160-8ecc-3f7be1175a29 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d89e24c-f5eb-4dd5-966d-a88095b62aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-a349658f-9ef1-4160-8ecc-3f7be1175a29 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Flow 'volume_create_manager' (835b2164-9e64-452b-99c9-963a5f63996c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:48:31 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-a349658f-9ef1-4160-8ecc-3f7be1175a29 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Created volume successfully. Jul 28 10:48:31 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1bd78406-1d70-492b-9b09-04ac52e793d5 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Acquiring lock "cinder-5b0f3a5a-f024-4abf-b611-3ed190e21143-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:48:31 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1bd78406-1d70-492b-9b09-04ac52e793d5 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Lock "cinder-5b0f3a5a-f024-4abf-b611-3ed190e21143-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:48:31 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1bd78406-1d70-492b-9b09-04ac52e793d5 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Acquiring lock "cinder-quobyte-5b0f3a5a-f024-4abf-b611-3ed190e21143" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:48:31 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1bd78406-1d70-492b-9b09-04ac52e793d5 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Lock "cinder-quobyte-5b0f3a5a-f024-4abf-b611-3ed190e21143" acquired by "delete_volume" :: waited 0.017s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:48:31 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a97b6d2-9620-4b9f-916b-7c80645299ad]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:48:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1bd78406-1d70-492b-9b09-04ac52e793d5 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5b0f3a5a-f024-4abf-b611-3ed190e21143 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:31 devstack sudo[102274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5b0f3a5a-f024-4abf-b611-3ed190e21143 Jul 28 10:48:31 devstack sudo[102274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:32 devstack sudo[102274]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1bd78406-1d70-492b-9b09-04ac52e793d5 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5b0f3a5a-f024-4abf-b611-3ed190e21143" returned: 0 in 0.391s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1bd78406-1d70-492b-9b09-04ac52e793d5 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5b0f3a5a-f024-4abf-b611-3ed190e21143 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:32 devstack sudo[102280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5b0f3a5a-f024-4abf-b611-3ed190e21143 Jul 28 10:48:32 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:32 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1bd78406-1d70-492b-9b09-04ac52e793d5 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5b0f3a5a-f024-4abf-b611-3ed190e21143" returned: 0 in 0.261s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:32 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1bd78406-1d70-492b-9b09-04ac52e793d5 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Lock "cinder-quobyte-5b0f3a5a-f024-4abf-b611-3ed190e21143" released by "delete_volume" :: held 0.707s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:48:32 devstack cinder-volume[88413]: WARNING cinder.quota [None req-1bd78406-1d70-492b-9b09-04ac52e793d5 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 28 10:48:32 devstack cinder-volume[88413]: WARNING cinder.quota [None req-1bd78406-1d70-492b-9b09-04ac52e793d5 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 28 10:48:32 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-1bd78406-1d70-492b-9b09-04ac52e793d5 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Created reservations ['e4b8e53d-e412-4646-8dfc-03c189476298', '32e43a8a-4104-440e-adef-8b0005b0e30b', 'c6fbbf1f-7fd9-427d-a16e-a8bf0d103e8c', '79e9acb1-e0a5-4c00-89a6-55a8221489e8'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:48:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1bd78406-1d70-492b-9b09-04ac52e793d5 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:48:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1bd78406-1d70-492b-9b09-04ac52e793d5 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:48:32 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-1bd78406-1d70-492b-9b09-04ac52e793d5 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:48:32 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-1bd78406-1d70-492b-9b09-04ac52e793d5 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:48:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1bd78406-1d70-492b-9b09-04ac52e793d5 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:48:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1bd78406-1d70-492b-9b09-04ac52e793d5 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:32 devstack sudo[102290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:48:32 devstack sudo[102290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-bb5198f5-9ac7-4c33-8c15-4e9d7e65a1ea tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:48:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-bb5198f5-9ac7-4c33-8c15-4e9d7e65a1ea tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:48:32 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-bb5198f5-9ac7-4c33-8c15-4e9d7e65a1ea tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Creating offline snapshot f90e8b9b-bc23-4edf-aec3-4901612f8560 of volume 4dd37b32-9549-4457-80ad-4545977f3ca9 {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:48:32 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae33465-549c-4a1d-b7bc-e0aa53366647]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:48:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bb5198f5-9ac7-4c33-8c15-4e9d7e65a1ea tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:32 devstack sudo[102292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9 Jul 28 10:48:32 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:32 devstack sudo[102290]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1bd78406-1d70-492b-9b09-04ac52e793d5 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.256s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:32 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-1bd78406-1d70-492b-9b09-04ac52e793d5 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:48:32 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-1bd78406-1d70-492b-9b09-04ac52e793d5 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Deleted volume successfully. Jul 28 10:48:32 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1bd78406-1d70-492b-9b09-04ac52e793d5 tempest-VolumeAndVolumeTypeFromImageTest-2005871225 None] Lock "cinder-5b0f3a5a-f024-4abf-b611-3ed190e21143-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:48:33 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bb5198f5-9ac7-4c33-8c15-4e9d7e65a1ea tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9" returned: 0 in 0.461s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bb5198f5-9ac7-4c33-8c15-4e9d7e65a1ea tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9.f90e8b9b-bc23-4edf-aec3-4901612f8560 2G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:33 devstack sudo[102302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9.f90e8b9b-bc23-4edf-aec3-4901612f8560 2G Jul 28 10:48:33 devstack sudo[102302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:33 devstack sudo[102302]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bb5198f5-9ac7-4c33-8c15-4e9d7e65a1ea tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9.f90e8b9b-bc23-4edf-aec3-4901612f8560 2G" returned: 0 in 0.480s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bb5198f5-9ac7-4c33-8c15-4e9d7e65a1ea tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dd37b32-9549-4457-80ad-4545977f3ca9 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9.f90e8b9b-bc23-4edf-aec3-4901612f8560 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:33 devstack sudo[102323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dd37b32-9549-4457-80ad-4545977f3ca9 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9.f90e8b9b-bc23-4edf-aec3-4901612f8560 Jul 28 10:48:33 devstack sudo[102323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:33 devstack sudo[102323]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bb5198f5-9ac7-4c33-8c15-4e9d7e65a1ea tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dd37b32-9549-4457-80ad-4545977f3ca9 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9.f90e8b9b-bc23-4edf-aec3-4901612f8560" returned: 0 in 0.352s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:33 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-bb5198f5-9ac7-4c33-8c15-4e9d7e65a1ea tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9.f90e8b9b-bc23-4edf-aec3-4901612f8560 is being set with open permissions: ugo+rw Jul 28 10:48:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bb5198f5-9ac7-4c33-8c15-4e9d7e65a1ea tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9.f90e8b9b-bc23-4edf-aec3-4901612f8560 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:33 devstack sudo[102338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9.f90e8b9b-bc23-4edf-aec3-4901612f8560 Jul 28 10:48:33 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:34 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bb5198f5-9ac7-4c33-8c15-4e9d7e65a1ea tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9.f90e8b9b-bc23-4edf-aec3-4901612f8560" returned: 0 in 0.339s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bb5198f5-9ac7-4c33-8c15-4e9d7e65a1ea tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:34 devstack sudo[102356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9.info Jul 28 10:48:34 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:34 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bb5198f5-9ac7-4c33-8c15-4e9d7e65a1ea tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9.info" returned: 0 in 0.316s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:34 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-bb5198f5-9ac7-4c33-8c15-4e9d7e65a1ea tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9.info is being set with open permissions: ugo+rw Jul 28 10:48:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bb5198f5-9ac7-4c33-8c15-4e9d7e65a1ea tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:34 devstack sudo[102359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9.info Jul 28 10:48:34 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:34 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bb5198f5-9ac7-4c33-8c15-4e9d7e65a1ea tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9.info" returned: 0 in 0.303s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-bb5198f5-9ac7-4c33-8c15-4e9d7e65a1ea tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.381s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:48:34 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-bb5198f5-9ac7-4c33-8c15-4e9d7e65a1ea tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Create snapshot completed successfully Jul 28 10:48:35 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ca1b0f18-a46a-4e2f-a4d1-2e6946ab56a5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Acquiring lock "cinder-f90e8b9b-bc23-4edf-aec3-4901612f8560-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:48:36 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ca1b0f18-a46a-4e2f-a4d1-2e6946ab56a5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Lock "cinder-f90e8b9b-bc23-4edf-aec3-4901612f8560-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:48:36 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ca1b0f18-a46a-4e2f-a4d1-2e6946ab56a5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Acquiring lock "cinder-quobyte-4dd37b32-9549-4457-80ad-4545977f3ca9" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:48:36 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ca1b0f18-a46a-4e2f-a4d1-2e6946ab56a5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Lock "cinder-quobyte-4dd37b32-9549-4457-80ad-4545977f3ca9" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:48:36 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ca1b0f18-a46a-4e2f-a4d1-2e6946ab56a5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Acquiring lock "cinder-quobyte-f90e8b9b-bc23-4edf-aec3-4901612f8560" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:48:36 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ca1b0f18-a46a-4e2f-a4d1-2e6946ab56a5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Lock "cinder-quobyte-f90e8b9b-bc23-4edf-aec3-4901612f8560" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:48:36 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-ca1b0f18-a46a-4e2f-a4d1-2e6946ab56a5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Deleting offline snapshot f90e8b9b-bc23-4edf-aec3-4901612f8560 of volume 4dd37b32-9549-4457-80ad-4545977f3ca9 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:48:36 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-ca1b0f18-a46a-4e2f-a4d1-2e6946ab56a5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] snapshot_file for this snap is: volume-4dd37b32-9549-4457-80ad-4545977f3ca9.f90e8b9b-bc23-4edf-aec3-4901612f8560 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:48:36 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ad12d1-8b59-43a0-8be0-c9773df92c6c]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:48:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ca1b0f18-a46a-4e2f-a4d1-2e6946ab56a5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9.f90e8b9b-bc23-4edf-aec3-4901612f8560 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:36 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9.f90e8b9b-bc23-4edf-aec3-4901612f8560 Jul 28 10:48:36 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:36 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ca1b0f18-a46a-4e2f-a4d1-2e6946ab56a5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9.f90e8b9b-bc23-4edf-aec3-4901612f8560" returned: 0 in 0.411s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:36 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-ca1b0f18-a46a-4e2f-a4d1-2e6946ab56a5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4dd37b32-9549-4457-80ad-4545977f3ca9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:48:36 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b4ae91-aa1c-4fe8-91e2-e2ad9a656f0f]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:48:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ca1b0f18-a46a-4e2f-a4d1-2e6946ab56a5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:36 devstack sudo[102370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9 Jul 28 10:48:36 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:36 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ca1b0f18-a46a-4e2f-a4d1-2e6946ab56a5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9" returned: 0 in 0.408s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ca1b0f18-a46a-4e2f-a4d1-2e6946ab56a5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9.f90e8b9b-bc23-4edf-aec3-4901612f8560 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:36 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9.f90e8b9b-bc23-4edf-aec3-4901612f8560 Jul 28 10:48:36 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:37 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ca1b0f18-a46a-4e2f-a4d1-2e6946ab56a5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9.f90e8b9b-bc23-4edf-aec3-4901612f8560" returned: 0 in 0.430s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ca1b0f18-a46a-4e2f-a4d1-2e6946ab56a5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9.f90e8b9b-bc23-4edf-aec3-4901612f8560 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:37 devstack sudo[102405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9.f90e8b9b-bc23-4edf-aec3-4901612f8560 Jul 28 10:48:37 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:37 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ca1b0f18-a46a-4e2f-a4d1-2e6946ab56a5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9.f90e8b9b-bc23-4edf-aec3-4901612f8560" returned: 0 in 0.278s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:37 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ca1b0f18-a46a-4e2f-a4d1-2e6946ab56a5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Lock "cinder-quobyte-f90e8b9b-bc23-4edf-aec3-4901612f8560" released by "_delete_snapshot" :: held 1.672s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:48:37 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ca1b0f18-a46a-4e2f-a4d1-2e6946ab56a5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Lock "cinder-quobyte-4dd37b32-9549-4457-80ad-4545977f3ca9" released by "delete_snapshot" :: held 1.699s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:48:37 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-ca1b0f18-a46a-4e2f-a4d1-2e6946ab56a5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Created reservations ['bc95018b-aeae-462d-bec5-a349f11a02a2', '1b09d2e3-42c9-4e71-8941-6d3982ab1378', '37f5729d-b7bd-4e9b-a5a2-9a09c093f271', '98e4fc80-4de2-47f8-9ddd-de8c703c8c8e'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:48:37 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-ca1b0f18-a46a-4e2f-a4d1-2e6946ab56a5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Delete snapshot completed successfully. Jul 28 10:48:37 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ca1b0f18-a46a-4e2f-a4d1-2e6946ab56a5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Lock "cinder-f90e8b9b-bc23-4edf-aec3-4901612f8560-delete_snapshot" released by "delete_snapshot" :: held 1.921s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:48:38 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-79cc6903-d815-48dd-8b08-686411db2a0b tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:48:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-79cc6903-d815-48dd-8b08-686411db2a0b tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Flow 'volume_create_manager' (3e7dcf61-5c08-4bda-a7e4-bd493a776d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:48:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-79cc6903-d815-48dd-8b08-686411db2a0b tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b5398d6-356d-4fd2-a6ee-d8aa28ca3b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-79cc6903-d815-48dd-8b08-686411db2a0b tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b5398d6-356d-4fd2-a6ee-d8aa28ca3b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-422452748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d17e4b7c-b1fb-4d2e-bd88-ae9637263d3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0956a83bfd408897ad1a2099388090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:48:38Z,use_quota=True,user_id='6b7cb63435e94f4590f8257a7e6f4248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-79cc6903-d815-48dd-8b08-686411db2a0b tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0367c94d-403e-4811-9f23-9473961393e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-79cc6903-d815-48dd-8b08-686411db2a0b tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0367c94d-403e-4811-9f23-9473961393e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-79cc6903-d815-48dd-8b08-686411db2a0b tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60fb2a8e-6b49-489d-916b-fea7dada76bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-79cc6903-d815-48dd-8b08-686411db2a0b tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60fb2a8e-6b49-489d-916b-fea7dada76bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd17e4b7c-b1fb-4d2e-bd88-ae9637263d3c', 'volume_name': 'volume-d17e4b7c-b1fb-4d2e-bd88-ae9637263d3c', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-79cc6903-d815-48dd-8b08-686411db2a0b tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0693af5f-5f80-4255-8aea-1409d48fee50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-79cc6903-d815-48dd-8b08-686411db2a0b tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0693af5f-5f80-4255-8aea-1409d48fee50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-79cc6903-d815-48dd-8b08-686411db2a0b tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac29fbed-e40e-4ca6-ba73-70eb9c06f8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:38 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-79cc6903-d815-48dd-8b08-686411db2a0b tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Volume d17e4b7c-b1fb-4d2e-bd88-ae9637263d3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d17e4b7c-b1fb-4d2e-bd88-ae9637263d3c', 'volume_size': 1} Jul 28 10:48:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-79cc6903-d815-48dd-8b08-686411db2a0b tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:48:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-79cc6903-d815-48dd-8b08-686411db2a0b tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:48:38 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-79cc6903-d815-48dd-8b08-686411db2a0b tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-422452748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d17e4b7c-b1fb-4d2e-bd88-ae9637263d3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0956a83bfd408897ad1a2099388090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:48:38Z,use_quota=True,user_id='6b7cb63435e94f4590f8257a7e6f4248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:48:38 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-79cc6903-d815-48dd-8b08-686411db2a0b tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Creating volume d17e4b7c-b1fb-4d2e-bd88-ae9637263d3c {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:48:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-79cc6903-d815-48dd-8b08-686411db2a0b tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:48:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-79cc6903-d815-48dd-8b08-686411db2a0b tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:48:38 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-79cc6903-d815-48dd-8b08-686411db2a0b tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:48:38 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-79cc6903-d815-48dd-8b08-686411db2a0b tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:48:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-79cc6903-d815-48dd-8b08-686411db2a0b tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:48:38 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-79cc6903-d815-48dd-8b08-686411db2a0b tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:48:38 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-79cc6903-d815-48dd-8b08-686411db2a0b tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:48:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-79cc6903-d815-48dd-8b08-686411db2a0b tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d17e4b7c-b1fb-4d2e-bd88-ae9637263d3c 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:38 devstack sudo[102408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d17e4b7c-b1fb-4d2e-bd88-ae9637263d3c 1073741824 Jul 28 10:48:38 devstack sudo[102408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:38 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3d274df5-438e-4bad-be95-ce94b7a221f5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Acquiring lock "cinder-4dd37b32-9549-4457-80ad-4545977f3ca9-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:48:38 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3d274df5-438e-4bad-be95-ce94b7a221f5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Lock "cinder-4dd37b32-9549-4457-80ad-4545977f3ca9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:48:38 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3d274df5-438e-4bad-be95-ce94b7a221f5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Acquiring lock "cinder-quobyte-4dd37b32-9549-4457-80ad-4545977f3ca9" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:48:38 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3d274df5-438e-4bad-be95-ce94b7a221f5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Lock "cinder-quobyte-4dd37b32-9549-4457-80ad-4545977f3ca9" acquired by "delete_volume" :: waited 0.020s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:48:38 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[abca93a6-fb0e-4ffc-874f-c6c8a598dc36]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:48:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3d274df5-438e-4bad-be95-ce94b7a221f5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:38 devstack sudo[102410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9 Jul 28 10:48:38 devstack sudo[102410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:38 devstack sudo[102408]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-79cc6903-d815-48dd-8b08-686411db2a0b tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d17e4b7c-b1fb-4d2e-bd88-ae9637263d3c 1073741824" returned: 0 in 0.497s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-79cc6903-d815-48dd-8b08-686411db2a0b tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d17e4b7c-b1fb-4d2e-bd88-ae9637263d3c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:38 devstack sudo[102417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d17e4b7c-b1fb-4d2e-bd88-ae9637263d3c Jul 28 10:48:38 devstack sudo[102417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:38 devstack sudo[102410]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3d274df5-438e-4bad-be95-ce94b7a221f5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9" returned: 0 in 0.417s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3d274df5-438e-4bad-be95-ce94b7a221f5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:38 devstack sudo[102421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9 Jul 28 10:48:38 devstack sudo[102421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:39 devstack sudo[102417]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-79cc6903-d815-48dd-8b08-686411db2a0b tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d17e4b7c-b1fb-4d2e-bd88-ae9637263d3c" returned: 0 in 0.318s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:39 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-79cc6903-d815-48dd-8b08-686411db2a0b tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:48:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-79cc6903-d815-48dd-8b08-686411db2a0b tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:48:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-79cc6903-d815-48dd-8b08-686411db2a0b tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac29fbed-e40e-4ca6-ba73-70eb9c06f8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d17e4b7c-b1fb-4d2e-bd88-ae9637263d3c', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-79cc6903-d815-48dd-8b08-686411db2a0b tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2cd929-5576-4482-87a9-d3203493a3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:39 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-79cc6903-d815-48dd-8b08-686411db2a0b tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Volume volume-d17e4b7c-b1fb-4d2e-bd88-ae9637263d3c (d17e4b7c-b1fb-4d2e-bd88-ae9637263d3c): created successfully Jul 28 10:48:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-79cc6903-d815-48dd-8b08-686411db2a0b tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2cd929-5576-4482-87a9-d3203493a3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:39 devstack sudo[102421]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-79cc6903-d815-48dd-8b08-686411db2a0b tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Flow 'volume_create_manager' (3e7dcf61-5c08-4bda-a7e4-bd493a776d5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:48:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3d274df5-438e-4bad-be95-ce94b7a221f5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4dd37b32-9549-4457-80ad-4545977f3ca9" returned: 0 in 0.319s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:39 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3d274df5-438e-4bad-be95-ce94b7a221f5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Lock "cinder-quobyte-4dd37b32-9549-4457-80ad-4545977f3ca9" released by "delete_volume" :: held 0.810s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:48:39 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-79cc6903-d815-48dd-8b08-686411db2a0b tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Created volume successfully. Jul 28 10:48:39 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-3d274df5-438e-4bad-be95-ce94b7a221f5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Created reservations ['8e72d570-84c8-45fc-b207-9cd155820292', 'db49f9fd-0d85-4c47-b1fc-686a09bb17ee', '3e5c7a42-83d3-4ea0-9cac-f0707c43ddd4', 'cfa530be-f2a7-4f6a-8bf7-a446d25ce0eb'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:48:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3d274df5-438e-4bad-be95-ce94b7a221f5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:48:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3d274df5-438e-4bad-be95-ce94b7a221f5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:48:39 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3d274df5-438e-4bad-be95-ce94b7a221f5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:48:39 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3d274df5-438e-4bad-be95-ce94b7a221f5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:48:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3d274df5-438e-4bad-be95-ce94b7a221f5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:48:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3d274df5-438e-4bad-be95-ce94b7a221f5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:39 devstack sudo[102425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:48:39 devstack sudo[102425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:39 devstack sudo[102425]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3d274df5-438e-4bad-be95-ce94b7a221f5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.266s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:39 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-3d274df5-438e-4bad-be95-ce94b7a221f5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:48:39 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-3d274df5-438e-4bad-be95-ce94b7a221f5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Deleted volume successfully. Jul 28 10:48:39 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3d274df5-438e-4bad-be95-ce94b7a221f5 tempest-VolumesSnapshotNegativeTestJSON-1369687677 None] Lock "cinder-4dd37b32-9549-4457-80ad-4545977f3ca9-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:48:40 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8f2ba96-fd41-44b6-b084-9e04ca75c13f tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:48:40 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e8f2ba96-fd41-44b6-b084-9e04ca75c13f tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Flow 'volume_create_manager' (3937f5ac-2093-49bb-a279-cb1a2b1ef9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:48:40 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e8f2ba96-fd41-44b6-b084-9e04ca75c13f tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16285b57-d93b-4118-9f04-d39e4d7d240f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:40 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e8f2ba96-fd41-44b6-b084-9e04ca75c13f tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16285b57-d93b-4118-9f04-d39e4d7d240f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1186429857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b07165f-fb9f-49a3-90a4-478485a282e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0956a83bfd408897ad1a2099388090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:48:41Z,use_quota=True,user_id='6b7cb63435e94f4590f8257a7e6f4248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:40 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e8f2ba96-fd41-44b6-b084-9e04ca75c13f tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe7ac33-c98e-4664-a937-4ef0b5c7e54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:40 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e8f2ba96-fd41-44b6-b084-9e04ca75c13f tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe7ac33-c98e-4664-a937-4ef0b5c7e54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:40 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e8f2ba96-fd41-44b6-b084-9e04ca75c13f tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d6c72f-9fd0-40b1-9891-e52bc3889352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:40 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e8f2ba96-fd41-44b6-b084-9e04ca75c13f tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d6c72f-9fd0-40b1-9891-e52bc3889352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b07165f-fb9f-49a3-90a4-478485a282e0', 'volume_name': 'volume-9b07165f-fb9f-49a3-90a4-478485a282e0', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:40 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e8f2ba96-fd41-44b6-b084-9e04ca75c13f tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (927b8d27-aa2e-4ffe-86fe-34fc9c0cae06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:40 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e8f2ba96-fd41-44b6-b084-9e04ca75c13f tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (927b8d27-aa2e-4ffe-86fe-34fc9c0cae06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:40 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e8f2ba96-fd41-44b6-b084-9e04ca75c13f tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37d6ad12-740d-40aa-a017-bf8c2f966940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:40 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-e8f2ba96-fd41-44b6-b084-9e04ca75c13f tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Volume 9b07165f-fb9f-49a3-90a4-478485a282e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b07165f-fb9f-49a3-90a4-478485a282e0', 'volume_size': 1} Jul 28 10:48:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e8f2ba96-fd41-44b6-b084-9e04ca75c13f tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:48:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e8f2ba96-fd41-44b6-b084-9e04ca75c13f tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:48:40 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e8f2ba96-fd41-44b6-b084-9e04ca75c13f tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1186429857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b07165f-fb9f-49a3-90a4-478485a282e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0956a83bfd408897ad1a2099388090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:48:41Z,use_quota=True,user_id='6b7cb63435e94f4590f8257a7e6f4248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:48:40 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-e8f2ba96-fd41-44b6-b084-9e04ca75c13f tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Creating volume 9b07165f-fb9f-49a3-90a4-478485a282e0 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:48:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e8f2ba96-fd41-44b6-b084-9e04ca75c13f tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:48:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e8f2ba96-fd41-44b6-b084-9e04ca75c13f tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:48:40 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e8f2ba96-fd41-44b6-b084-9e04ca75c13f tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:48:40 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e8f2ba96-fd41-44b6-b084-9e04ca75c13f tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:48:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e8f2ba96-fd41-44b6-b084-9e04ca75c13f tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:48:40 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e8f2ba96-fd41-44b6-b084-9e04ca75c13f tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:48:40 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-e8f2ba96-fd41-44b6-b084-9e04ca75c13f tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:48:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e8f2ba96-fd41-44b6-b084-9e04ca75c13f tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9b07165f-fb9f-49a3-90a4-478485a282e0 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:40 devstack sudo[102429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9b07165f-fb9f-49a3-90a4-478485a282e0 1073741824 Jul 28 10:48:40 devstack sudo[102429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:41 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c52a47c-1176-4fa4-9c2f-9529efa50cc7 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:48:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9c52a47c-1176-4fa4-9c2f-9529efa50cc7 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Flow 'volume_create_manager' (8f91bb9d-9b0a-46b8-8cba-7daaf105dbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:48:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9c52a47c-1176-4fa4-9c2f-9529efa50cc7 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad87469e-9dbf-4871-8b73-0b7aeb60b217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9c52a47c-1176-4fa4-9c2f-9529efa50cc7 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad87469e-9dbf-4871-8b73-0b7aeb60b217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1992161021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=454f0882-e9d3-4498-99b4-e1f650c96d4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0956a83bfd408897ad1a2099388090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:48:41Z,use_quota=True,user_id='6b7cb63435e94f4590f8257a7e6f4248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9c52a47c-1176-4fa4-9c2f-9529efa50cc7 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e900ab-d63d-420a-84bd-938289b0f2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9c52a47c-1176-4fa4-9c2f-9529efa50cc7 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e900ab-d63d-420a-84bd-938289b0f2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9c52a47c-1176-4fa4-9c2f-9529efa50cc7 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44bdb58f-fa7e-4193-87cd-2f447e32870f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9c52a47c-1176-4fa4-9c2f-9529efa50cc7 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44bdb58f-fa7e-4193-87cd-2f447e32870f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '454f0882-e9d3-4498-99b4-e1f650c96d4e', 'volume_name': 'volume-454f0882-e9d3-4498-99b4-e1f650c96d4e', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9c52a47c-1176-4fa4-9c2f-9529efa50cc7 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5ea1bff-9179-4600-b019-8f56cb6c632f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9c52a47c-1176-4fa4-9c2f-9529efa50cc7 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5ea1bff-9179-4600-b019-8f56cb6c632f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9c52a47c-1176-4fa4-9c2f-9529efa50cc7 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (954326aa-7c6a-4680-9add-5d1c1c11e926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:41 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-9c52a47c-1176-4fa4-9c2f-9529efa50cc7 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Volume 454f0882-e9d3-4498-99b4-e1f650c96d4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-454f0882-e9d3-4498-99b4-e1f650c96d4e', 'volume_size': 1} Jul 28 10:48:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9c52a47c-1176-4fa4-9c2f-9529efa50cc7 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:48:41 devstack sudo[102429]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e8f2ba96-fd41-44b6-b084-9e04ca75c13f tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9b07165f-fb9f-49a3-90a4-478485a282e0 1073741824" returned: 0 in 0.747s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e8f2ba96-fd41-44b6-b084-9e04ca75c13f tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9b07165f-fb9f-49a3-90a4-478485a282e0 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:41 devstack sudo[102434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9b07165f-fb9f-49a3-90a4-478485a282e0 Jul 28 10:48:41 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:41 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-0901b65e-da36-4e49-bd39-00a0e6a96770 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:48:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0901b65e-da36-4e49-bd39-00a0e6a96770 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Flow 'volume_create_manager' (9ed8ab07-4579-4305-9f31-41b4843e5cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:48:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0901b65e-da36-4e49-bd39-00a0e6a96770 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3990d899-9547-485d-88c8-6368b5ffe5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0901b65e-da36-4e49-bd39-00a0e6a96770 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3990d899-9547-485d-88c8-6368b5ffe5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1150650471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fef3a718-1b87-4737-853e-0188747c8d94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0956a83bfd408897ad1a2099388090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:48:42Z,use_quota=True,user_id='6b7cb63435e94f4590f8257a7e6f4248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0901b65e-da36-4e49-bd39-00a0e6a96770 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6bf740d-75e7-4600-8fa1-02680a42ae80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0901b65e-da36-4e49-bd39-00a0e6a96770 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6bf740d-75e7-4600-8fa1-02680a42ae80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0901b65e-da36-4e49-bd39-00a0e6a96770 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c3efcea-83b1-449f-9f8f-876a392de9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:42 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0901b65e-da36-4e49-bd39-00a0e6a96770 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c3efcea-83b1-449f-9f8f-876a392de9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fef3a718-1b87-4737-853e-0188747c8d94', 'volume_name': 'volume-fef3a718-1b87-4737-853e-0188747c8d94', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:42 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0901b65e-da36-4e49-bd39-00a0e6a96770 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efb4be80-29eb-4d99-84e6-6c62809e8e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:42 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0901b65e-da36-4e49-bd39-00a0e6a96770 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efb4be80-29eb-4d99-84e6-6c62809e8e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:42 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0901b65e-da36-4e49-bd39-00a0e6a96770 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2006aad7-0261-4876-900d-156e605401f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:42 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-0901b65e-da36-4e49-bd39-00a0e6a96770 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Volume fef3a718-1b87-4737-853e-0188747c8d94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fef3a718-1b87-4737-853e-0188747c8d94', 'volume_size': 1} Jul 28 10:48:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0901b65e-da36-4e49-bd39-00a0e6a96770 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:48:42 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e8f2ba96-fd41-44b6-b084-9e04ca75c13f tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9b07165f-fb9f-49a3-90a4-478485a282e0" returned: 0 in 0.345s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:42 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e8f2ba96-fd41-44b6-b084-9e04ca75c13f tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:48:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e8f2ba96-fd41-44b6-b084-9e04ca75c13f tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:48:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9c52a47c-1176-4fa4-9c2f-9529efa50cc7 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.540s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:48:42 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9c52a47c-1176-4fa4-9c2f-9529efa50cc7 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1992161021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=454f0882-e9d3-4498-99b4-e1f650c96d4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0956a83bfd408897ad1a2099388090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:48:41Z,use_quota=True,user_id='6b7cb63435e94f4590f8257a7e6f4248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:48:42 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-9c52a47c-1176-4fa4-9c2f-9529efa50cc7 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Creating volume 454f0882-e9d3-4498-99b4-e1f650c96d4e {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:48:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9c52a47c-1176-4fa4-9c2f-9529efa50cc7 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:48:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9c52a47c-1176-4fa4-9c2f-9529efa50cc7 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:48:42 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9c52a47c-1176-4fa4-9c2f-9529efa50cc7 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:48:42 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9c52a47c-1176-4fa4-9c2f-9529efa50cc7 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:48:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9c52a47c-1176-4fa4-9c2f-9529efa50cc7 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:48:42 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9c52a47c-1176-4fa4-9c2f-9529efa50cc7 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:48:42 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-9c52a47c-1176-4fa4-9c2f-9529efa50cc7 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:48:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9c52a47c-1176-4fa4-9c2f-9529efa50cc7 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-454f0882-e9d3-4498-99b4-e1f650c96d4e 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:42 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e8f2ba96-fd41-44b6-b084-9e04ca75c13f tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37d6ad12-740d-40aa-a017-bf8c2f966940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b07165f-fb9f-49a3-90a4-478485a282e0', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:42 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e8f2ba96-fd41-44b6-b084-9e04ca75c13f tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5201e645-6f5b-459a-bbba-3528559f9ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:42 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-e8f2ba96-fd41-44b6-b084-9e04ca75c13f tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Volume volume-9b07165f-fb9f-49a3-90a4-478485a282e0 (9b07165f-fb9f-49a3-90a4-478485a282e0): created successfully Jul 28 10:48:42 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e8f2ba96-fd41-44b6-b084-9e04ca75c13f tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5201e645-6f5b-459a-bbba-3528559f9ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:42 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-e8f2ba96-fd41-44b6-b084-9e04ca75c13f tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Flow 'volume_create_manager' (3937f5ac-2093-49bb-a279-cb1a2b1ef9cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:48:42 devstack sudo[102437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-454f0882-e9d3-4498-99b4-e1f650c96d4e 1073741824 Jul 28 10:48:42 devstack sudo[102437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:42 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-e8f2ba96-fd41-44b6-b084-9e04ca75c13f tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Created volume successfully. Jul 28 10:48:42 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-d321eac2-9b69-4820-be67-2b6fc82004ce tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:48:42 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d321eac2-9b69-4820-be67-2b6fc82004ce tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Flow 'volume_create_manager' (9a6e283a-6242-4133-9b63-2531407041d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:48:42 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d321eac2-9b69-4820-be67-2b6fc82004ce tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25f3c0fa-0328-490a-9630-f8ec7487468e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:42 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d321eac2-9b69-4820-be67-2b6fc82004ce tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25f3c0fa-0328-490a-9630-f8ec7487468e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-630497610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de9a19c5-2457-4345-aafc-6ce6764535a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0956a83bfd408897ad1a2099388090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:48:42Z,use_quota=True,user_id='6b7cb63435e94f4590f8257a7e6f4248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:42 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d321eac2-9b69-4820-be67-2b6fc82004ce tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5adabd32-fce1-4e03-9331-1e27c5a9563c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:42 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d321eac2-9b69-4820-be67-2b6fc82004ce tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5adabd32-fce1-4e03-9331-1e27c5a9563c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:42 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d321eac2-9b69-4820-be67-2b6fc82004ce tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (449de9b2-b00e-40d0-b390-5749e7781b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:42 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d321eac2-9b69-4820-be67-2b6fc82004ce tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (449de9b2-b00e-40d0-b390-5749e7781b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de9a19c5-2457-4345-aafc-6ce6764535a5', 'volume_name': 'volume-de9a19c5-2457-4345-aafc-6ce6764535a5', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:42 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d321eac2-9b69-4820-be67-2b6fc82004ce tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d88f6845-3bd1-43be-9a39-33e78caf6528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:42 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d321eac2-9b69-4820-be67-2b6fc82004ce tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d88f6845-3bd1-43be-9a39-33e78caf6528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:42 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d321eac2-9b69-4820-be67-2b6fc82004ce tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1808778-600d-49b5-be05-132cdb0104ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:42 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-d321eac2-9b69-4820-be67-2b6fc82004ce tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Volume de9a19c5-2457-4345-aafc-6ce6764535a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de9a19c5-2457-4345-aafc-6ce6764535a5', 'volume_size': 1} Jul 28 10:48:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d321eac2-9b69-4820-be67-2b6fc82004ce tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:48:42 devstack sudo[102437]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9c52a47c-1176-4fa4-9c2f-9529efa50cc7 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-454f0882-e9d3-4498-99b4-e1f650c96d4e 1073741824" returned: 0 in 0.850s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9c52a47c-1176-4fa4-9c2f-9529efa50cc7 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-454f0882-e9d3-4498-99b4-e1f650c96d4e {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:43 devstack sudo[102442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-454f0882-e9d3-4498-99b4-e1f650c96d4e Jul 28 10:48:43 devstack sudo[102442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:43 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-80205500-ef18-45d0-b29e-36a433105528 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:48:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-80205500-ef18-45d0-b29e-36a433105528 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Flow 'volume_create_manager' (5029bcb0-a1ca-4221-a8ba-120255a28df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:48:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-80205500-ef18-45d0-b29e-36a433105528 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128eef46-b9a4-48b2-ace9-7cc1c3d96a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-80205500-ef18-45d0-b29e-36a433105528 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128eef46-b9a4-48b2-ace9-7cc1c3d96a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1449916438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02da5e75-41e4-4f35-a9a6-025289f77a96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0956a83bfd408897ad1a2099388090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:48:43Z,use_quota=True,user_id='6b7cb63435e94f4590f8257a7e6f4248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-80205500-ef18-45d0-b29e-36a433105528 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d505f9a-5f8b-4d91-b29f-cdc470a2dbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-80205500-ef18-45d0-b29e-36a433105528 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d505f9a-5f8b-4d91-b29f-cdc470a2dbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-80205500-ef18-45d0-b29e-36a433105528 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (464585a4-9c7a-4133-bbff-14bb1d4e9d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-80205500-ef18-45d0-b29e-36a433105528 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (464585a4-9c7a-4133-bbff-14bb1d4e9d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02da5e75-41e4-4f35-a9a6-025289f77a96', 'volume_name': 'volume-02da5e75-41e4-4f35-a9a6-025289f77a96', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-80205500-ef18-45d0-b29e-36a433105528 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c87c7d63-4b95-41e5-97be-064ebdb996ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-80205500-ef18-45d0-b29e-36a433105528 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c87c7d63-4b95-41e5-97be-064ebdb996ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-80205500-ef18-45d0-b29e-36a433105528 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ca3ad3d-79a4-4cbd-b33d-e6a6b7e6b122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:43 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-80205500-ef18-45d0-b29e-36a433105528 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Volume 02da5e75-41e4-4f35-a9a6-025289f77a96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02da5e75-41e4-4f35-a9a6-025289f77a96', 'volume_size': 1} Jul 28 10:48:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-80205500-ef18-45d0-b29e-36a433105528 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:48:43 devstack sudo[102442]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9c52a47c-1176-4fa4-9c2f-9529efa50cc7 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-454f0882-e9d3-4498-99b4-e1f650c96d4e" returned: 0 in 0.457s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:43 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9c52a47c-1176-4fa4-9c2f-9529efa50cc7 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] <== create_volume: return (1362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:48:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9c52a47c-1176-4fa4-9c2f-9529efa50cc7 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.367s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:48:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0901b65e-da36-4e49-bd39-00a0e6a96770 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.443s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:48:43 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0901b65e-da36-4e49-bd39-00a0e6a96770 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1150650471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fef3a718-1b87-4737-853e-0188747c8d94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0956a83bfd408897ad1a2099388090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:48:42Z,use_quota=True,user_id='6b7cb63435e94f4590f8257a7e6f4248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:48:43 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-0901b65e-da36-4e49-bd39-00a0e6a96770 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Creating volume fef3a718-1b87-4737-853e-0188747c8d94 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:48:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0901b65e-da36-4e49-bd39-00a0e6a96770 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:48:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0901b65e-da36-4e49-bd39-00a0e6a96770 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:48:43 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0901b65e-da36-4e49-bd39-00a0e6a96770 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:48:43 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0901b65e-da36-4e49-bd39-00a0e6a96770 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:48:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0901b65e-da36-4e49-bd39-00a0e6a96770 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:48:43 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0901b65e-da36-4e49-bd39-00a0e6a96770 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:48:43 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-0901b65e-da36-4e49-bd39-00a0e6a96770 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:48:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0901b65e-da36-4e49-bd39-00a0e6a96770 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-fef3a718-1b87-4737-853e-0188747c8d94 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9c52a47c-1176-4fa4-9c2f-9529efa50cc7 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (954326aa-7c6a-4680-9add-5d1c1c11e926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-454f0882-e9d3-4498-99b4-e1f650c96d4e', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:43 devstack sudo[102445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-fef3a718-1b87-4737-853e-0188747c8d94 1073741824 Jul 28 10:48:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9c52a47c-1176-4fa4-9c2f-9529efa50cc7 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (335a74b0-da47-473c-aa86-6ad85cdacb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:43 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:43 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-9c52a47c-1176-4fa4-9c2f-9529efa50cc7 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Volume volume-454f0882-e9d3-4498-99b4-e1f650c96d4e (454f0882-e9d3-4498-99b4-e1f650c96d4e): created successfully Jul 28 10:48:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9c52a47c-1176-4fa4-9c2f-9529efa50cc7 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (335a74b0-da47-473c-aa86-6ad85cdacb50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9c52a47c-1176-4fa4-9c2f-9529efa50cc7 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Flow 'volume_create_manager' (8f91bb9d-9b0a-46b8-8cba-7daaf105dbb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:48:43 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-9c52a47c-1176-4fa4-9c2f-9529efa50cc7 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Created volume successfully. Jul 28 10:48:44 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0901b65e-da36-4e49-bd39-00a0e6a96770 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-fef3a718-1b87-4737-853e-0188747c8d94 1073741824" returned: 0 in 0.585s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0901b65e-da36-4e49-bd39-00a0e6a96770 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-fef3a718-1b87-4737-853e-0188747c8d94 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:44 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-fef3a718-1b87-4737-853e-0188747c8d94 Jul 28 10:48:44 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:44 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0901b65e-da36-4e49-bd39-00a0e6a96770 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-fef3a718-1b87-4737-853e-0188747c8d94" returned: 0 in 0.295s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:44 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0901b65e-da36-4e49-bd39-00a0e6a96770 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:48:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0901b65e-da36-4e49-bd39-00a0e6a96770 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:48:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d321eac2-9b69-4820-be67-2b6fc82004ce tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.754s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:48:44 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-d321eac2-9b69-4820-be67-2b6fc82004ce tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-630497610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de9a19c5-2457-4345-aafc-6ce6764535a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0956a83bfd408897ad1a2099388090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:48:42Z,use_quota=True,user_id='6b7cb63435e94f4590f8257a7e6f4248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:48:44 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-d321eac2-9b69-4820-be67-2b6fc82004ce tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Creating volume de9a19c5-2457-4345-aafc-6ce6764535a5 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:48:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d321eac2-9b69-4820-be67-2b6fc82004ce tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:48:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d321eac2-9b69-4820-be67-2b6fc82004ce tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:48:44 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-d321eac2-9b69-4820-be67-2b6fc82004ce tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:48:44 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-d321eac2-9b69-4820-be67-2b6fc82004ce tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:48:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d321eac2-9b69-4820-be67-2b6fc82004ce tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:48:44 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-d321eac2-9b69-4820-be67-2b6fc82004ce tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:48:44 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-d321eac2-9b69-4820-be67-2b6fc82004ce tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:48:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d321eac2-9b69-4820-be67-2b6fc82004ce tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-de9a19c5-2457-4345-aafc-6ce6764535a5 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:44 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0901b65e-da36-4e49-bd39-00a0e6a96770 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2006aad7-0261-4876-900d-156e605401f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fef3a718-1b87-4737-853e-0188747c8d94', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:44 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0901b65e-da36-4e49-bd39-00a0e6a96770 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a95f6760-9bb8-4695-b05a-e25022ddbb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:44 devstack sudo[102454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-de9a19c5-2457-4345-aafc-6ce6764535a5 1073741824 Jul 28 10:48:44 devstack sudo[102454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:44 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-0901b65e-da36-4e49-bd39-00a0e6a96770 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Volume volume-fef3a718-1b87-4737-853e-0188747c8d94 (fef3a718-1b87-4737-853e-0188747c8d94): created successfully Jul 28 10:48:44 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0901b65e-da36-4e49-bd39-00a0e6a96770 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a95f6760-9bb8-4695-b05a-e25022ddbb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:44 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0901b65e-da36-4e49-bd39-00a0e6a96770 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Flow 'volume_create_manager' (9ed8ab07-4579-4305-9f31-41b4843e5cf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:48:44 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-0901b65e-da36-4e49-bd39-00a0e6a96770 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Created volume successfully. Jul 28 10:48:44 devstack sudo[102454]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d321eac2-9b69-4820-be67-2b6fc82004ce tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-de9a19c5-2457-4345-aafc-6ce6764535a5 1073741824" returned: 0 in 0.513s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d321eac2-9b69-4820-be67-2b6fc82004ce tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-de9a19c5-2457-4345-aafc-6ce6764535a5 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:45 devstack sudo[102460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-de9a19c5-2457-4345-aafc-6ce6764535a5 Jul 28 10:48:45 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:45 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d321eac2-9b69-4820-be67-2b6fc82004ce tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-de9a19c5-2457-4345-aafc-6ce6764535a5" returned: 0 in 0.324s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:45 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-d321eac2-9b69-4820-be67-2b6fc82004ce tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:48:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d321eac2-9b69-4820-be67-2b6fc82004ce tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:48:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-80205500-ef18-45d0-b29e-36a433105528 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.061s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:48:45 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-80205500-ef18-45d0-b29e-36a433105528 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1449916438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02da5e75-41e4-4f35-a9a6-025289f77a96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0956a83bfd408897ad1a2099388090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:48:43Z,use_quota=True,user_id='6b7cb63435e94f4590f8257a7e6f4248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:48:45 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-80205500-ef18-45d0-b29e-36a433105528 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Creating volume 02da5e75-41e4-4f35-a9a6-025289f77a96 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:48:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-80205500-ef18-45d0-b29e-36a433105528 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:48:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-80205500-ef18-45d0-b29e-36a433105528 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:48:45 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-80205500-ef18-45d0-b29e-36a433105528 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:48:45 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-80205500-ef18-45d0-b29e-36a433105528 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:48:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-80205500-ef18-45d0-b29e-36a433105528 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:48:45 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-80205500-ef18-45d0-b29e-36a433105528 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:48:45 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-80205500-ef18-45d0-b29e-36a433105528 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:48:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-80205500-ef18-45d0-b29e-36a433105528 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-02da5e75-41e4-4f35-a9a6-025289f77a96 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:45 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d321eac2-9b69-4820-be67-2b6fc82004ce tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1808778-600d-49b5-be05-132cdb0104ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de9a19c5-2457-4345-aafc-6ce6764535a5', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:45 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d321eac2-9b69-4820-be67-2b6fc82004ce tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0652811a-0351-42b1-b25a-552abc0e5159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:45 devstack sudo[102463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-02da5e75-41e4-4f35-a9a6-025289f77a96 1073741824 Jul 28 10:48:45 devstack sudo[102463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:45 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-d321eac2-9b69-4820-be67-2b6fc82004ce tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Volume volume-de9a19c5-2457-4345-aafc-6ce6764535a5 (de9a19c5-2457-4345-aafc-6ce6764535a5): created successfully Jul 28 10:48:45 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d321eac2-9b69-4820-be67-2b6fc82004ce tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0652811a-0351-42b1-b25a-552abc0e5159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:45 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d321eac2-9b69-4820-be67-2b6fc82004ce tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Flow 'volume_create_manager' (9a6e283a-6242-4133-9b63-2531407041d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:48:45 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-d321eac2-9b69-4820-be67-2b6fc82004ce tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Created volume successfully. Jul 28 10:48:45 devstack sudo[102463]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-80205500-ef18-45d0-b29e-36a433105528 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-02da5e75-41e4-4f35-a9a6-025289f77a96 1073741824" returned: 0 in 0.492s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-80205500-ef18-45d0-b29e-36a433105528 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-02da5e75-41e4-4f35-a9a6-025289f77a96 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:45 devstack sudo[102469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-02da5e75-41e4-4f35-a9a6-025289f77a96 Jul 28 10:48:45 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:46 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-80205500-ef18-45d0-b29e-36a433105528 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-02da5e75-41e4-4f35-a9a6-025289f77a96" returned: 0 in 0.274s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:46 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-80205500-ef18-45d0-b29e-36a433105528 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:48:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-80205500-ef18-45d0-b29e-36a433105528 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:48:46 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-80205500-ef18-45d0-b29e-36a433105528 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ca3ad3d-79a4-4cbd-b33d-e6a6b7e6b122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02da5e75-41e4-4f35-a9a6-025289f77a96', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:46 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-80205500-ef18-45d0-b29e-36a433105528 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5789eda9-1a65-484a-9299-f5ac9a412bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:46 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-80205500-ef18-45d0-b29e-36a433105528 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Volume volume-02da5e75-41e4-4f35-a9a6-025289f77a96 (02da5e75-41e4-4f35-a9a6-025289f77a96): created successfully Jul 28 10:48:46 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-80205500-ef18-45d0-b29e-36a433105528 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5789eda9-1a65-484a-9299-f5ac9a412bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:46 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-80205500-ef18-45d0-b29e-36a433105528 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Flow 'volume_create_manager' (5029bcb0-a1ca-4221-a8ba-120255a28df0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:48:46 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-80205500-ef18-45d0-b29e-36a433105528 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Created volume successfully. Jul 28 10:48:46 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e18b0b3e-c8cb-411f-a380-25247f3ac55e tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Acquiring lock "cinder-02da5e75-41e4-4f35-a9a6-025289f77a96-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:48:46 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e18b0b3e-c8cb-411f-a380-25247f3ac55e tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "cinder-02da5e75-41e4-4f35-a9a6-025289f77a96-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:48:46 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e18b0b3e-c8cb-411f-a380-25247f3ac55e tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Acquiring lock "cinder-quobyte-02da5e75-41e4-4f35-a9a6-025289f77a96" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:48:46 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e18b0b3e-c8cb-411f-a380-25247f3ac55e tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "cinder-quobyte-02da5e75-41e4-4f35-a9a6-025289f77a96" acquired by "delete_volume" :: waited 0.039s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:48:46 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc1c91d-939a-4a10-8201-54e05c37cc80]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:48:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e18b0b3e-c8cb-411f-a380-25247f3ac55e tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-02da5e75-41e4-4f35-a9a6-025289f77a96 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:46 devstack sudo[102472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-02da5e75-41e4-4f35-a9a6-025289f77a96 Jul 28 10:48:46 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:47 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e18b0b3e-c8cb-411f-a380-25247f3ac55e tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-02da5e75-41e4-4f35-a9a6-025289f77a96" returned: 0 in 0.386s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e18b0b3e-c8cb-411f-a380-25247f3ac55e tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-02da5e75-41e4-4f35-a9a6-025289f77a96 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:47 devstack sudo[102477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-02da5e75-41e4-4f35-a9a6-025289f77a96 Jul 28 10:48:47 devstack sudo[102477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:47 devstack sudo[102477]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e18b0b3e-c8cb-411f-a380-25247f3ac55e tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-02da5e75-41e4-4f35-a9a6-025289f77a96" returned: 0 in 0.309s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:47 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e18b0b3e-c8cb-411f-a380-25247f3ac55e tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "cinder-quobyte-02da5e75-41e4-4f35-a9a6-025289f77a96" released by "delete_volume" :: held 0.761s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:48:47 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-e18b0b3e-c8cb-411f-a380-25247f3ac55e tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Created reservations ['d445b70f-c459-4058-a8ce-e556add9d04d', 'd694219f-d73f-4b81-890e-f16e2323e379', 'd34b7ab6-7894-4b5a-bec0-d98368bd21d4', '8bbdea75-fdbf-40ba-bb95-3b0d09e5d497'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:48:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e18b0b3e-c8cb-411f-a380-25247f3ac55e tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:48:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e18b0b3e-c8cb-411f-a380-25247f3ac55e tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:48:47 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e18b0b3e-c8cb-411f-a380-25247f3ac55e tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:48:47 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e18b0b3e-c8cb-411f-a380-25247f3ac55e tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:48:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e18b0b3e-c8cb-411f-a380-25247f3ac55e tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:48:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e18b0b3e-c8cb-411f-a380-25247f3ac55e tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:47 devstack sudo[102480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:48:47 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:47 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-68a39c4f-e51b-4d3e-9a6a-0e04a26192d1 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Acquiring lock "cinder-de9a19c5-2457-4345-aafc-6ce6764535a5-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:48:47 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-68a39c4f-e51b-4d3e-9a6a-0e04a26192d1 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "cinder-de9a19c5-2457-4345-aafc-6ce6764535a5-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:48:47 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-68a39c4f-e51b-4d3e-9a6a-0e04a26192d1 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Acquiring lock "cinder-quobyte-de9a19c5-2457-4345-aafc-6ce6764535a5" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:48:47 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-68a39c4f-e51b-4d3e-9a6a-0e04a26192d1 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "cinder-quobyte-de9a19c5-2457-4345-aafc-6ce6764535a5" acquired by "delete_volume" :: waited 0.019s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:48:47 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a720eee-f19e-4e9d-b47a-84f1086ee8bb]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:48:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-68a39c4f-e51b-4d3e-9a6a-0e04a26192d1 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-de9a19c5-2457-4345-aafc-6ce6764535a5 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:48 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e18b0b3e-c8cb-411f-a380-25247f3ac55e tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.349s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:48 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-e18b0b3e-c8cb-411f-a380-25247f3ac55e tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:48:48 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-e18b0b3e-c8cb-411f-a380-25247f3ac55e tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Deleted volume successfully. Jul 28 10:48:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e18b0b3e-c8cb-411f-a380-25247f3ac55e tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "cinder-02da5e75-41e4-4f35-a9a6-025289f77a96-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:48:48 devstack sudo[102487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-de9a19c5-2457-4345-aafc-6ce6764535a5 Jul 28 10:48:48 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:48 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-68a39c4f-e51b-4d3e-9a6a-0e04a26192d1 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-de9a19c5-2457-4345-aafc-6ce6764535a5" returned: 0 in 0.502s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-68a39c4f-e51b-4d3e-9a6a-0e04a26192d1 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-de9a19c5-2457-4345-aafc-6ce6764535a5 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:48 devstack sudo[102492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-de9a19c5-2457-4345-aafc-6ce6764535a5 Jul 28 10:48:48 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:48 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-68a39c4f-e51b-4d3e-9a6a-0e04a26192d1 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-de9a19c5-2457-4345-aafc-6ce6764535a5" returned: 0 in 0.266s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-68a39c4f-e51b-4d3e-9a6a-0e04a26192d1 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "cinder-quobyte-de9a19c5-2457-4345-aafc-6ce6764535a5" released by "delete_volume" :: held 0.829s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:48:48 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-68a39c4f-e51b-4d3e-9a6a-0e04a26192d1 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Created reservations ['389f776d-c496-44e8-a26f-5d963071facc', '8e4d5670-8042-4893-a652-7c671851aa5e', '142a214e-8011-4e42-834a-0d4cf8405edc', 'df85e123-00a1-4884-b602-bbaa0473f7e4'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:48:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-68a39c4f-e51b-4d3e-9a6a-0e04a26192d1 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:48:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-68a39c4f-e51b-4d3e-9a6a-0e04a26192d1 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:48:48 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-68a39c4f-e51b-4d3e-9a6a-0e04a26192d1 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:48:48 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-68a39c4f-e51b-4d3e-9a6a-0e04a26192d1 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:48:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-68a39c4f-e51b-4d3e-9a6a-0e04a26192d1 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:48:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-68a39c4f-e51b-4d3e-9a6a-0e04a26192d1 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:48 devstack sudo[102495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:48:48 devstack sudo[102495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:49 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-516de574-903c-4ce3-9003-33d3391f6e06 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Acquiring lock "cinder-fef3a718-1b87-4737-853e-0188747c8d94-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:48:49 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-516de574-903c-4ce3-9003-33d3391f6e06 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "cinder-fef3a718-1b87-4737-853e-0188747c8d94-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:48:49 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-516de574-903c-4ce3-9003-33d3391f6e06 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Acquiring lock "cinder-quobyte-fef3a718-1b87-4737-853e-0188747c8d94" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:48:49 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-516de574-903c-4ce3-9003-33d3391f6e06 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "cinder-quobyte-fef3a718-1b87-4737-853e-0188747c8d94" acquired by "delete_volume" :: waited 0.018s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:48:49 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[123f9d71-f5e3-46e2-855d-ae61b34ca565]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:48:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-516de574-903c-4ce3-9003-33d3391f6e06 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-fef3a718-1b87-4737-853e-0188747c8d94 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:49 devstack sudo[102495]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-68a39c4f-e51b-4d3e-9a6a-0e04a26192d1 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.374s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:49 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-68a39c4f-e51b-4d3e-9a6a-0e04a26192d1 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:48:49 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-68a39c4f-e51b-4d3e-9a6a-0e04a26192d1 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Deleted volume successfully. Jul 28 10:48:49 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-68a39c4f-e51b-4d3e-9a6a-0e04a26192d1 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "cinder-de9a19c5-2457-4345-aafc-6ce6764535a5-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:48:49 devstack sudo[102498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-fef3a718-1b87-4737-853e-0188747c8d94 Jul 28 10:48:49 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:49 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-516de574-903c-4ce3-9003-33d3391f6e06 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-fef3a718-1b87-4737-853e-0188747c8d94" returned: 0 in 0.433s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-516de574-903c-4ce3-9003-33d3391f6e06 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-fef3a718-1b87-4737-853e-0188747c8d94 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:49 devstack sudo[102503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-fef3a718-1b87-4737-853e-0188747c8d94 Jul 28 10:48:49 devstack sudo[102503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:49 devstack sudo[102503]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-516de574-903c-4ce3-9003-33d3391f6e06 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-fef3a718-1b87-4737-853e-0188747c8d94" returned: 0 in 0.275s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:49 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-516de574-903c-4ce3-9003-33d3391f6e06 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "cinder-quobyte-fef3a718-1b87-4737-853e-0188747c8d94" released by "delete_volume" :: held 0.765s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:48:50 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-516de574-903c-4ce3-9003-33d3391f6e06 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Created reservations ['e9f1850f-85a0-4155-9458-0f70f2148626', '904957af-dab3-4725-849d-a6fc5e65d04f', '92a1f760-46f6-4acc-bed4-c77285810907', '4409faed-9f65-4e86-8ffe-8550235889dc'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:48:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-516de574-903c-4ce3-9003-33d3391f6e06 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:48:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-516de574-903c-4ce3-9003-33d3391f6e06 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:48:50 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-516de574-903c-4ce3-9003-33d3391f6e06 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:48:50 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-516de574-903c-4ce3-9003-33d3391f6e06 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:48:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-516de574-903c-4ce3-9003-33d3391f6e06 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:48:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-516de574-903c-4ce3-9003-33d3391f6e06 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:50 devstack sudo[102507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:48:50 devstack sudo[102507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-913dabb7-a597-4569-a7c3-27b42dbc346d tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Acquiring lock "cinder-454f0882-e9d3-4498-99b4-e1f650c96d4e-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:48:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-913dabb7-a597-4569-a7c3-27b42dbc346d tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "cinder-454f0882-e9d3-4498-99b4-e1f650c96d4e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:48:50 devstack sudo[102507]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-516de574-903c-4ce3-9003-33d3391f6e06 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.278s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:50 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-516de574-903c-4ce3-9003-33d3391f6e06 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:48:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-913dabb7-a597-4569-a7c3-27b42dbc346d tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Acquiring lock "cinder-quobyte-454f0882-e9d3-4498-99b4-e1f650c96d4e" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:48:50 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-516de574-903c-4ce3-9003-33d3391f6e06 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Deleted volume successfully. Jul 28 10:48:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-913dabb7-a597-4569-a7c3-27b42dbc346d tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "cinder-quobyte-454f0882-e9d3-4498-99b4-e1f650c96d4e" acquired by "delete_volume" :: waited 0.041s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:48:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-516de574-903c-4ce3-9003-33d3391f6e06 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "cinder-fef3a718-1b87-4737-853e-0188747c8d94-delete_volume" released by "delete_volume" :: held 1.327s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:48:50 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad5456d-5f30-471f-beb2-ff719c234524]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:48:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-913dabb7-a597-4569-a7c3-27b42dbc346d tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-454f0882-e9d3-4498-99b4-e1f650c96d4e {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:50 devstack sudo[102510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-454f0882-e9d3-4498-99b4-e1f650c96d4e Jul 28 10:48:50 devstack sudo[102510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:50 devstack sudo[102510]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-913dabb7-a597-4569-a7c3-27b42dbc346d tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-454f0882-e9d3-4498-99b4-e1f650c96d4e" returned: 0 in 0.384s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-913dabb7-a597-4569-a7c3-27b42dbc346d tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-454f0882-e9d3-4498-99b4-e1f650c96d4e {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:50 devstack sudo[102515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-454f0882-e9d3-4498-99b4-e1f650c96d4e Jul 28 10:48:50 devstack sudo[102515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:51 devstack sudo[102515]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-913dabb7-a597-4569-a7c3-27b42dbc346d tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-454f0882-e9d3-4498-99b4-e1f650c96d4e" returned: 0 in 0.259s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-913dabb7-a597-4569-a7c3-27b42dbc346d tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "cinder-quobyte-454f0882-e9d3-4498-99b4-e1f650c96d4e" released by "delete_volume" :: held 0.700s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:48:51 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-913dabb7-a597-4569-a7c3-27b42dbc346d tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Created reservations ['2175f2db-7c8f-4503-a0da-907cecf9bfac', '3d2e93fd-2515-4b73-8496-9f221417804e', '6711c67e-95f9-40da-b4c8-da3236fcf637', '362bcb3d-20bf-4ae1-8891-d20155513114'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:48:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-913dabb7-a597-4569-a7c3-27b42dbc346d tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:48:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-913dabb7-a597-4569-a7c3-27b42dbc346d tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:48:51 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-913dabb7-a597-4569-a7c3-27b42dbc346d tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:48:51 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-913dabb7-a597-4569-a7c3-27b42dbc346d tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:48:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-913dabb7-a597-4569-a7c3-27b42dbc346d tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:48:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-913dabb7-a597-4569-a7c3-27b42dbc346d tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:51 devstack sudo[102518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:48:51 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-64b1c865-1d54-4897-8a12-5a645097664e tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Acquiring lock "cinder-9b07165f-fb9f-49a3-90a4-478485a282e0-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:48:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-64b1c865-1d54-4897-8a12-5a645097664e tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "cinder-9b07165f-fb9f-49a3-90a4-478485a282e0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:48:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-64b1c865-1d54-4897-8a12-5a645097664e tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Acquiring lock "cinder-quobyte-9b07165f-fb9f-49a3-90a4-478485a282e0" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:48:51 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-913dabb7-a597-4569-a7c3-27b42dbc346d tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.266s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:51 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-913dabb7-a597-4569-a7c3-27b42dbc346d tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:48:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-64b1c865-1d54-4897-8a12-5a645097664e tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "cinder-quobyte-9b07165f-fb9f-49a3-90a4-478485a282e0" acquired by "delete_volume" :: waited 0.022s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:48:51 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-913dabb7-a597-4569-a7c3-27b42dbc346d tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Deleted volume successfully. Jul 28 10:48:51 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bc3fe0-24f6-4c74-9545-4a091a712ba6]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:48:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-64b1c865-1d54-4897-8a12-5a645097664e tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9b07165f-fb9f-49a3-90a4-478485a282e0 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-913dabb7-a597-4569-a7c3-27b42dbc346d tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "cinder-454f0882-e9d3-4498-99b4-e1f650c96d4e-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:48:51 devstack sudo[102521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9b07165f-fb9f-49a3-90a4-478485a282e0 Jul 28 10:48:51 devstack sudo[102521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:52 devstack sudo[102521]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-64b1c865-1d54-4897-8a12-5a645097664e tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9b07165f-fb9f-49a3-90a4-478485a282e0" returned: 0 in 0.435s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-64b1c865-1d54-4897-8a12-5a645097664e tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9b07165f-fb9f-49a3-90a4-478485a282e0 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:52 devstack sudo[102526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9b07165f-fb9f-49a3-90a4-478485a282e0 Jul 28 10:48:52 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:52 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-64b1c865-1d54-4897-8a12-5a645097664e tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9b07165f-fb9f-49a3-90a4-478485a282e0" returned: 0 in 0.275s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:52 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-64b1c865-1d54-4897-8a12-5a645097664e tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "cinder-quobyte-9b07165f-fb9f-49a3-90a4-478485a282e0" released by "delete_volume" :: held 0.761s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:48:52 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-64b1c865-1d54-4897-8a12-5a645097664e tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Created reservations ['9c049a73-1d28-4fba-a766-d702d5ced6b0', 'bc671499-3032-4c0e-9c07-a95c925fd12e', '4a5c7c3c-c013-428f-af96-26100efbb4e6', '63c6c4f6-8d96-4275-951f-7f3a540ed74a'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:48:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-64b1c865-1d54-4897-8a12-5a645097664e tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:48:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-64b1c865-1d54-4897-8a12-5a645097664e tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:48:52 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-64b1c865-1d54-4897-8a12-5a645097664e tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:48:52 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-64b1c865-1d54-4897-8a12-5a645097664e tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:48:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-64b1c865-1d54-4897-8a12-5a645097664e tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:48:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-64b1c865-1d54-4897-8a12-5a645097664e tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:52 devstack sudo[102529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:48:52 devstack sudo[102529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:52 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e428c1ba-cc26-4c77-b409-0e060869a141 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Acquiring lock "cinder-d17e4b7c-b1fb-4d2e-bd88-ae9637263d3c-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:48:52 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e428c1ba-cc26-4c77-b409-0e060869a141 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "cinder-d17e4b7c-b1fb-4d2e-bd88-ae9637263d3c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:48:52 devstack sudo[102529]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-64b1c865-1d54-4897-8a12-5a645097664e tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.244s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:52 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-64b1c865-1d54-4897-8a12-5a645097664e tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:48:52 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-64b1c865-1d54-4897-8a12-5a645097664e tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Deleted volume successfully. Jul 28 10:48:52 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-64b1c865-1d54-4897-8a12-5a645097664e tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "cinder-9b07165f-fb9f-49a3-90a4-478485a282e0-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:48:52 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e428c1ba-cc26-4c77-b409-0e060869a141 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Acquiring lock "cinder-quobyte-d17e4b7c-b1fb-4d2e-bd88-ae9637263d3c" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:48:52 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e428c1ba-cc26-4c77-b409-0e060869a141 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "cinder-quobyte-d17e4b7c-b1fb-4d2e-bd88-ae9637263d3c" acquired by "delete_volume" :: waited 0.018s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:48:52 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b688fa-6f15-48a3-bcb4-9f54e8896fdd]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:48:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e428c1ba-cc26-4c77-b409-0e060869a141 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d17e4b7c-b1fb-4d2e-bd88-ae9637263d3c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:52 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d17e4b7c-b1fb-4d2e-bd88-ae9637263d3c Jul 28 10:48:52 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:53 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e428c1ba-cc26-4c77-b409-0e060869a141 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d17e4b7c-b1fb-4d2e-bd88-ae9637263d3c" returned: 0 in 0.384s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e428c1ba-cc26-4c77-b409-0e060869a141 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d17e4b7c-b1fb-4d2e-bd88-ae9637263d3c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:53 devstack sudo[102537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d17e4b7c-b1fb-4d2e-bd88-ae9637263d3c Jul 28 10:48:53 devstack sudo[102537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:53 devstack sudo[102537]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e428c1ba-cc26-4c77-b409-0e060869a141 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d17e4b7c-b1fb-4d2e-bd88-ae9637263d3c" returned: 0 in 0.250s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:53 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e428c1ba-cc26-4c77-b409-0e060869a141 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "cinder-quobyte-d17e4b7c-b1fb-4d2e-bd88-ae9637263d3c" released by "delete_volume" :: held 0.679s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:48:53 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:UPDATE=114,cinder:SELECT=90,cinder:DELETE=11,cinder:INSERT=32 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:48:53 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-e428c1ba-cc26-4c77-b409-0e060869a141 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Created reservations ['4f7406d3-4b8c-4392-9d63-19eb740fb3d7', '4e8b5bc0-e902-4565-9ca9-77f86564ca8d', 'ab9ea926-3810-4b18-91af-5bfd6a576b46', 'ec002f47-17bc-4266-9518-f992060e3d90'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:48:53 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=89,cinder:INSERT=31,cinder:UPDATE=112,cinder:DELETE=9 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:48:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e428c1ba-cc26-4c77-b409-0e060869a141 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:48:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e428c1ba-cc26-4c77-b409-0e060869a141 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:48:53 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e428c1ba-cc26-4c77-b409-0e060869a141 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:48:53 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-e428c1ba-cc26-4c77-b409-0e060869a141 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:48:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-e428c1ba-cc26-4c77-b409-0e060869a141 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:48:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e428c1ba-cc26-4c77-b409-0e060869a141 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:53 devstack sudo[102540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:48:53 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:53 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e428c1ba-cc26-4c77-b409-0e060869a141 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.267s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:53 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-e428c1ba-cc26-4c77-b409-0e060869a141 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:48:53 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-e428c1ba-cc26-4c77-b409-0e060869a141 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Deleted volume successfully. Jul 28 10:48:53 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e428c1ba-cc26-4c77-b409-0e060869a141 tempest-CreateVolumesFromSourceVolumeTest-1266629174 None] Lock "cinder-d17e4b7c-b1fb-4d2e-bd88-ae9637263d3c-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:48:56 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cdc4ae5-6981-4c00-8783-1c18223b3865 tempest-VolumeDependencyTests-2085055242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:48:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1cdc4ae5-6981-4c00-8783-1c18223b3865 tempest-VolumeDependencyTests-2085055242 None] Flow 'volume_create_manager' (42df8585-8822-4a0a-9fb6-a1cb1b48c1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:48:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1cdc4ae5-6981-4c00-8783-1c18223b3865 tempest-VolumeDependencyTests-2085055242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c814c71-cf7c-4a94-8f58-138a3383aa16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1cdc4ae5-6981-4c00-8783-1c18223b3865 tempest-VolumeDependencyTests-2085055242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c814c71-cf7c-4a94-8f58-138a3383aa16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1474055745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaa088fc-1a60-4503-86c0-0c36367342d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27075b88b74248d3b560a1a60eefea50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:48:57Z,use_quota=True,user_id='cf111bc2b0aa461993fb4f7afd65aef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1cdc4ae5-6981-4c00-8783-1c18223b3865 tempest-VolumeDependencyTests-2085055242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (505fb381-86f4-499d-b637-a6f756225863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1cdc4ae5-6981-4c00-8783-1c18223b3865 tempest-VolumeDependencyTests-2085055242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (505fb381-86f4-499d-b637-a6f756225863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1cdc4ae5-6981-4c00-8783-1c18223b3865 tempest-VolumeDependencyTests-2085055242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f9df050-01e2-4ed9-b2f8-2db8ee9a0928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1cdc4ae5-6981-4c00-8783-1c18223b3865 tempest-VolumeDependencyTests-2085055242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f9df050-01e2-4ed9-b2f8-2db8ee9a0928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaa088fc-1a60-4503-86c0-0c36367342d1', 'volume_name': 'volume-eaa088fc-1a60-4503-86c0-0c36367342d1', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1cdc4ae5-6981-4c00-8783-1c18223b3865 tempest-VolumeDependencyTests-2085055242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06d58242-65e3-4fb1-b391-40a86b130769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1cdc4ae5-6981-4c00-8783-1c18223b3865 tempest-VolumeDependencyTests-2085055242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06d58242-65e3-4fb1-b391-40a86b130769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1cdc4ae5-6981-4c00-8783-1c18223b3865 tempest-VolumeDependencyTests-2085055242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02d3dbdd-bed0-4998-8943-df86578f6885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:57 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-1cdc4ae5-6981-4c00-8783-1c18223b3865 tempest-VolumeDependencyTests-2085055242 None] Volume eaa088fc-1a60-4503-86c0-0c36367342d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaa088fc-1a60-4503-86c0-0c36367342d1', 'volume_size': 1} Jul 28 10:48:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1cdc4ae5-6981-4c00-8783-1c18223b3865 tempest-VolumeDependencyTests-2085055242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:48:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1cdc4ae5-6981-4c00-8783-1c18223b3865 tempest-VolumeDependencyTests-2085055242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:48:57 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-1cdc4ae5-6981-4c00-8783-1c18223b3865 tempest-VolumeDependencyTests-2085055242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1474055745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaa088fc-1a60-4503-86c0-0c36367342d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27075b88b74248d3b560a1a60eefea50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:48:57Z,use_quota=True,user_id='cf111bc2b0aa461993fb4f7afd65aef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:48:57 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-1cdc4ae5-6981-4c00-8783-1c18223b3865 tempest-VolumeDependencyTests-2085055242 None] Creating volume eaa088fc-1a60-4503-86c0-0c36367342d1 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:48:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1cdc4ae5-6981-4c00-8783-1c18223b3865 tempest-VolumeDependencyTests-2085055242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:48:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1cdc4ae5-6981-4c00-8783-1c18223b3865 tempest-VolumeDependencyTests-2085055242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:48:57 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-1cdc4ae5-6981-4c00-8783-1c18223b3865 tempest-VolumeDependencyTests-2085055242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:48:57 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-1cdc4ae5-6981-4c00-8783-1c18223b3865 tempest-VolumeDependencyTests-2085055242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:48:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1cdc4ae5-6981-4c00-8783-1c18223b3865 tempest-VolumeDependencyTests-2085055242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:48:57 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-1cdc4ae5-6981-4c00-8783-1c18223b3865 tempest-VolumeDependencyTests-2085055242 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:48:57 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-1cdc4ae5-6981-4c00-8783-1c18223b3865 tempest-VolumeDependencyTests-2085055242 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:48:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1cdc4ae5-6981-4c00-8783-1c18223b3865 tempest-VolumeDependencyTests-2085055242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:57 devstack sudo[102543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1 1073741824 Jul 28 10:48:57 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:57 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1cdc4ae5-6981-4c00-8783-1c18223b3865 tempest-VolumeDependencyTests-2085055242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1 1073741824" returned: 0 in 0.434s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1cdc4ae5-6981-4c00-8783-1c18223b3865 tempest-VolumeDependencyTests-2085055242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:57 devstack sudo[102548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1 Jul 28 10:48:57 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:57 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1cdc4ae5-6981-4c00-8783-1c18223b3865 tempest-VolumeDependencyTests-2085055242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1" returned: 0 in 0.276s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:57 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-1cdc4ae5-6981-4c00-8783-1c18223b3865 tempest-VolumeDependencyTests-2085055242 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:48:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1cdc4ae5-6981-4c00-8783-1c18223b3865 tempest-VolumeDependencyTests-2085055242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:48:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1cdc4ae5-6981-4c00-8783-1c18223b3865 tempest-VolumeDependencyTests-2085055242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02d3dbdd-bed0-4998-8943-df86578f6885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaa088fc-1a60-4503-86c0-0c36367342d1', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1cdc4ae5-6981-4c00-8783-1c18223b3865 tempest-VolumeDependencyTests-2085055242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c69bd7c-698a-40ae-9003-2c02b11c5bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:48:57 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-1cdc4ae5-6981-4c00-8783-1c18223b3865 tempest-VolumeDependencyTests-2085055242 None] Volume volume-eaa088fc-1a60-4503-86c0-0c36367342d1 (eaa088fc-1a60-4503-86c0-0c36367342d1): created successfully Jul 28 10:48:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1cdc4ae5-6981-4c00-8783-1c18223b3865 tempest-VolumeDependencyTests-2085055242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c69bd7c-698a-40ae-9003-2c02b11c5bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:48:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1cdc4ae5-6981-4c00-8783-1c18223b3865 tempest-VolumeDependencyTests-2085055242 None] Flow 'volume_create_manager' (42df8585-8822-4a0a-9fb6-a1cb1b48c1e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:48:57 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-1cdc4ae5-6981-4c00-8783-1c18223b3865 tempest-VolumeDependencyTests-2085055242 None] Created volume successfully. Jul 28 10:48:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0a630040-128c-49ca-b7a4-b8e38187553a tempest-VolumeDependencyTests-2085055242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:48:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0a630040-128c-49ca-b7a4-b8e38187553a tempest-VolumeDependencyTests-2085055242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:48:58 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-0a630040-128c-49ca-b7a4-b8e38187553a tempest-VolumeDependencyTests-2085055242 None] Creating offline snapshot 18ff0068-b730-4387-b2b5-65be2550be93 of volume eaa088fc-1a60-4503-86c0-0c36367342d1 {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:48:58 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6a7edb-38f0-4b7c-94df-f7691671b805]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:48:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0a630040-128c-49ca-b7a4-b8e38187553a tempest-VolumeDependencyTests-2085055242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:58 devstack sudo[102554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1 Jul 28 10:48:58 devstack sudo[102554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:58 devstack sudo[102554]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0a630040-128c-49ca-b7a4-b8e38187553a tempest-VolumeDependencyTests-2085055242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1" returned: 0 in 0.403s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0a630040-128c-49ca-b7a4-b8e38187553a tempest-VolumeDependencyTests-2085055242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1.18ff0068-b730-4387-b2b5-65be2550be93 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:58 devstack sudo[102561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1.18ff0068-b730-4387-b2b5-65be2550be93 1G Jul 28 10:48:58 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:59 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0a630040-128c-49ca-b7a4-b8e38187553a tempest-VolumeDependencyTests-2085055242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1.18ff0068-b730-4387-b2b5-65be2550be93 1G" returned: 0 in 0.622s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0a630040-128c-49ca-b7a4-b8e38187553a tempest-VolumeDependencyTests-2085055242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaa088fc-1a60-4503-86c0-0c36367342d1 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1.18ff0068-b730-4387-b2b5-65be2550be93 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:59 devstack sudo[102567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaa088fc-1a60-4503-86c0-0c36367342d1 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1.18ff0068-b730-4387-b2b5-65be2550be93 Jul 28 10:48:59 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:59 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0a630040-128c-49ca-b7a4-b8e38187553a tempest-VolumeDependencyTests-2085055242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaa088fc-1a60-4503-86c0-0c36367342d1 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1.18ff0068-b730-4387-b2b5-65be2550be93" returned: 0 in 0.355s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:48:59 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-0a630040-128c-49ca-b7a4-b8e38187553a tempest-VolumeDependencyTests-2085055242 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1.18ff0068-b730-4387-b2b5-65be2550be93 is being set with open permissions: ugo+rw Jul 28 10:48:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0a630040-128c-49ca-b7a4-b8e38187553a tempest-VolumeDependencyTests-2085055242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1.18ff0068-b730-4387-b2b5-65be2550be93 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:48:59 devstack sudo[102572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1.18ff0068-b730-4387-b2b5-65be2550be93 Jul 28 10:48:59 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:48:59 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root Jul 28 10:48:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0a630040-128c-49ca-b7a4-b8e38187553a tempest-VolumeDependencyTests-2085055242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1.18ff0068-b730-4387-b2b5-65be2550be93" returned: 0 in 0.337s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:49:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0a630040-128c-49ca-b7a4-b8e38187553a tempest-VolumeDependencyTests-2085055242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:49:00 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1.info Jul 28 10:49:00 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:49:00 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Jul 28 10:49:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0a630040-128c-49ca-b7a4-b8e38187553a tempest-VolumeDependencyTests-2085055242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1.info" returned: 0 in 0.310s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:49:00 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-0a630040-128c-49ca-b7a4-b8e38187553a tempest-VolumeDependencyTests-2085055242 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1.info is being set with open permissions: ugo+rw Jul 28 10:49:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0a630040-128c-49ca-b7a4-b8e38187553a tempest-VolumeDependencyTests-2085055242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:49:00 devstack sudo[102581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1.info Jul 28 10:49:00 devstack sudo[102581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:49:00 devstack sudo[102581]: pam_unix(sudo:session): session closed for user root Jul 28 10:49:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0a630040-128c-49ca-b7a4-b8e38187553a tempest-VolumeDependencyTests-2085055242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1.info" returned: 0 in 0.301s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:49:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0a630040-128c-49ca-b7a4-b8e38187553a tempest-VolumeDependencyTests-2085055242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.463s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:49:00 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-0a630040-128c-49ca-b7a4-b8e38187553a tempest-VolumeDependencyTests-2085055242 None] Create snapshot completed successfully Jul 28 10:49:02 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:49:02 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Flow 'volume_create_manager' (2cc3d3a6-09c8-4d27-9812-2b5f2d66c34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:49:02 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b7b3aaa-33f2-4959-99a5-5140b689df86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:49:02 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b7b3aaa-33f2-4959-99a5-5140b689df86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:49:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-849548515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeba6fff-5ff1-4dc0-9241-2272d5aba451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27075b88b74248d3b560a1a60eefea50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=18ff0068-b730-4387-b2b5-65be2550be93,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:49:02Z,use_quota=True,user_id='cf111bc2b0aa461993fb4f7afd65aef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:49:02 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (071ef38a-1aca-40ca-923e-d6b6db95446c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:49:02 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (071ef38a-1aca-40ca-923e-d6b6db95446c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:49:02 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30270bdc-d3ee-4902-bb06-67cf9de7e1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:49:02 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30270bdc-d3ee-4902-bb06-67cf9de7e1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'aeba6fff-5ff1-4dc0-9241-2272d5aba451', 'volume_name': 'volume-aeba6fff-5ff1-4dc0-9241-2272d5aba451', 'volume_size': 1, 'snapshot_id': '18ff0068-b730-4387-b2b5-65be2550be93'}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:49:02 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a1b38a6-0e13-40f8-adc1-8bc5662df469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:49:02 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a1b38a6-0e13-40f8-adc1-8bc5662df469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:49:02 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d93d602-9ead-49ae-ab44-fc43958dc342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:49:02 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Volume aeba6fff-5ff1-4dc0-9241-2272d5aba451: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-aeba6fff-5ff1-4dc0-9241-2272d5aba451', 'volume_size': 1, 'snapshot_id': '18ff0068-b730-4387-b2b5-65be2550be93'} Jul 28 10:49:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:49:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:49:02 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Acquiring lock "cinder-quobyte-18ff0068-b730-4387-b2b5-65be2550be93-aeba6fff-5ff1-4dc0-9241-2272d5aba451" by "_create_volume_from_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:49:02 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Lock "cinder-quobyte-18ff0068-b730-4387-b2b5-65be2550be93-aeba6fff-5ff1-4dc0-9241-2272d5aba451" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:49:02 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Creating volume aeba6fff-5ff1-4dc0-9241-2272d5aba451 from snapshot 18ff0068-b730-4387-b2b5-65be2550be93 {{(pid=88413) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 28 10:49:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:49:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:49:02 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:49:02 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:49:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:49:02 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:49:02 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Acquiring lock "cinder-quobyte-aeba6fff-5ff1-4dc0-9241-2272d5aba451" by "_copy_volume_from_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:49:02 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Lock "cinder-quobyte-aeba6fff-5ff1-4dc0-9241-2272d5aba451" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:49:02 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] snapshot: 18ff0068-b730-4387-b2b5-65be2550be93, volume: aeba6fff-5ff1-4dc0-9241-2272d5aba451, {{(pid=88413) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 28 10:49:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:49:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:49:02 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:49:02 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:49:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:49:02 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fee6cd8-e776-4f4b-91d1-2cb293bd2c7e]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:49:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1.18ff0068-b730-4387-b2b5-65be2550be93 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:49:02 devstack sudo[102586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1.18ff0068-b730-4387-b2b5-65be2550be93 Jul 28 10:49:02 devstack sudo[102586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:49:02 devstack sudo[102586]: pam_unix(sudo:session): session closed for user root Jul 28 10:49:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1.18ff0068-b730-4387-b2b5-65be2550be93" returned: 0 in 0.473s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:49:02 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eaa088fc-1a60-4503-86c0-0c36367342d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:49:02 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1 {{(pid=88413) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 28 10:49:02 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Creating direct copy from snapshot {{(pid=88413) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 28 10:49:02 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[132b3fd3-27e3-49c8-a5ca-70f373566279]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:49:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:49:03 devstack sudo[102591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1 Jul 28 10:49:03 devstack sudo[102591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:49:03 devstack sudo[102591]: pam_unix(sudo:session): session closed for user root Jul 28 10:49:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1" returned: 0 in 0.514s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:49:03 devstack cinder-volume[88413]: DEBUG cinder.utils [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Path /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeba6fff-5ff1-4dc0-9241-2272d5aba451 not found in is_blk_device check {{(pid=88413) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 28 10:49:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeba6fff-5ff1-4dc0-9241-2272d5aba451 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:49:03 devstack sudo[102596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeba6fff-5ff1-4dc0-9241-2272d5aba451 Jul 28 10:49:03 devstack sudo[102596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:49:04 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-aee0866d-3691-4c26-8365-9818f2d3c0d9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:49:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aee0866d-3691-4c26-8365-9818f2d3c0d9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Flow 'volume_create_manager' (ab3f0118-e61a-4a81-9c5d-2bbc50290780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:49:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aee0866d-3691-4c26-8365-9818f2d3c0d9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b93f7de-04ea-4fd4-85fd-7f7e14da60c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:49:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aee0866d-3691-4c26-8365-9818f2d3c0d9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b93f7de-04ea-4fd4-85fd-7f7e14da60c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1912702691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ada6cbb-1a99-4cde-8492-61c247286cf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f859f8dde9ea4e4383235ce135d832f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:49:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:49:04Z,use_quota=True,user_id='3ae7da3adf7a4775a5dce4e3d216f80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:49:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aee0866d-3691-4c26-8365-9818f2d3c0d9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b60bf39-8e1d-485c-999a-bbda0d0ba54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:49:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aee0866d-3691-4c26-8365-9818f2d3c0d9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b60bf39-8e1d-485c-999a-bbda0d0ba54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:49:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aee0866d-3691-4c26-8365-9818f2d3c0d9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (423938e8-b41b-463f-87f8-4384d21dc619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:49:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aee0866d-3691-4c26-8365-9818f2d3c0d9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (423938e8-b41b-463f-87f8-4384d21dc619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ada6cbb-1a99-4cde-8492-61c247286cf2', 'volume_name': 'volume-9ada6cbb-1a99-4cde-8492-61c247286cf2', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:49:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aee0866d-3691-4c26-8365-9818f2d3c0d9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fe36684-38e3-4fff-9b6f-5e3a82f21f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:49:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aee0866d-3691-4c26-8365-9818f2d3c0d9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fe36684-38e3-4fff-9b6f-5e3a82f21f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:49:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aee0866d-3691-4c26-8365-9818f2d3c0d9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f0e2609-edb2-4e86-8e8b-84e0971ca14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:49:04 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-aee0866d-3691-4c26-8365-9818f2d3c0d9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Volume 9ada6cbb-1a99-4cde-8492-61c247286cf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ada6cbb-1a99-4cde-8492-61c247286cf2', 'volume_size': 1} Jul 28 10:49:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-aee0866d-3691-4c26-8365-9818f2d3c0d9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:49:05 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-3b8dec09-8bea-46cb-b47a-f5ff6b4d103f req-69ddd1e0-6654-44af-880c-a803da308542 tempest-TestMinimumBasicScenario-1637923331 None] Terminate volume connection completed successfully. Jul 28 10:49:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-3b8dec09-8bea-46cb-b47a-f5ff6b4d103f req-69ddd1e0-6654-44af-880c-a803da308542 tempest-TestMinimumBasicScenario-1637923331 None] Deleting attachment 0aa633f1-e8ef-4603-9c13-04de66112280. {{(pid=88413) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 10:49:05 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-af9f279d-eef2-4e31-ab45-c9e1ad018b0f tempest-TestServerVolumeAttachmentScenario-802127431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:49:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-af9f279d-eef2-4e31-ab45-c9e1ad018b0f tempest-TestServerVolumeAttachmentScenario-802127431 None] Flow 'volume_create_manager' (4ddc740f-6dc5-45b8-bb15-0d06cc5bf8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:49:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-af9f279d-eef2-4e31-ab45-c9e1ad018b0f tempest-TestServerVolumeAttachmentScenario-802127431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81d51dd2-2981-4c7c-88bb-d0560be4d3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:49:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-af9f279d-eef2-4e31-ab45-c9e1ad018b0f tempest-TestServerVolumeAttachmentScenario-802127431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81d51dd2-2981-4c7c-88bb-d0560be4d3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1855595569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb6d9275-5055-4c70-bfb1-3d294506b0ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f859f8dde9ea4e4383235ce135d832f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:49:05Z,use_quota=True,user_id='3ae7da3adf7a4775a5dce4e3d216f80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:49:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-af9f279d-eef2-4e31-ab45-c9e1ad018b0f tempest-TestServerVolumeAttachmentScenario-802127431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7abf7c25-53e9-4431-a391-d7dff914c003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:49:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-af9f279d-eef2-4e31-ab45-c9e1ad018b0f tempest-TestServerVolumeAttachmentScenario-802127431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7abf7c25-53e9-4431-a391-d7dff914c003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:49:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-af9f279d-eef2-4e31-ab45-c9e1ad018b0f tempest-TestServerVolumeAttachmentScenario-802127431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a52ad689-f916-419e-86a8-eea5378e5620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:49:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-af9f279d-eef2-4e31-ab45-c9e1ad018b0f tempest-TestServerVolumeAttachmentScenario-802127431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a52ad689-f916-419e-86a8-eea5378e5620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb6d9275-5055-4c70-bfb1-3d294506b0ab', 'volume_name': 'volume-bb6d9275-5055-4c70-bfb1-3d294506b0ab', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:49:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-af9f279d-eef2-4e31-ab45-c9e1ad018b0f tempest-TestServerVolumeAttachmentScenario-802127431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e007afa-0db7-4718-8159-85833ee64822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:49:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-af9f279d-eef2-4e31-ab45-c9e1ad018b0f tempest-TestServerVolumeAttachmentScenario-802127431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e007afa-0db7-4718-8159-85833ee64822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:49:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-af9f279d-eef2-4e31-ab45-c9e1ad018b0f tempest-TestServerVolumeAttachmentScenario-802127431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57fbccf6-d4ea-48c6-bb77-58fa0e7e509c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:49:05 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-af9f279d-eef2-4e31-ab45-c9e1ad018b0f tempest-TestServerVolumeAttachmentScenario-802127431 None] Volume bb6d9275-5055-4c70-bfb1-3d294506b0ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb6d9275-5055-4c70-bfb1-3d294506b0ab', 'volume_size': 1} Jul 28 10:49:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-af9f279d-eef2-4e31-ab45-c9e1ad018b0f tempest-TestServerVolumeAttachmentScenario-802127431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:49:06 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-553f13fa-b6a7-430a-98e3-458e4dd0fbc4 tempest-TestMinimumBasicScenario-1637923331 None] Acquiring lock "cinder-c0246bbd-7659-4c95-b3a6-1e76292d2bb8-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:49:06 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-553f13fa-b6a7-430a-98e3-458e4dd0fbc4 tempest-TestMinimumBasicScenario-1637923331 None] Lock "cinder-c0246bbd-7659-4c95-b3a6-1e76292d2bb8-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:49:06 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-553f13fa-b6a7-430a-98e3-458e4dd0fbc4 tempest-TestMinimumBasicScenario-1637923331 None] Acquiring lock "cinder-quobyte-c0246bbd-7659-4c95-b3a6-1e76292d2bb8" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:49:07 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-553f13fa-b6a7-430a-98e3-458e4dd0fbc4 tempest-TestMinimumBasicScenario-1637923331 None] Lock "cinder-quobyte-c0246bbd-7659-4c95-b3a6-1e76292d2bb8" acquired by "delete_volume" :: waited 0.033s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:49:07 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[305e9e84-3666-417d-a59c-4ff9db4d8975]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:49:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-553f13fa-b6a7-430a-98e3-458e4dd0fbc4 tempest-TestMinimumBasicScenario-1637923331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c0246bbd-7659-4c95-b3a6-1e76292d2bb8 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:49:07 devstack sudo[102617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c0246bbd-7659-4c95-b3a6-1e76292d2bb8 Jul 28 10:49:07 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:49:07 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root Jul 28 10:49:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-553f13fa-b6a7-430a-98e3-458e4dd0fbc4 tempest-TestMinimumBasicScenario-1637923331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c0246bbd-7659-4c95-b3a6-1e76292d2bb8" returned: 0 in 0.787s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:49:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-553f13fa-b6a7-430a-98e3-458e4dd0fbc4 tempest-TestMinimumBasicScenario-1637923331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c0246bbd-7659-4c95-b3a6-1e76292d2bb8 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:49:07 devstack sudo[102623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c0246bbd-7659-4c95-b3a6-1e76292d2bb8 Jul 28 10:49:07 devstack sudo[102623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:49:08 devstack sudo[102623]: pam_unix(sudo:session): session closed for user root Jul 28 10:49:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-553f13fa-b6a7-430a-98e3-458e4dd0fbc4 tempest-TestMinimumBasicScenario-1637923331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c0246bbd-7659-4c95-b3a6-1e76292d2bb8" returned: 0 in 0.672s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:49:08 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-553f13fa-b6a7-430a-98e3-458e4dd0fbc4 tempest-TestMinimumBasicScenario-1637923331 None] Lock "cinder-quobyte-c0246bbd-7659-4c95-b3a6-1e76292d2bb8" released by "delete_volume" :: held 1.575s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:49:08 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-553f13fa-b6a7-430a-98e3-458e4dd0fbc4 tempest-TestMinimumBasicScenario-1637923331 None] Created reservations ['15477316-5b78-418a-a969-d36bf845b487', '2017a55a-0cb6-4979-9044-593db1e404e9', '22388e9f-2ff4-4256-8ef5-62b1cf402559', 'a405b264-590e-465c-bd67-7795649b7bdb'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:49:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-553f13fa-b6a7-430a-98e3-458e4dd0fbc4 tempest-TestMinimumBasicScenario-1637923331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:49:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-553f13fa-b6a7-430a-98e3-458e4dd0fbc4 tempest-TestMinimumBasicScenario-1637923331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:49:08 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-553f13fa-b6a7-430a-98e3-458e4dd0fbc4 tempest-TestMinimumBasicScenario-1637923331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:49:08 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-553f13fa-b6a7-430a-98e3-458e4dd0fbc4 tempest-TestMinimumBasicScenario-1637923331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:49:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-553f13fa-b6a7-430a-98e3-458e4dd0fbc4 tempest-TestMinimumBasicScenario-1637923331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:49:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-553f13fa-b6a7-430a-98e3-458e4dd0fbc4 tempest-TestMinimumBasicScenario-1637923331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:49:09 devstack sudo[102626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:49:09 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:49:09 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root Jul 28 10:49:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-553f13fa-b6a7-430a-98e3-458e4dd0fbc4 tempest-TestMinimumBasicScenario-1637923331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.711s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:49:09 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-553f13fa-b6a7-430a-98e3-458e4dd0fbc4 tempest-TestMinimumBasicScenario-1637923331 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:49:09 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-553f13fa-b6a7-430a-98e3-458e4dd0fbc4 tempest-TestMinimumBasicScenario-1637923331 None] Deleted volume successfully. Jul 28 10:49:09 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-553f13fa-b6a7-430a-98e3-458e4dd0fbc4 tempest-TestMinimumBasicScenario-1637923331 None] Lock "cinder-c0246bbd-7659-4c95-b3a6-1e76292d2bb8-delete_volume" released by "delete_volume" :: held 2.974s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:49:10 devstack sudo[102596]: pam_unix(sudo:session): session closed for user root Jul 28 10:49:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeba6fff-5ff1-4dc0-9241-2272d5aba451" returned: 0 in 6.662s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:49:10 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[732f1754-d16d-4670-a9d5-b2757d5e29aa]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:49:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:49:10 devstack sudo[102639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1 Jul 28 10:49:10 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:49:10 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root Jul 28 10:49:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1" returned: 0 in 0.811s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:49:10 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1, size 1024.00 MB, duration 6.66 sec, destination /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeba6fff-5ff1-4dc0-9241-2272d5aba451 {{(pid=88413) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 10:49:10 devstack cinder-volume[88413]: INFO cinder.image.image_utils [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Converted 1024.00 MB image at 153.68 MB/s Jul 28 10:49:10 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeba6fff-5ff1-4dc0-9241-2272d5aba451 is being set with open permissions: ugo+rw Jul 28 10:49:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeba6fff-5ff1-4dc0-9241-2272d5aba451 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:49:10 devstack sudo[102661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeba6fff-5ff1-4dc0-9241-2272d5aba451 Jul 28 10:49:10 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:49:11 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root Jul 28 10:49:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeba6fff-5ff1-4dc0-9241-2272d5aba451" returned: 0 in 0.363s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:49:11 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Lock "cinder-quobyte-aeba6fff-5ff1-4dc0-9241-2272d5aba451" released by "_copy_volume_from_snapshot" :: held 8.974s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:49:11 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Lock "cinder-quobyte-18ff0068-b730-4387-b2b5-65be2550be93-aeba6fff-5ff1-4dc0-9241-2272d5aba451" released by "_create_volume_from_snapshot" :: held 9.020s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:49:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.038s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:49:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-aee0866d-3691-4c26-8365-9818f2d3c0d9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.664s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:49:11 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-aee0866d-3691-4c26-8365-9818f2d3c0d9 tempest-TestServerVolumeAttachmentScenario-802127431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1912702691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ada6cbb-1a99-4cde-8492-61c247286cf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f859f8dde9ea4e4383235ce135d832f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:49:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:49:04Z,use_quota=True,user_id='3ae7da3adf7a4775a5dce4e3d216f80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:49:11 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-aee0866d-3691-4c26-8365-9818f2d3c0d9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Creating volume 9ada6cbb-1a99-4cde-8492-61c247286cf2 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:49:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-aee0866d-3691-4c26-8365-9818f2d3c0d9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:49:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-aee0866d-3691-4c26-8365-9818f2d3c0d9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:49:11 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-aee0866d-3691-4c26-8365-9818f2d3c0d9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:49:11 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-aee0866d-3691-4c26-8365-9818f2d3c0d9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:49:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-aee0866d-3691-4c26-8365-9818f2d3c0d9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:49:11 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-aee0866d-3691-4c26-8365-9818f2d3c0d9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:49:11 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-aee0866d-3691-4c26-8365-9818f2d3c0d9 tempest-TestServerVolumeAttachmentScenario-802127431 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:49:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-aee0866d-3691-4c26-8365-9818f2d3c0d9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9ada6cbb-1a99-4cde-8492-61c247286cf2 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:49:11 devstack sudo[102666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9ada6cbb-1a99-4cde-8492-61c247286cf2 1073741824 Jul 28 10:49:11 devstack sudo[102666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:49:11 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d93d602-9ead-49ae-ab44-fc43958dc342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeba6fff-5ff1-4dc0-9241-2272d5aba451', 'volume_size': 1, 'snapshot_id': '18ff0068-b730-4387-b2b5-65be2550be93'}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:49:11 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30985b8b-43d9-4da7-8c20-9d82651ec5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:49:11 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Volume volume-aeba6fff-5ff1-4dc0-9241-2272d5aba451 (aeba6fff-5ff1-4dc0-9241-2272d5aba451): created successfully Jul 28 10:49:11 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30985b8b-43d9-4da7-8c20-9d82651ec5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:49:11 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Flow 'volume_create_manager' (2cc3d3a6-09c8-4d27-9812-2b5f2d66c34d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:49:11 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-4efc2cd4-ab2a-4192-9ceb-a15c72eb0122 tempest-VolumeDependencyTests-2085055242 None] Created volume successfully. Jul 28 10:49:11 devstack sudo[102666]: pam_unix(sudo:session): session closed for user root Jul 28 10:49:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-aee0866d-3691-4c26-8365-9818f2d3c0d9 tempest-TestServerVolumeAttachmentScenario-802127431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9ada6cbb-1a99-4cde-8492-61c247286cf2 1073741824" returned: 0 in 0.548s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:49:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-aee0866d-3691-4c26-8365-9818f2d3c0d9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9ada6cbb-1a99-4cde-8492-61c247286cf2 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:49:11 devstack sudo[102675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9ada6cbb-1a99-4cde-8492-61c247286cf2 Jul 28 10:49:11 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:49:12 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e475deb6-4b46-4107-8288-b89d232bffab tempest-VolumeDependencyTests-2085055242 None] Acquiring lock "cinder-18ff0068-b730-4387-b2b5-65be2550be93-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:49:12 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e475deb6-4b46-4107-8288-b89d232bffab tempest-VolumeDependencyTests-2085055242 None] Lock "cinder-18ff0068-b730-4387-b2b5-65be2550be93-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:49:12 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e475deb6-4b46-4107-8288-b89d232bffab tempest-VolumeDependencyTests-2085055242 None] Acquiring lock "cinder-quobyte-eaa088fc-1a60-4503-86c0-0c36367342d1" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:49:12 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e475deb6-4b46-4107-8288-b89d232bffab tempest-VolumeDependencyTests-2085055242 None] Lock "cinder-quobyte-eaa088fc-1a60-4503-86c0-0c36367342d1" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:49:12 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e475deb6-4b46-4107-8288-b89d232bffab tempest-VolumeDependencyTests-2085055242 None] Acquiring lock "cinder-quobyte-18ff0068-b730-4387-b2b5-65be2550be93" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:49:12 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e475deb6-4b46-4107-8288-b89d232bffab tempest-VolumeDependencyTests-2085055242 None] Lock "cinder-quobyte-18ff0068-b730-4387-b2b5-65be2550be93" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:49:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-e475deb6-4b46-4107-8288-b89d232bffab tempest-VolumeDependencyTests-2085055242 None] Deleting offline snapshot 18ff0068-b730-4387-b2b5-65be2550be93 of volume eaa088fc-1a60-4503-86c0-0c36367342d1 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:49:12 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root Jul 28 10:49:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-e475deb6-4b46-4107-8288-b89d232bffab tempest-VolumeDependencyTests-2085055242 None] snapshot_file for this snap is: volume-eaa088fc-1a60-4503-86c0-0c36367342d1.18ff0068-b730-4387-b2b5-65be2550be93 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:49:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-aee0866d-3691-4c26-8365-9818f2d3c0d9 tempest-TestServerVolumeAttachmentScenario-802127431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9ada6cbb-1a99-4cde-8492-61c247286cf2" returned: 0 in 0.326s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:49:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-aee0866d-3691-4c26-8365-9818f2d3c0d9 tempest-TestServerVolumeAttachmentScenario-802127431 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:49:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-aee0866d-3691-4c26-8365-9818f2d3c0d9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:49:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-af9f279d-eef2-4e31-ab45-c9e1ad018b0f tempest-TestServerVolumeAttachmentScenario-802127431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.467s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:49:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-af9f279d-eef2-4e31-ab45-c9e1ad018b0f tempest-TestServerVolumeAttachmentScenario-802127431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1855595569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb6d9275-5055-4c70-bfb1-3d294506b0ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f859f8dde9ea4e4383235ce135d832f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:49:05Z,use_quota=True,user_id='3ae7da3adf7a4775a5dce4e3d216f80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:49:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-af9f279d-eef2-4e31-ab45-c9e1ad018b0f tempest-TestServerVolumeAttachmentScenario-802127431 None] Creating volume bb6d9275-5055-4c70-bfb1-3d294506b0ab {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:49:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-af9f279d-eef2-4e31-ab45-c9e1ad018b0f tempest-TestServerVolumeAttachmentScenario-802127431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:49:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-af9f279d-eef2-4e31-ab45-c9e1ad018b0f tempest-TestServerVolumeAttachmentScenario-802127431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:49:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-af9f279d-eef2-4e31-ab45-c9e1ad018b0f tempest-TestServerVolumeAttachmentScenario-802127431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:49:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-af9f279d-eef2-4e31-ab45-c9e1ad018b0f tempest-TestServerVolumeAttachmentScenario-802127431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:49:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-af9f279d-eef2-4e31-ab45-c9e1ad018b0f tempest-TestServerVolumeAttachmentScenario-802127431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:49:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-af9f279d-eef2-4e31-ab45-c9e1ad018b0f tempest-TestServerVolumeAttachmentScenario-802127431 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:49:12 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-af9f279d-eef2-4e31-ab45-c9e1ad018b0f tempest-TestServerVolumeAttachmentScenario-802127431 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:49:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-af9f279d-eef2-4e31-ab45-c9e1ad018b0f tempest-TestServerVolumeAttachmentScenario-802127431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-bb6d9275-5055-4c70-bfb1-3d294506b0ab 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:49:12 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecfa383-8dd0-491b-8415-c1f59a91eef7]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:49:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e475deb6-4b46-4107-8288-b89d232bffab tempest-VolumeDependencyTests-2085055242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1.18ff0068-b730-4387-b2b5-65be2550be93 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:49:12 devstack sudo[102678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-bb6d9275-5055-4c70-bfb1-3d294506b0ab 1073741824 Jul 28 10:49:12 devstack sudo[102678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:49:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aee0866d-3691-4c26-8365-9818f2d3c0d9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f0e2609-edb2-4e86-8e8b-84e0971ca14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ada6cbb-1a99-4cde-8492-61c247286cf2', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:49:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aee0866d-3691-4c26-8365-9818f2d3c0d9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11c76122-38e6-4d8e-8c20-d7339fb3afd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:49:12 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-aee0866d-3691-4c26-8365-9818f2d3c0d9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Volume volume-9ada6cbb-1a99-4cde-8492-61c247286cf2 (9ada6cbb-1a99-4cde-8492-61c247286cf2): created successfully Jul 28 10:49:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aee0866d-3691-4c26-8365-9818f2d3c0d9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11c76122-38e6-4d8e-8c20-d7339fb3afd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:49:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aee0866d-3691-4c26-8365-9818f2d3c0d9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Flow 'volume_create_manager' (ab3f0118-e61a-4a81-9c5d-2bbc50290780) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:49:12 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-aee0866d-3691-4c26-8365-9818f2d3c0d9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Created volume successfully. Jul 28 10:49:12 devstack sudo[102679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1.18ff0068-b730-4387-b2b5-65be2550be93 Jul 28 10:49:12 devstack sudo[102679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:49:12 devstack sudo[102679]: pam_unix(sudo:session): session closed for user root Jul 28 10:49:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e475deb6-4b46-4107-8288-b89d232bffab tempest-VolumeDependencyTests-2085055242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1.18ff0068-b730-4387-b2b5-65be2550be93" returned: 0 in 0.510s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:49:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-e475deb6-4b46-4107-8288-b89d232bffab tempest-VolumeDependencyTests-2085055242 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eaa088fc-1a60-4503-86c0-0c36367342d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:49:12 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[520a94eb-c602-4f9b-803e-e99d5fafe879]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:49:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e475deb6-4b46-4107-8288-b89d232bffab tempest-VolumeDependencyTests-2085055242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:49:12 devstack sudo[102678]: pam_unix(sudo:session): session closed for user root Jul 28 10:49:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-af9f279d-eef2-4e31-ab45-c9e1ad018b0f tempest-TestServerVolumeAttachmentScenario-802127431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-bb6d9275-5055-4c70-bfb1-3d294506b0ab 1073741824" returned: 0 in 0.633s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:49:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-af9f279d-eef2-4e31-ab45-c9e1ad018b0f tempest-TestServerVolumeAttachmentScenario-802127431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-bb6d9275-5055-4c70-bfb1-3d294506b0ab {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:49:12 devstack sudo[102690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-bb6d9275-5055-4c70-bfb1-3d294506b0ab Jul 28 10:49:12 devstack sudo[102690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:49:12 devstack sudo[102689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1 Jul 28 10:49:12 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:49:13 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root Jul 28 10:49:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e475deb6-4b46-4107-8288-b89d232bffab tempest-VolumeDependencyTests-2085055242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1" returned: 0 in 0.508s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:49:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e475deb6-4b46-4107-8288-b89d232bffab tempest-VolumeDependencyTests-2085055242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1.18ff0068-b730-4387-b2b5-65be2550be93 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:49:13 devstack sudo[102698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1.18ff0068-b730-4387-b2b5-65be2550be93 Jul 28 10:49:13 devstack sudo[102690]: pam_unix(sudo:session): session closed for user root Jul 28 10:49:13 devstack sudo[102698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:49:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-af9f279d-eef2-4e31-ab45-c9e1ad018b0f tempest-TestServerVolumeAttachmentScenario-802127431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-bb6d9275-5055-4c70-bfb1-3d294506b0ab" returned: 0 in 0.460s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:49:13 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-af9f279d-eef2-4e31-ab45-c9e1ad018b0f tempest-TestServerVolumeAttachmentScenario-802127431 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:49:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-af9f279d-eef2-4e31-ab45-c9e1ad018b0f tempest-TestServerVolumeAttachmentScenario-802127431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:49:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-af9f279d-eef2-4e31-ab45-c9e1ad018b0f tempest-TestServerVolumeAttachmentScenario-802127431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57fbccf6-d4ea-48c6-bb77-58fa0e7e509c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb6d9275-5055-4c70-bfb1-3d294506b0ab', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:49:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-af9f279d-eef2-4e31-ab45-c9e1ad018b0f tempest-TestServerVolumeAttachmentScenario-802127431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65e9d509-6a2e-4249-b54b-45456efebb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:49:13 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-af9f279d-eef2-4e31-ab45-c9e1ad018b0f tempest-TestServerVolumeAttachmentScenario-802127431 None] Volume volume-bb6d9275-5055-4c70-bfb1-3d294506b0ab (bb6d9275-5055-4c70-bfb1-3d294506b0ab): created successfully Jul 28 10:49:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-af9f279d-eef2-4e31-ab45-c9e1ad018b0f tempest-TestServerVolumeAttachmentScenario-802127431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65e9d509-6a2e-4249-b54b-45456efebb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:49:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-af9f279d-eef2-4e31-ab45-c9e1ad018b0f tempest-TestServerVolumeAttachmentScenario-802127431 None] Flow 'volume_create_manager' (4ddc740f-6dc5-45b8-bb15-0d06cc5bf8f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:49:13 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-af9f279d-eef2-4e31-ab45-c9e1ad018b0f tempest-TestServerVolumeAttachmentScenario-802127431 None] Created volume successfully. Jul 28 10:49:13 devstack sudo[102698]: pam_unix(sudo:session): session closed for user root Jul 28 10:49:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e475deb6-4b46-4107-8288-b89d232bffab tempest-VolumeDependencyTests-2085055242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1.18ff0068-b730-4387-b2b5-65be2550be93" returned: 0 in 0.513s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:49:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e475deb6-4b46-4107-8288-b89d232bffab tempest-VolumeDependencyTests-2085055242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1.18ff0068-b730-4387-b2b5-65be2550be93 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:49:13 devstack sudo[102704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1.18ff0068-b730-4387-b2b5-65be2550be93 Jul 28 10:49:13 devstack sudo[102704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:49:14 devstack sudo[102704]: pam_unix(sudo:session): session closed for user root Jul 28 10:49:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e475deb6-4b46-4107-8288-b89d232bffab tempest-VolumeDependencyTests-2085055242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1.18ff0068-b730-4387-b2b5-65be2550be93" returned: 0 in 0.318s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:49:14 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e475deb6-4b46-4107-8288-b89d232bffab tempest-VolumeDependencyTests-2085055242 None] Lock "cinder-quobyte-18ff0068-b730-4387-b2b5-65be2550be93" released by "_delete_snapshot" :: held 2.040s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:49:14 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e475deb6-4b46-4107-8288-b89d232bffab tempest-VolumeDependencyTests-2085055242 None] Lock "cinder-quobyte-eaa088fc-1a60-4503-86c0-0c36367342d1" released by "delete_snapshot" :: held 2.073s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:49:14 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-e475deb6-4b46-4107-8288-b89d232bffab tempest-VolumeDependencyTests-2085055242 None] Created reservations ['fe95b6b0-1f82-4d51-89a6-78b1f54d7e62', '145d0fd0-0ab4-4227-a5c3-880ba5134b45', 'bf83df52-2134-4619-83f2-58e017698d0b', '283fb2ac-8e91-482f-8a0d-ee85d5fe6475'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:49:14 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-e475deb6-4b46-4107-8288-b89d232bffab tempest-VolumeDependencyTests-2085055242 None] Delete snapshot completed successfully. Jul 28 10:49:14 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e475deb6-4b46-4107-8288-b89d232bffab tempest-VolumeDependencyTests-2085055242 None] Lock "cinder-18ff0068-b730-4387-b2b5-65be2550be93-delete_snapshot" released by "delete_snapshot" :: held 2.320s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:49:15 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-44010019-64e4-4f6a-89be-24baee44efdb tempest-VolumeDependencyTests-2085055242 None] Acquiring lock "cinder-eaa088fc-1a60-4503-86c0-0c36367342d1-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:49:15 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-44010019-64e4-4f6a-89be-24baee44efdb tempest-VolumeDependencyTests-2085055242 None] Lock "cinder-eaa088fc-1a60-4503-86c0-0c36367342d1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:49:15 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-44010019-64e4-4f6a-89be-24baee44efdb tempest-VolumeDependencyTests-2085055242 None] Acquiring lock "cinder-quobyte-eaa088fc-1a60-4503-86c0-0c36367342d1" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:49:15 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-44010019-64e4-4f6a-89be-24baee44efdb tempest-VolumeDependencyTests-2085055242 None] Lock "cinder-quobyte-eaa088fc-1a60-4503-86c0-0c36367342d1" acquired by "delete_volume" :: waited 0.016s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:49:15 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[233879c3-9e61-4055-b7ae-3b102cb6e771]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:49:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-44010019-64e4-4f6a-89be-24baee44efdb tempest-VolumeDependencyTests-2085055242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:49:15 devstack sudo[102722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1 Jul 28 10:49:15 devstack sudo[102722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:49:16 devstack sudo[102722]: pam_unix(sudo:session): session closed for user root Jul 28 10:49:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-44010019-64e4-4f6a-89be-24baee44efdb tempest-VolumeDependencyTests-2085055242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1" returned: 0 in 0.493s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:49:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-44010019-64e4-4f6a-89be-24baee44efdb tempest-VolumeDependencyTests-2085055242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:49:16 devstack sudo[102728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1 Jul 28 10:49:16 devstack sudo[102728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:49:16 devstack sudo[102728]: pam_unix(sudo:session): session closed for user root Jul 28 10:49:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-44010019-64e4-4f6a-89be-24baee44efdb tempest-VolumeDependencyTests-2085055242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-eaa088fc-1a60-4503-86c0-0c36367342d1" returned: 0 in 0.397s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:49:16 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-44010019-64e4-4f6a-89be-24baee44efdb tempest-VolumeDependencyTests-2085055242 None] Lock "cinder-quobyte-eaa088fc-1a60-4503-86c0-0c36367342d1" released by "delete_volume" :: held 1.004s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:49:16 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-44010019-64e4-4f6a-89be-24baee44efdb tempest-VolumeDependencyTests-2085055242 None] Created reservations ['42d724d4-5705-4b5f-b395-6335f2b7d6ff', '219ece7b-6ea1-478f-8218-586d16c9233f', 'f756585c-5a8b-49fd-af2d-67f0ce9a90df', 'b3024bb5-741a-478f-9e70-98518568cf55'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:49:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-44010019-64e4-4f6a-89be-24baee44efdb tempest-VolumeDependencyTests-2085055242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:49:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-44010019-64e4-4f6a-89be-24baee44efdb tempest-VolumeDependencyTests-2085055242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:49:16 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-44010019-64e4-4f6a-89be-24baee44efdb tempest-VolumeDependencyTests-2085055242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:49:16 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-44010019-64e4-4f6a-89be-24baee44efdb tempest-VolumeDependencyTests-2085055242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:49:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-44010019-64e4-4f6a-89be-24baee44efdb tempest-VolumeDependencyTests-2085055242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:49:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-44010019-64e4-4f6a-89be-24baee44efdb tempest-VolumeDependencyTests-2085055242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:49:16 devstack sudo[102762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:49:16 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:49:17 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root Jul 28 10:49:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-44010019-64e4-4f6a-89be-24baee44efdb tempest-VolumeDependencyTests-2085055242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.411s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:49:17 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-44010019-64e4-4f6a-89be-24baee44efdb tempest-VolumeDependencyTests-2085055242 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:49:17 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-44010019-64e4-4f6a-89be-24baee44efdb tempest-VolumeDependencyTests-2085055242 None] Deleted volume successfully. Jul 28 10:49:17 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-44010019-64e4-4f6a-89be-24baee44efdb tempest-VolumeDependencyTests-2085055242 None] Lock "cinder-eaa088fc-1a60-4503-86c0-0c36367342d1-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:49:17 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-289f469f-7f9a-4980-bc2d-cec2461bfb48 tempest-VolumeDependencyTests-2085055242 None] Acquiring lock "cinder-aeba6fff-5ff1-4dc0-9241-2272d5aba451-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:49:17 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-289f469f-7f9a-4980-bc2d-cec2461bfb48 tempest-VolumeDependencyTests-2085055242 None] Lock "cinder-aeba6fff-5ff1-4dc0-9241-2272d5aba451-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:49:17 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-289f469f-7f9a-4980-bc2d-cec2461bfb48 tempest-VolumeDependencyTests-2085055242 None] Acquiring lock "cinder-quobyte-aeba6fff-5ff1-4dc0-9241-2272d5aba451" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:49:17 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-289f469f-7f9a-4980-bc2d-cec2461bfb48 tempest-VolumeDependencyTests-2085055242 None] Lock "cinder-quobyte-aeba6fff-5ff1-4dc0-9241-2272d5aba451" acquired by "delete_volume" :: waited 0.020s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:49:17 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d62964-f34b-424d-a343-9170669d55ec]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:49:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-289f469f-7f9a-4980-bc2d-cec2461bfb48 tempest-VolumeDependencyTests-2085055242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeba6fff-5ff1-4dc0-9241-2272d5aba451 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:49:18 devstack sudo[102805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeba6fff-5ff1-4dc0-9241-2272d5aba451 Jul 28 10:49:18 devstack sudo[102805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:49:18 devstack sudo[102805]: pam_unix(sudo:session): session closed for user root Jul 28 10:49:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-289f469f-7f9a-4980-bc2d-cec2461bfb48 tempest-VolumeDependencyTests-2085055242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeba6fff-5ff1-4dc0-9241-2272d5aba451" returned: 0 in 0.502s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:49:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-289f469f-7f9a-4980-bc2d-cec2461bfb48 tempest-VolumeDependencyTests-2085055242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeba6fff-5ff1-4dc0-9241-2272d5aba451 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:49:18 devstack sudo[102827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeba6fff-5ff1-4dc0-9241-2272d5aba451 Jul 28 10:49:18 devstack sudo[102827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:49:18 devstack sudo[102827]: pam_unix(sudo:session): session closed for user root Jul 28 10:49:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-289f469f-7f9a-4980-bc2d-cec2461bfb48 tempest-VolumeDependencyTests-2085055242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aeba6fff-5ff1-4dc0-9241-2272d5aba451" returned: 0 in 0.335s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:49:18 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-289f469f-7f9a-4980-bc2d-cec2461bfb48 tempest-VolumeDependencyTests-2085055242 None] Lock "cinder-quobyte-aeba6fff-5ff1-4dc0-9241-2272d5aba451" released by "delete_volume" :: held 0.899s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:49:18 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-289f469f-7f9a-4980-bc2d-cec2461bfb48 tempest-VolumeDependencyTests-2085055242 None] Created reservations ['0ed51e36-103a-4958-b87c-4de7b099c642', '2c92e60b-1b8b-4d63-91c6-5cf907f548b4', '9f1f884c-02b8-4f5d-9f3c-3bc0cfe60734', 'f4e44fac-ac18-460a-b0ea-6117f8931369'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:49:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-289f469f-7f9a-4980-bc2d-cec2461bfb48 tempest-VolumeDependencyTests-2085055242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:49:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-289f469f-7f9a-4980-bc2d-cec2461bfb48 tempest-VolumeDependencyTests-2085055242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:49:18 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-289f469f-7f9a-4980-bc2d-cec2461bfb48 tempest-VolumeDependencyTests-2085055242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:49:18 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-289f469f-7f9a-4980-bc2d-cec2461bfb48 tempest-VolumeDependencyTests-2085055242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:49:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-289f469f-7f9a-4980-bc2d-cec2461bfb48 tempest-VolumeDependencyTests-2085055242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:49:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-289f469f-7f9a-4980-bc2d-cec2461bfb48 tempest-VolumeDependencyTests-2085055242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:49:19 devstack sudo[102833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:49:19 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:49:19 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root Jul 28 10:49:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-289f469f-7f9a-4980-bc2d-cec2461bfb48 tempest-VolumeDependencyTests-2085055242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.360s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:49:19 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-289f469f-7f9a-4980-bc2d-cec2461bfb48 tempest-VolumeDependencyTests-2085055242 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:49:19 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-289f469f-7f9a-4980-bc2d-cec2461bfb48 tempest-VolumeDependencyTests-2085055242 None] Deleted volume successfully. Jul 28 10:49:19 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-289f469f-7f9a-4980-bc2d-cec2461bfb48 tempest-VolumeDependencyTests-2085055242 None] Lock "cinder-aeba6fff-5ff1-4dc0-9241-2272d5aba451-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:49:28 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:49:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:49:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:49:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:49:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:49:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:49:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:49:28 devstack sudo[102879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:49:28 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:49:28 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root Jul 28 10:49:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.256s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:49:28 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:49:28 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager._thread_info {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:49:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread count: 29 {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 10:49:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread info: [<_MainThread(MainThread, started 137939890385024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 10:49:28 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:UPDATE=46,cinder:DELETE=4,cinder:SELECT=36,cinder:INSERT=11 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:49:29 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:INSERT=11,cinder:UPDATE=53,cinder:SELECT=35,cinder:DELETE=5 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:49:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-7f533e8f-5872-40e4-94fa-f4b9813d65bd req-c246cf16-4ee4-46d2-8402-bd34519b8bfe tempest-TestServerVolumeAttachmentScenario-802127431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:49:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-7f533e8f-5872-40e4-94fa-f4b9813d65bd req-c246cf16-4ee4-46d2-8402-bd34519b8bfe tempest-TestServerVolumeAttachmentScenario-802127431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:49:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-7f533e8f-5872-40e4-94fa-f4b9813d65bd req-c246cf16-4ee4-46d2-8402-bd34519b8bfe tempest-TestServerVolumeAttachmentScenario-802127431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:49:44 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-7f533e8f-5872-40e4-94fa-f4b9813d65bd req-c246cf16-4ee4-46d2-8402-bd34519b8bfe tempest-TestServerVolumeAttachmentScenario-802127431 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7', 'name': 'volume-9ada6cbb-1a99-4cde-8492-61c247286cf2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e10a49ff-1e40-4f4f-84af-91527a96bfc6', 'enforce_multipath': True} {{(pid=88413) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 10:49:44 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-7f533e8f-5872-40e4-94fa-f4b9813d65bd req-c246cf16-4ee4-46d2-8402-bd34519b8bfe tempest-TestServerVolumeAttachmentScenario-802127431 None] attachment_update completed successfully. Jul 28 10:49:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-c9f94b33-c789-4dee-b3ad-2634a8916e66 req-39404483-b727-41fc-8bb5-c19c4ccc7c4c tempest-TestServerVolumeAttachmentScenario-802127431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:49:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-c9f94b33-c789-4dee-b3ad-2634a8916e66 req-39404483-b727-41fc-8bb5-c19c4ccc7c4c tempest-TestServerVolumeAttachmentScenario-802127431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:49:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-c9f94b33-c789-4dee-b3ad-2634a8916e66 req-39404483-b727-41fc-8bb5-c19c4ccc7c4c tempest-TestServerVolumeAttachmentScenario-802127431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:49:49 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-c9f94b33-c789-4dee-b3ad-2634a8916e66 req-39404483-b727-41fc-8bb5-c19c4ccc7c4c tempest-TestServerVolumeAttachmentScenario-802127431 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7', 'name': 'volume-bb6d9275-5055-4c70-bfb1-3d294506b0ab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7dc9725b-25d2-485b-8154-f66b4e820024', 'enforce_multipath': True} {{(pid=88413) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 10:49:49 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-c9f94b33-c789-4dee-b3ad-2634a8916e66 req-39404483-b727-41fc-8bb5-c19c4ccc7c4c tempest-TestServerVolumeAttachmentScenario-802127431 None] attachment_update completed successfully. Jul 28 10:49:52 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-1d3d562c-1bbe-46a4-aa89-bd5186affb5d req-3327a106-3364-4273-9919-d948604d1c1a tempest-TestServerVolumeAttachmentScenario-802127431 None] Terminate volume connection completed successfully. Jul 28 10:49:52 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-1d3d562c-1bbe-46a4-aa89-bd5186affb5d req-3327a106-3364-4273-9919-d948604d1c1a tempest-TestServerVolumeAttachmentScenario-802127431 None] Deleting attachment 7dc9725b-25d2-485b-8154-f66b4e820024. {{(pid=88413) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 10:49:54 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-5f966c3a-1a74-4b45-9ce6-85ed3c909a45 req-26bb1cf4-6d60-4f90-95d2-9bc7b3e7f911 tempest-TestServerVolumeAttachmentScenario-802127431 None] Terminate volume connection completed successfully. Jul 28 10:49:54 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-5f966c3a-1a74-4b45-9ce6-85ed3c909a45 req-26bb1cf4-6d60-4f90-95d2-9bc7b3e7f911 tempest-TestServerVolumeAttachmentScenario-802127431 None] Deleting attachment e10a49ff-1e40-4f4f-84af-91527a96bfc6. {{(pid=88413) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 10:49:59 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-21159b67-c286-4f42-b493-d7a620aecf8d tempest-TestServerVolumeAttachmentScenario-802127431 None] Acquiring lock "cinder-bb6d9275-5055-4c70-bfb1-3d294506b0ab-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:49:59 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-21159b67-c286-4f42-b493-d7a620aecf8d tempest-TestServerVolumeAttachmentScenario-802127431 None] Lock "cinder-bb6d9275-5055-4c70-bfb1-3d294506b0ab-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:49:59 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-21159b67-c286-4f42-b493-d7a620aecf8d tempest-TestServerVolumeAttachmentScenario-802127431 None] Acquiring lock "cinder-quobyte-bb6d9275-5055-4c70-bfb1-3d294506b0ab" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:49:59 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-21159b67-c286-4f42-b493-d7a620aecf8d tempest-TestServerVolumeAttachmentScenario-802127431 None] Lock "cinder-quobyte-bb6d9275-5055-4c70-bfb1-3d294506b0ab" acquired by "delete_volume" :: waited 0.016s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:49:59 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf53389-1769-4d7b-804c-7606dae5655e]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:49:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-21159b67-c286-4f42-b493-d7a620aecf8d tempest-TestServerVolumeAttachmentScenario-802127431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-bb6d9275-5055-4c70-bfb1-3d294506b0ab {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:49:59 devstack sudo[103492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-bb6d9275-5055-4c70-bfb1-3d294506b0ab Jul 28 10:49:59 devstack sudo[103492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:49:59 devstack sudo[103492]: pam_unix(sudo:session): session closed for user root Jul 28 10:49:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-21159b67-c286-4f42-b493-d7a620aecf8d tempest-TestServerVolumeAttachmentScenario-802127431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-bb6d9275-5055-4c70-bfb1-3d294506b0ab" returned: 0 in 0.369s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:49:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-21159b67-c286-4f42-b493-d7a620aecf8d tempest-TestServerVolumeAttachmentScenario-802127431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-bb6d9275-5055-4c70-bfb1-3d294506b0ab {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:49:59 devstack sudo[103497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-bb6d9275-5055-4c70-bfb1-3d294506b0ab Jul 28 10:49:59 devstack sudo[103497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:49:59 devstack sudo[103497]: pam_unix(sudo:session): session closed for user root Jul 28 10:49:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-21159b67-c286-4f42-b493-d7a620aecf8d tempest-TestServerVolumeAttachmentScenario-802127431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-bb6d9275-5055-4c70-bfb1-3d294506b0ab" returned: 0 in 0.267s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:49:59 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-21159b67-c286-4f42-b493-d7a620aecf8d tempest-TestServerVolumeAttachmentScenario-802127431 None] Lock "cinder-quobyte-bb6d9275-5055-4c70-bfb1-3d294506b0ab" released by "delete_volume" :: held 0.693s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:49:59 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-21159b67-c286-4f42-b493-d7a620aecf8d tempest-TestServerVolumeAttachmentScenario-802127431 None] Created reservations ['25ea2a13-862d-494e-8b21-507214c53548', 'ebbf98b0-1a7f-4daf-8d50-29ac479d7f09', 'cce607e2-2e35-454b-ab37-ee071741b037', '52d5e50e-aa4b-4c15-9c7a-6f2f994f2e60'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:49:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-21159b67-c286-4f42-b493-d7a620aecf8d tempest-TestServerVolumeAttachmentScenario-802127431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:49:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-21159b67-c286-4f42-b493-d7a620aecf8d tempest-TestServerVolumeAttachmentScenario-802127431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:49:59 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-21159b67-c286-4f42-b493-d7a620aecf8d tempest-TestServerVolumeAttachmentScenario-802127431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:49:59 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-21159b67-c286-4f42-b493-d7a620aecf8d tempest-TestServerVolumeAttachmentScenario-802127431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:49:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-21159b67-c286-4f42-b493-d7a620aecf8d tempest-TestServerVolumeAttachmentScenario-802127431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:49:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-21159b67-c286-4f42-b493-d7a620aecf8d tempest-TestServerVolumeAttachmentScenario-802127431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:49:59 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:49:59 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:50:00 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Jul 28 10:50:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-21159b67-c286-4f42-b493-d7a620aecf8d tempest-TestServerVolumeAttachmentScenario-802127431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.313s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:50:00 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-21159b67-c286-4f42-b493-d7a620aecf8d tempest-TestServerVolumeAttachmentScenario-802127431 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:50:00 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b8819bf3-6dd1-4afb-9802-90a16b2552a9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Acquiring lock "cinder-9ada6cbb-1a99-4cde-8492-61c247286cf2-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:50:00 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-21159b67-c286-4f42-b493-d7a620aecf8d tempest-TestServerVolumeAttachmentScenario-802127431 None] Deleted volume successfully. Jul 28 10:50:00 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-21159b67-c286-4f42-b493-d7a620aecf8d tempest-TestServerVolumeAttachmentScenario-802127431 None] Lock "cinder-bb6d9275-5055-4c70-bfb1-3d294506b0ab-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:50:00 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b8819bf3-6dd1-4afb-9802-90a16b2552a9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Lock "cinder-9ada6cbb-1a99-4cde-8492-61c247286cf2-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:50:00 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b8819bf3-6dd1-4afb-9802-90a16b2552a9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Acquiring lock "cinder-quobyte-9ada6cbb-1a99-4cde-8492-61c247286cf2" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:50:00 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b8819bf3-6dd1-4afb-9802-90a16b2552a9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Lock "cinder-quobyte-9ada6cbb-1a99-4cde-8492-61c247286cf2" acquired by "delete_volume" :: waited 0.020s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:50:00 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8fa1e4-c180-4bb7-964f-23cdb0501b67]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:50:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b8819bf3-6dd1-4afb-9802-90a16b2552a9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9ada6cbb-1a99-4cde-8492-61c247286cf2 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:50:00 devstack sudo[103504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9ada6cbb-1a99-4cde-8492-61c247286cf2 Jul 28 10:50:00 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:50:00 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root Jul 28 10:50:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b8819bf3-6dd1-4afb-9802-90a16b2552a9 tempest-TestServerVolumeAttachmentScenario-802127431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9ada6cbb-1a99-4cde-8492-61c247286cf2" returned: 0 in 0.371s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:50:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b8819bf3-6dd1-4afb-9802-90a16b2552a9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9ada6cbb-1a99-4cde-8492-61c247286cf2 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:50:00 devstack sudo[103511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9ada6cbb-1a99-4cde-8492-61c247286cf2 Jul 28 10:50:00 devstack sudo[103511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:50:01 devstack sudo[103511]: pam_unix(sudo:session): session closed for user root Jul 28 10:50:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b8819bf3-6dd1-4afb-9802-90a16b2552a9 tempest-TestServerVolumeAttachmentScenario-802127431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9ada6cbb-1a99-4cde-8492-61c247286cf2" returned: 0 in 0.259s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:50:01 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b8819bf3-6dd1-4afb-9802-90a16b2552a9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Lock "cinder-quobyte-9ada6cbb-1a99-4cde-8492-61c247286cf2" released by "delete_volume" :: held 0.682s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:50:01 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-b8819bf3-6dd1-4afb-9802-90a16b2552a9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Created reservations ['ca3e5ca3-b0b1-4ba2-a16a-e90a199bfdcd', 'c0b5c993-1960-4fcb-ba65-961137595610', 'ec646557-5d17-4d4c-987c-a0ef0fd49785', '715742f0-62ed-461e-b66d-eb1e85482f60'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:50:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b8819bf3-6dd1-4afb-9802-90a16b2552a9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:50:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b8819bf3-6dd1-4afb-9802-90a16b2552a9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:50:01 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b8819bf3-6dd1-4afb-9802-90a16b2552a9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:50:01 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b8819bf3-6dd1-4afb-9802-90a16b2552a9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:50:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b8819bf3-6dd1-4afb-9802-90a16b2552a9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:50:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b8819bf3-6dd1-4afb-9802-90a16b2552a9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:50:01 devstack sudo[103514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:50:01 devstack sudo[103514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:50:01 devstack sudo[103514]: pam_unix(sudo:session): session closed for user root Jul 28 10:50:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b8819bf3-6dd1-4afb-9802-90a16b2552a9 tempest-TestServerVolumeAttachmentScenario-802127431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.261s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:50:01 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-b8819bf3-6dd1-4afb-9802-90a16b2552a9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:50:01 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-b8819bf3-6dd1-4afb-9802-90a16b2552a9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Deleted volume successfully. Jul 28 10:50:01 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b8819bf3-6dd1-4afb-9802-90a16b2552a9 tempest-TestServerVolumeAttachmentScenario-802127431 None] Lock "cinder-9ada6cbb-1a99-4cde-8492-61c247286cf2-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:50:11 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=29,cinder:UPDATE=20,cinder:INSERT=3,cinder:DELETE=1 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:50:11 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=21,cinder:UPDATE=18,cinder:INSERT=5,cinder:DELETE=1 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:50:19 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3c072d8-5b4f-4976-87fe-75d8dcd48858 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:50:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f3c072d8-5b4f-4976-87fe-75d8dcd48858 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Flow 'volume_create_manager' (570c69ec-07f2-4403-84a5-8409ed2a1102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:50:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f3c072d8-5b4f-4976-87fe-75d8dcd48858 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67ea9421-217d-4905-8d29-8d4223c62001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:50:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f3c072d8-5b4f-4976-87fe-75d8dcd48858 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67ea9421-217d-4905-8d29-8d4223c62001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-71636130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40a250d9-a790-4f32-93e2-a27a8cae3c19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a85f74a722994b9796f2920aed61e110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:50:19Z,use_quota=True,user_id='85ea3afd3810431c8f4ef73bb0cf0bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:50:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f3c072d8-5b4f-4976-87fe-75d8dcd48858 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4185306a-65ef-4bfb-a613-330b2b806304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:50:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f3c072d8-5b4f-4976-87fe-75d8dcd48858 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4185306a-65ef-4bfb-a613-330b2b806304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:50:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f3c072d8-5b4f-4976-87fe-75d8dcd48858 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a445748-8ec6-46e2-85a3-6dda744bd152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:50:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f3c072d8-5b4f-4976-87fe-75d8dcd48858 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a445748-8ec6-46e2-85a3-6dda744bd152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40a250d9-a790-4f32-93e2-a27a8cae3c19', 'volume_name': 'volume-40a250d9-a790-4f32-93e2-a27a8cae3c19', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:50:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f3c072d8-5b4f-4976-87fe-75d8dcd48858 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c9f277-f7c3-4a96-8c2b-0496586a5e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:50:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f3c072d8-5b4f-4976-87fe-75d8dcd48858 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c9f277-f7c3-4a96-8c2b-0496586a5e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:50:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f3c072d8-5b4f-4976-87fe-75d8dcd48858 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0c494a1-ee41-411b-b6db-78f9704fa414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:50:19 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-f3c072d8-5b4f-4976-87fe-75d8dcd48858 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Volume 40a250d9-a790-4f32-93e2-a27a8cae3c19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40a250d9-a790-4f32-93e2-a27a8cae3c19', 'volume_size': 1} Jul 28 10:50:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f3c072d8-5b4f-4976-87fe-75d8dcd48858 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:50:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f3c072d8-5b4f-4976-87fe-75d8dcd48858 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:50:19 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f3c072d8-5b4f-4976-87fe-75d8dcd48858 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-71636130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40a250d9-a790-4f32-93e2-a27a8cae3c19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a85f74a722994b9796f2920aed61e110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:50:19Z,use_quota=True,user_id='85ea3afd3810431c8f4ef73bb0cf0bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:50:19 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-f3c072d8-5b4f-4976-87fe-75d8dcd48858 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Creating volume 40a250d9-a790-4f32-93e2-a27a8cae3c19 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:50:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f3c072d8-5b4f-4976-87fe-75d8dcd48858 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:50:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f3c072d8-5b4f-4976-87fe-75d8dcd48858 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:50:19 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f3c072d8-5b4f-4976-87fe-75d8dcd48858 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:50:19 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f3c072d8-5b4f-4976-87fe-75d8dcd48858 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:50:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f3c072d8-5b4f-4976-87fe-75d8dcd48858 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:50:19 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f3c072d8-5b4f-4976-87fe-75d8dcd48858 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:50:19 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-f3c072d8-5b4f-4976-87fe-75d8dcd48858 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:50:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f3c072d8-5b4f-4976-87fe-75d8dcd48858 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-40a250d9-a790-4f32-93e2-a27a8cae3c19 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:50:19 devstack sudo[103568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-40a250d9-a790-4f32-93e2-a27a8cae3c19 1073741824 Jul 28 10:50:19 devstack sudo[103568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:50:19 devstack sudo[103568]: pam_unix(sudo:session): session closed for user root Jul 28 10:50:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f3c072d8-5b4f-4976-87fe-75d8dcd48858 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-40a250d9-a790-4f32-93e2-a27a8cae3c19 1073741824" returned: 0 in 0.558s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:50:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f3c072d8-5b4f-4976-87fe-75d8dcd48858 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-40a250d9-a790-4f32-93e2-a27a8cae3c19 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:50:20 devstack sudo[103575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-40a250d9-a790-4f32-93e2-a27a8cae3c19 Jul 28 10:50:20 devstack sudo[103575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:50:20 devstack sudo[103575]: pam_unix(sudo:session): session closed for user root Jul 28 10:50:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f3c072d8-5b4f-4976-87fe-75d8dcd48858 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-40a250d9-a790-4f32-93e2-a27a8cae3c19" returned: 0 in 0.288s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:50:20 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f3c072d8-5b4f-4976-87fe-75d8dcd48858 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:50:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f3c072d8-5b4f-4976-87fe-75d8dcd48858 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:50:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f3c072d8-5b4f-4976-87fe-75d8dcd48858 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0c494a1-ee41-411b-b6db-78f9704fa414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40a250d9-a790-4f32-93e2-a27a8cae3c19', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:50:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f3c072d8-5b4f-4976-87fe-75d8dcd48858 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d241530-4e29-4ce2-883d-7def6d433e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:50:20 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-f3c072d8-5b4f-4976-87fe-75d8dcd48858 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Volume volume-40a250d9-a790-4f32-93e2-a27a8cae3c19 (40a250d9-a790-4f32-93e2-a27a8cae3c19): created successfully Jul 28 10:50:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f3c072d8-5b4f-4976-87fe-75d8dcd48858 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d241530-4e29-4ce2-883d-7def6d433e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:50:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-f3c072d8-5b4f-4976-87fe-75d8dcd48858 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Flow 'volume_create_manager' (570c69ec-07f2-4403-84a5-8409ed2a1102) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:50:20 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-f3c072d8-5b4f-4976-87fe-75d8dcd48858 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Created volume successfully. Jul 28 10:50:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-1d131b36-29bf-4a26-a82f-fae740958054 req-d695f8b1-f116-4f65-8db3-bd0b82baa9a1 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:50:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-1d131b36-29bf-4a26-a82f-fae740958054 req-d695f8b1-f116-4f65-8db3-bd0b82baa9a1 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:50:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-1d131b36-29bf-4a26-a82f-fae740958054 req-d695f8b1-f116-4f65-8db3-bd0b82baa9a1 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:50:22 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-1d131b36-29bf-4a26-a82f-fae740958054 req-d695f8b1-f116-4f65-8db3-bd0b82baa9a1 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7', 'name': 'volume-40a250d9-a790-4f32-93e2-a27a8cae3c19', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '71bb895a-8676-4a8f-ae6f-c3f14ce5269a', 'enforce_multipath': True} {{(pid=88413) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 10:50:22 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-1d131b36-29bf-4a26-a82f-fae740958054 req-d695f8b1-f116-4f65-8db3-bd0b82baa9a1 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] attachment_update completed successfully. Jul 28 10:50:25 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-9fff0cfe-dc06-48a2-acef-342ad98a088f req-c2d0fa6b-78f5-4617-a0d8-96f3dad4261b tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Terminate volume connection completed successfully. Jul 28 10:50:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-9fff0cfe-dc06-48a2-acef-342ad98a088f req-c2d0fa6b-78f5-4617-a0d8-96f3dad4261b tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Deleting attachment 71bb895a-8676-4a8f-ae6f-c3f14ce5269a. {{(pid=88413) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 10:50:26 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8eba8d42-e6bb-417e-b796-bec4c43fd4e1 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Acquiring lock "cinder-40a250d9-a790-4f32-93e2-a27a8cae3c19-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:50:26 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8eba8d42-e6bb-417e-b796-bec4c43fd4e1 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Lock "cinder-40a250d9-a790-4f32-93e2-a27a8cae3c19-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:50:26 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8eba8d42-e6bb-417e-b796-bec4c43fd4e1 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Acquiring lock "cinder-quobyte-40a250d9-a790-4f32-93e2-a27a8cae3c19" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:50:26 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8eba8d42-e6bb-417e-b796-bec4c43fd4e1 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Lock "cinder-quobyte-40a250d9-a790-4f32-93e2-a27a8cae3c19" acquired by "delete_volume" :: waited 0.022s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:50:26 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c17580b-2b39-4e8d-aef6-d1c7051c3f20]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:50:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8eba8d42-e6bb-417e-b796-bec4c43fd4e1 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-40a250d9-a790-4f32-93e2-a27a8cae3c19 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:50:26 devstack sudo[104040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-40a250d9-a790-4f32-93e2-a27a8cae3c19 Jul 28 10:50:26 devstack sudo[104040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:50:26 devstack sudo[104040]: pam_unix(sudo:session): session closed for user root Jul 28 10:50:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8eba8d42-e6bb-417e-b796-bec4c43fd4e1 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-40a250d9-a790-4f32-93e2-a27a8cae3c19" returned: 0 in 0.413s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:50:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8eba8d42-e6bb-417e-b796-bec4c43fd4e1 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-40a250d9-a790-4f32-93e2-a27a8cae3c19 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:50:27 devstack sudo[104045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-40a250d9-a790-4f32-93e2-a27a8cae3c19 Jul 28 10:50:27 devstack sudo[104045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:50:27 devstack sudo[104045]: pam_unix(sudo:session): session closed for user root Jul 28 10:50:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8eba8d42-e6bb-417e-b796-bec4c43fd4e1 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-40a250d9-a790-4f32-93e2-a27a8cae3c19" returned: 0 in 0.273s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:50:27 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8eba8d42-e6bb-417e-b796-bec4c43fd4e1 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Lock "cinder-quobyte-40a250d9-a790-4f32-93e2-a27a8cae3c19" released by "delete_volume" :: held 0.747s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:50:27 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-8eba8d42-e6bb-417e-b796-bec4c43fd4e1 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Created reservations ['7a2690a3-1de8-40a0-bdb8-aea7ae3670a0', '2e778dbe-649d-4884-86ce-32bb01ca4f1a', '8bebc8e7-853e-4745-8c8c-a19470e7af04', 'c036d196-ea93-4007-ae20-505d5ba1acba'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:50:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8eba8d42-e6bb-417e-b796-bec4c43fd4e1 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:50:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8eba8d42-e6bb-417e-b796-bec4c43fd4e1 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:50:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8eba8d42-e6bb-417e-b796-bec4c43fd4e1 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:50:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8eba8d42-e6bb-417e-b796-bec4c43fd4e1 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:50:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8eba8d42-e6bb-417e-b796-bec4c43fd4e1 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:50:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8eba8d42-e6bb-417e-b796-bec4c43fd4e1 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:50:27 devstack sudo[104048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:50:27 devstack sudo[104048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:50:27 devstack sudo[104048]: pam_unix(sudo:session): session closed for user root Jul 28 10:50:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8eba8d42-e6bb-417e-b796-bec4c43fd4e1 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.313s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:50:27 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-8eba8d42-e6bb-417e-b796-bec4c43fd4e1 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:50:27 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-8eba8d42-e6bb-417e-b796-bec4c43fd4e1 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Deleted volume successfully. Jul 28 10:50:27 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8eba8d42-e6bb-417e-b796-bec4c43fd4e1 tempest-TestServerVolumeAttachScenarioOldVersion-712529826 None] Lock "cinder-40a250d9-a790-4f32-93e2-a27a8cae3c19-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:50:28 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:50:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:50:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:50:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:50:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:50:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:50:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:50:28 devstack sudo[104071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:50:28 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:50:28 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root Jul 28 10:50:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.316s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:50:28 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:50:28 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager._thread_info {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:50:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread count: 29 {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 10:50:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread info: [<_MainThread(MainThread, started 137939890385024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 10:50:33 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-237f46c9-dfd2-4ec8-b049-fb2789dfc881 tempest-TestStampPattern-827573592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:50:33 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-237f46c9-dfd2-4ec8-b049-fb2789dfc881 tempest-TestStampPattern-827573592 None] Flow 'volume_create_manager' (cab40d74-4829-4720-ac0c-558f2051f9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:50:33 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-237f46c9-dfd2-4ec8-b049-fb2789dfc881 tempest-TestStampPattern-827573592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cce9407-243b-45c3-8d28-5e62d057f66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:50:33 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-237f46c9-dfd2-4ec8-b049-fb2789dfc881 tempest-TestStampPattern-827573592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cce9407-243b-45c3-8d28-5e62d057f66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-707776465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b77f0531-5da8-497c-8277-3db903768502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36335a4377474ac0ab451905094396cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:50:33Z,use_quota=True,user_id='4d75788b40cb400e8805c7b8e75bc9ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:50:33 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-237f46c9-dfd2-4ec8-b049-fb2789dfc881 tempest-TestStampPattern-827573592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c15de8e-2880-4a13-a262-d82edca3c55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:50:33 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-237f46c9-dfd2-4ec8-b049-fb2789dfc881 tempest-TestStampPattern-827573592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c15de8e-2880-4a13-a262-d82edca3c55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:50:33 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-237f46c9-dfd2-4ec8-b049-fb2789dfc881 tempest-TestStampPattern-827573592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9950d3b9-2ab6-435f-a260-f0e7aa514bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:50:33 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-237f46c9-dfd2-4ec8-b049-fb2789dfc881 tempest-TestStampPattern-827573592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9950d3b9-2ab6-435f-a260-f0e7aa514bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b77f0531-5da8-497c-8277-3db903768502', 'volume_name': 'volume-b77f0531-5da8-497c-8277-3db903768502', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:50:33 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-237f46c9-dfd2-4ec8-b049-fb2789dfc881 tempest-TestStampPattern-827573592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d29eb8d9-33ce-4981-9aae-8bf35d8e87c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:50:33 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-237f46c9-dfd2-4ec8-b049-fb2789dfc881 tempest-TestStampPattern-827573592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d29eb8d9-33ce-4981-9aae-8bf35d8e87c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:50:33 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-237f46c9-dfd2-4ec8-b049-fb2789dfc881 tempest-TestStampPattern-827573592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45e2531a-717a-4407-a8aa-8e381908b050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:50:33 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-237f46c9-dfd2-4ec8-b049-fb2789dfc881 tempest-TestStampPattern-827573592 None] Volume b77f0531-5da8-497c-8277-3db903768502: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b77f0531-5da8-497c-8277-3db903768502', 'volume_size': 1} Jul 28 10:50:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-237f46c9-dfd2-4ec8-b049-fb2789dfc881 tempest-TestStampPattern-827573592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:50:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-237f46c9-dfd2-4ec8-b049-fb2789dfc881 tempest-TestStampPattern-827573592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:50:33 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-237f46c9-dfd2-4ec8-b049-fb2789dfc881 tempest-TestStampPattern-827573592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-707776465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b77f0531-5da8-497c-8277-3db903768502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36335a4377474ac0ab451905094396cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:50:33Z,use_quota=True,user_id='4d75788b40cb400e8805c7b8e75bc9ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:50:33 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-237f46c9-dfd2-4ec8-b049-fb2789dfc881 tempest-TestStampPattern-827573592 None] Creating volume b77f0531-5da8-497c-8277-3db903768502 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:50:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-237f46c9-dfd2-4ec8-b049-fb2789dfc881 tempest-TestStampPattern-827573592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:50:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-237f46c9-dfd2-4ec8-b049-fb2789dfc881 tempest-TestStampPattern-827573592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:50:33 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-237f46c9-dfd2-4ec8-b049-fb2789dfc881 tempest-TestStampPattern-827573592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:50:33 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-237f46c9-dfd2-4ec8-b049-fb2789dfc881 tempest-TestStampPattern-827573592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:50:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-237f46c9-dfd2-4ec8-b049-fb2789dfc881 tempest-TestStampPattern-827573592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:50:33 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-237f46c9-dfd2-4ec8-b049-fb2789dfc881 tempest-TestStampPattern-827573592 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:50:33 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-237f46c9-dfd2-4ec8-b049-fb2789dfc881 tempest-TestStampPattern-827573592 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:50:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-237f46c9-dfd2-4ec8-b049-fb2789dfc881 tempest-TestStampPattern-827573592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:50:33 devstack sudo[104086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502 1073741824 Jul 28 10:50:33 devstack sudo[104086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:50:33 devstack sudo[104086]: pam_unix(sudo:session): session closed for user root Jul 28 10:50:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-237f46c9-dfd2-4ec8-b049-fb2789dfc881 tempest-TestStampPattern-827573592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502 1073741824" returned: 0 in 0.530s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:50:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-237f46c9-dfd2-4ec8-b049-fb2789dfc881 tempest-TestStampPattern-827573592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:50:34 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502 Jul 28 10:50:34 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:50:34 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Jul 28 10:50:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-237f46c9-dfd2-4ec8-b049-fb2789dfc881 tempest-TestStampPattern-827573592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502" returned: 0 in 0.339s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:50:34 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-237f46c9-dfd2-4ec8-b049-fb2789dfc881 tempest-TestStampPattern-827573592 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:50:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-237f46c9-dfd2-4ec8-b049-fb2789dfc881 tempest-TestStampPattern-827573592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:50:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-237f46c9-dfd2-4ec8-b049-fb2789dfc881 tempest-TestStampPattern-827573592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45e2531a-717a-4407-a8aa-8e381908b050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b77f0531-5da8-497c-8277-3db903768502', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:50:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-237f46c9-dfd2-4ec8-b049-fb2789dfc881 tempest-TestStampPattern-827573592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1979de2-0c77-4705-bb55-2c7ff892a079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:50:34 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-237f46c9-dfd2-4ec8-b049-fb2789dfc881 tempest-TestStampPattern-827573592 None] Volume volume-b77f0531-5da8-497c-8277-3db903768502 (b77f0531-5da8-497c-8277-3db903768502): created successfully Jul 28 10:50:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-237f46c9-dfd2-4ec8-b049-fb2789dfc881 tempest-TestStampPattern-827573592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1979de2-0c77-4705-bb55-2c7ff892a079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:50:34 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-237f46c9-dfd2-4ec8-b049-fb2789dfc881 tempest-TestStampPattern-827573592 None] Flow 'volume_create_manager' (cab40d74-4829-4720-ac0c-558f2051f9e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:50:34 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-237f46c9-dfd2-4ec8-b049-fb2789dfc881 tempest-TestStampPattern-827573592 None] Created volume successfully. Jul 28 10:50:44 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:UPDATE=14,cinder:SELECT=15,cinder:DELETE=2,cinder:INSERT=3 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:50:44 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=18,cinder:UPDATE=17,cinder:INSERT=3,cinder:DELETE=1 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:51:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-d1590e1d-5607-47c8-b181-0c23c863a951 req-793b95be-b13a-4e83-afd5-3293db88eea6 tempest-TestStampPattern-827573592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:51:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-d1590e1d-5607-47c8-b181-0c23c863a951 req-793b95be-b13a-4e83-afd5-3293db88eea6 tempest-TestStampPattern-827573592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:51:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-d1590e1d-5607-47c8-b181-0c23c863a951 req-793b95be-b13a-4e83-afd5-3293db88eea6 tempest-TestStampPattern-827573592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:51:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-d1590e1d-5607-47c8-b181-0c23c863a951 req-793b95be-b13a-4e83-afd5-3293db88eea6 tempest-TestStampPattern-827573592 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7', 'name': 'volume-b77f0531-5da8-497c-8277-3db903768502', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5e413806-f7ee-4768-9cb7-67b919e1df51', 'enforce_multipath': True} {{(pid=88413) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 10:51:04 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-d1590e1d-5607-47c8-b181-0c23c863a951 req-793b95be-b13a-4e83-afd5-3293db88eea6 tempest-TestStampPattern-827573592 None] attachment_update completed successfully. Jul 28 10:51:04 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:51:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Flow 'volume_create_manager' (524aa148-dc19-4c0a-bc58-1f5cc48cad8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:51:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (232f7165-742d-4925-92af-6395639b9019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:51:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (232f7165-742d-4925-92af-6395639b9019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-670217725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a37849-2a08-4318-aab9-1b499d4bd8a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e41e499b88d4550946de74c521e18dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:51:05Z,use_quota=True,user_id='809307c79bad4075a242e6fc82ed0674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:51:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f525540a-f88d-4083-b31e-a671eb7a9b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:51:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f525540a-f88d-4083-b31e-a671eb7a9b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:51:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d86a2f-b427-4b75-b82a-cdd20373381e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:51:04 devstack cinder-volume[88413]: DEBUG cinder.image.glance [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Creating Keystone auth plugin from conf {{(pid=88413) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 28 10:51:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d86a2f-b427-4b75-b82a-cdd20373381e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '82a37849-2a08-4318-aab9-1b499d4bd8a3', 'volume_name': 'volume-82a37849-2a08-4318-aab9-1b499d4bd8a3', 'volume_size': 1, 'image_id': '3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b606c34dd1dc45a6a010943235754dcb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'created_at': datetime.datetime(2026, 7, 28, 8, 30, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 8, 30, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c7ac9f7-f638-43c1-9c8d-41f36b0aec05/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:51:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (056031be-7018-442e-bc4e-127a075b4907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:51:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (056031be-7018-442e-bc4e-127a075b4907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:51:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24a6f7e5-ff32-4f8d-b1b1-23b1a1060236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:51:05 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Volume 82a37849-2a08-4318-aab9-1b499d4bd8a3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-82a37849-2a08-4318-aab9-1b499d4bd8a3', 'volume_size': 1, 'image_id': '3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b606c34dd1dc45a6a010943235754dcb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'created_at': datetime.datetime(2026, 7, 28, 8, 30, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 8, 30, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c7ac9f7-f638-43c1-9c8d-41f36b0aec05/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 28 10:51:05 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Trying to clone 82a37849-2a08-4318-aab9-1b499d4bd8a3 from image 3c7ac9f7-f638-43c1-9c8d-41f36b0aec05 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'metadata': {}}]). {{(pid=88413) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 28 10:51:05 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_oacedhqsdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88413) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 28 10:51:05 devstack cinder-volume[88413]: INFO cinder.image.image_utils [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Image download 20.69 MB at 20.69 MB/s Jul 28 10:51:05 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3a046d-54c2-4f0b-b1e8-d8a34b70f5b1]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:51:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_oacedhqsdevstack@QuobyteHD {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:51:05 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_oacedhqsdevstack@QuobyteHD Jul 28 10:51:05 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:51:06 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Jul 28 10:51:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_oacedhqsdevstack@QuobyteHD" returned: 0 in 0.332s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:51:06 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Temporary image 3c7ac9f7-f638-43c1-9c8d-41f36b0aec05 is fetched for user 809307c79bad4075a242e6fc82ed0674. {{(pid=88413) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 28 10:51:06 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7c8d6a-8c9a-46e2-8085-5df53ab912e2]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:51:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_oacedhqsdevstack@QuobyteHD {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:51:06 devstack sudo[104642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_oacedhqsdevstack@QuobyteHD Jul 28 10:51:06 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:51:06 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root Jul 28 10:51:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_oacedhqsdevstack@QuobyteHD" returned: 0 in 0.322s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:51:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:51:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:51:06 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-670217725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a37849-2a08-4318-aab9-1b499d4bd8a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e41e499b88d4550946de74c521e18dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:51:05Z,use_quota=True,user_id='809307c79bad4075a242e6fc82ed0674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:51:06 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Creating volume 82a37849-2a08-4318-aab9-1b499d4bd8a3 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:51:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:51:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:51:06 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:51:06 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:51:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:51:06 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:51:06 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:51:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-82a37849-2a08-4318-aab9-1b499d4bd8a3 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:51:06 devstack sudo[104657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-82a37849-2a08-4318-aab9-1b499d4bd8a3 1073741824 Jul 28 10:51:06 devstack sudo[104657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:51:06 devstack sudo[104657]: pam_unix(sudo:session): session closed for user root Jul 28 10:51:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-82a37849-2a08-4318-aab9-1b499d4bd8a3 1073741824" returned: 0 in 0.424s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:51:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-82a37849-2a08-4318-aab9-1b499d4bd8a3 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:51:07 devstack sudo[104662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-82a37849-2a08-4318-aab9-1b499d4bd8a3 Jul 28 10:51:07 devstack sudo[104662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:51:07 devstack sudo[104662]: pam_unix(sudo:session): session closed for user root Jul 28 10:51:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-82a37849-2a08-4318-aab9-1b499d4bd8a3" returned: 0 in 0.246s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:51:07 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:51:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:51:07 devstack cinder-volume[88413]: DEBUG cinder.volume.volume_utils [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Attempting download of 3c7ac9f7-f638-43c1-9c8d-41f36b0aec05 ((None, [{'url': 'file:///opt/stack/data/glance/images/3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'metadata': {}}])) to volume 82a37849-2a08-4318-aab9-1b499d4bd8a3. {{(pid=88413) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 28 10:51:07 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[79433586-f2e5-40ca-966a-ef72fca1a48d]: (4, 'raw') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:51:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_08mswm1k {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:51:07 devstack sudo[104665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_08mswm1k Jul 28 10:51:07 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:51:07 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root Jul 28 10:51:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_08mswm1k" returned: 0 in 0.342s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:51:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_08mswm1k {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:51:07 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_08mswm1k Jul 28 10:51:07 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:51:08 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Jul 28 10:51:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_08mswm1k" returned: 1 in 0.379s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:51:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_08mswm1k' failed. Not Retrying. {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 10:51:08 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[732bac9a-bedf-4424-88d8-4969e3b98913]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:51:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_oacedhqsdevstack@QuobyteHD {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:51:08 devstack sudo[104673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_oacedhqsdevstack@QuobyteHD Jul 28 10:51:08 devstack sudo[104673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:51:08 devstack sudo[104673]: pam_unix(sudo:session): session closed for user root Jul 28 10:51:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_oacedhqsdevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:51:08 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] 3c7ac9f7-f638-43c1-9c8d-41f36b0aec05 was qcow2, converting to qcow2 {{(pid=88413) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 28 10:51:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_oacedhqsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-82a37849-2a08-4318-aab9-1b499d4bd8a3 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:51:08 devstack sudo[104684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_oacedhqsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-82a37849-2a08-4318-aab9-1b499d4bd8a3 Jul 28 10:51:08 devstack sudo[104684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:51:09 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-57fb8210-3450-45a2-9c63-586018e9b9f2 req-83309c1c-5fc1-412e-8ebf-4149638fb94f tempest-TestStampPattern-827573592 None] Terminate volume connection completed successfully. Jul 28 10:51:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-57fb8210-3450-45a2-9c63-586018e9b9f2 req-83309c1c-5fc1-412e-8ebf-4149638fb94f tempest-TestStampPattern-827573592 None] Deleting attachment 5e413806-f7ee-4768-9cb7-67b919e1df51. {{(pid=88413) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 10:51:10 devstack sudo[104684]: pam_unix(sudo:session): session closed for user root Jul 28 10:51:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_oacedhqsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-82a37849-2a08-4318-aab9-1b499d4bd8a3" returned: 0 in 1.858s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:51:10 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3c7ac9f7-f638-43c1-9c8d-41f36b0aec05_oacedhqsdevstack@QuobyteHD, size 112.00 MB, duration 1.86 sec, destination /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-82a37849-2a08-4318-aab9-1b499d4bd8a3 {{(pid=88413) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 10:51:10 devstack cinder-volume[88413]: INFO cinder.image.image_utils [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Converted 112.00 MB image at 60.24 MB/s Jul 28 10:51:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-82a37849-2a08-4318-aab9-1b499d4bd8a3 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:51:10 devstack sudo[104728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-82a37849-2a08-4318-aab9-1b499d4bd8a3 1G Jul 28 10:51:10 devstack sudo[104728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:51:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9dc30b8e-7006-4063-aee7-48ec37de43a8 tempest-TestStampPattern-827573592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:51:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9dc30b8e-7006-4063-aee7-48ec37de43a8 tempest-TestStampPattern-827573592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:51:10 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-9dc30b8e-7006-4063-aee7-48ec37de43a8 tempest-TestStampPattern-827573592 None] Creating offline snapshot 353844c3-ec93-4739-91b0-eba1b88a2ad5 of volume b77f0531-5da8-497c-8277-3db903768502 {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:51:10 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[de60f79c-d677-49eb-82e3-a9f77fa82e87]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:51:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9dc30b8e-7006-4063-aee7-48ec37de43a8 tempest-TestStampPattern-827573592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:51:10 devstack sudo[104730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502 Jul 28 10:51:10 devstack sudo[104730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:51:10 devstack sudo[104728]: pam_unix(sudo:session): session closed for user root Jul 28 10:51:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-82a37849-2a08-4318-aab9-1b499d4bd8a3 1G" returned: 0 in 0.356s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:51:10 devstack cinder-volume[88413]: DEBUG cinder.volume.volume_utils [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Downloaded image 3c7ac9f7-f638-43c1-9c8d-41f36b0aec05 ((None, [{'url': 'file:///opt/stack/data/glance/images/3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'metadata': {}}])) to volume 82a37849-2a08-4318-aab9-1b499d4bd8a3 successfully. {{(pid=88413) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 28 10:51:10 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Temporary image 3c7ac9f7-f638-43c1-9c8d-41f36b0aec05 for user 809307c79bad4075a242e6fc82ed0674 is deleted. {{(pid=88413) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 28 10:51:10 devstack cinder-volume[88413]: DEBUG cinder.volume.volume_utils [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Marking volume 82a37849-2a08-4318-aab9-1b499d4bd8a3 as bootable. {{(pid=88413) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 28 10:51:10 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Copying metadata from image 3c7ac9f7-f638-43c1-9c8d-41f36b0aec05 to 82a37849-2a08-4318-aab9-1b499d4bd8a3. {{(pid=88413) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 28 10:51:10 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Creating volume glance metadata for volume 82a37849-2a08-4318-aab9-1b499d4bd8a3 backed by image 3c7ac9f7-f638-43c1-9c8d-41f36b0aec05 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88413) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 28 10:51:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24a6f7e5-ff32-4f8d-b1b1-23b1a1060236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82a37849-2a08-4318-aab9-1b499d4bd8a3', 'volume_size': 1, 'image_id': '3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b606c34dd1dc45a6a010943235754dcb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3c7ac9f7-f638-43c1-9c8d-41f36b0aec05', 'created_at': datetime.datetime(2026, 7, 28, 8, 30, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 8, 30, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c7ac9f7-f638-43c1-9c8d-41f36b0aec05/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:51:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84bf555d-80e9-4ba3-9378-97445167fca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:51:10 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Volume volume-82a37849-2a08-4318-aab9-1b499d4bd8a3 (82a37849-2a08-4318-aab9-1b499d4bd8a3): created successfully Jul 28 10:51:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84bf555d-80e9-4ba3-9378-97445167fca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:51:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Flow 'volume_create_manager' (524aa148-dc19-4c0a-bc58-1f5cc48cad8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:51:10 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-fb9bfdb8-5ded-4576-a9f4-b122a6e75082 tempest-TestShelveInstance-630767199 None] Created volume successfully. Jul 28 10:51:10 devstack sudo[104730]: pam_unix(sudo:session): session closed for user root Jul 28 10:51:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9dc30b8e-7006-4063-aee7-48ec37de43a8 tempest-TestStampPattern-827573592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502" returned: 0 in 0.402s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:51:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9dc30b8e-7006-4063-aee7-48ec37de43a8 tempest-TestStampPattern-827573592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502.353844c3-ec93-4739-91b0-eba1b88a2ad5 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:51:10 devstack sudo[104738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502.353844c3-ec93-4739-91b0-eba1b88a2ad5 1G Jul 28 10:51:10 devstack sudo[104738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:51:11 devstack sudo[104738]: pam_unix(sudo:session): session closed for user root Jul 28 10:51:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9dc30b8e-7006-4063-aee7-48ec37de43a8 tempest-TestStampPattern-827573592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502.353844c3-ec93-4739-91b0-eba1b88a2ad5 1G" returned: 0 in 0.422s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:51:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9dc30b8e-7006-4063-aee7-48ec37de43a8 tempest-TestStampPattern-827573592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b77f0531-5da8-497c-8277-3db903768502 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502.353844c3-ec93-4739-91b0-eba1b88a2ad5 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:51:11 devstack sudo[104744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b77f0531-5da8-497c-8277-3db903768502 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502.353844c3-ec93-4739-91b0-eba1b88a2ad5 Jul 28 10:51:11 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:51:11 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root Jul 28 10:51:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9dc30b8e-7006-4063-aee7-48ec37de43a8 tempest-TestStampPattern-827573592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b77f0531-5da8-497c-8277-3db903768502 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502.353844c3-ec93-4739-91b0-eba1b88a2ad5" returned: 0 in 0.294s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:51:11 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-9dc30b8e-7006-4063-aee7-48ec37de43a8 tempest-TestStampPattern-827573592 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502.353844c3-ec93-4739-91b0-eba1b88a2ad5 is being set with open permissions: ugo+rw Jul 28 10:51:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9dc30b8e-7006-4063-aee7-48ec37de43a8 tempest-TestStampPattern-827573592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502.353844c3-ec93-4739-91b0-eba1b88a2ad5 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:51:11 devstack sudo[104749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502.353844c3-ec93-4739-91b0-eba1b88a2ad5 Jul 28 10:51:11 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:51:11 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root Jul 28 10:51:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9dc30b8e-7006-4063-aee7-48ec37de43a8 tempest-TestStampPattern-827573592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502.353844c3-ec93-4739-91b0-eba1b88a2ad5" returned: 0 in 0.240s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:51:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9dc30b8e-7006-4063-aee7-48ec37de43a8 tempest-TestStampPattern-827573592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:51:11 devstack sudo[104752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502.info Jul 28 10:51:11 devstack sudo[104752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:51:12 devstack sudo[104752]: pam_unix(sudo:session): session closed for user root Jul 28 10:51:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9dc30b8e-7006-4063-aee7-48ec37de43a8 tempest-TestStampPattern-827573592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502.info" returned: 0 in 0.280s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:51:12 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-9dc30b8e-7006-4063-aee7-48ec37de43a8 tempest-TestStampPattern-827573592 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502.info is being set with open permissions: ugo+rw Jul 28 10:51:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9dc30b8e-7006-4063-aee7-48ec37de43a8 tempest-TestStampPattern-827573592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:51:12 devstack sudo[104755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502.info Jul 28 10:51:12 devstack sudo[104755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:51:12 devstack sudo[104755]: pam_unix(sudo:session): session closed for user root Jul 28 10:51:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9dc30b8e-7006-4063-aee7-48ec37de43a8 tempest-TestStampPattern-827573592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502.info" returned: 0 in 0.269s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:51:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9dc30b8e-7006-4063-aee7-48ec37de43a8 tempest-TestStampPattern-827573592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.016s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:51:12 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-9dc30b8e-7006-4063-aee7-48ec37de43a8 tempest-TestStampPattern-827573592 None] Create snapshot completed successfully Jul 28 10:51:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-7f4ed756-5584-4c53-9b48-18aef366994d req-18d882bd-7c6c-4444-b655-4eb629e78978 tempest-TestShelveInstance-630767199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:51:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-7f4ed756-5584-4c53-9b48-18aef366994d req-18d882bd-7c6c-4444-b655-4eb629e78978 tempest-TestShelveInstance-630767199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:51:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-7f4ed756-5584-4c53-9b48-18aef366994d req-18d882bd-7c6c-4444-b655-4eb629e78978 tempest-TestShelveInstance-630767199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:51:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-7f4ed756-5584-4c53-9b48-18aef366994d req-18d882bd-7c6c-4444-b655-4eb629e78978 tempest-TestShelveInstance-630767199 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7', 'name': 'volume-82a37849-2a08-4318-aab9-1b499d4bd8a3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9f1ff3af-61b1-4eff-aca5-55a7beea5bbd', 'enforce_multipath': True} {{(pid=88413) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 10:51:13 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-7f4ed756-5584-4c53-9b48-18aef366994d req-18d882bd-7c6c-4444-b655-4eb629e78978 tempest-TestShelveInstance-630767199 None] attachment_update completed successfully. Jul 28 10:51:21 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:51:21 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Flow 'volume_create_manager' (e7a074aa-6a3d-4653-848a-df5baf1c97cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:51:21 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac562bfa-3531-48e7-bd57-a9cd5ac1a1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:51:21 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac562bfa-3531-48e7-bd57-a9cd5ac1a1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1692345030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=861e6a29-4776-4270-af06-d9ad99a5b929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36335a4377474ac0ab451905094396cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=353844c3-ec93-4739-91b0-eba1b88a2ad5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:51:22Z,use_quota=True,user_id='4d75788b40cb400e8805c7b8e75bc9ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:51:21 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa1b8692-6d8c-4cc5-b8f7-9b217e22775a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:51:21 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa1b8692-6d8c-4cc5-b8f7-9b217e22775a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:51:21 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ffe17e5-34d3-41da-9b29-10444ef6b3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:51:21 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ffe17e5-34d3-41da-9b29-10444ef6b3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '861e6a29-4776-4270-af06-d9ad99a5b929', 'volume_name': 'volume-861e6a29-4776-4270-af06-d9ad99a5b929', 'volume_size': 1, 'snapshot_id': '353844c3-ec93-4739-91b0-eba1b88a2ad5'}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:51:21 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4579784b-bea1-460b-b477-130e145db32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:51:21 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4579784b-bea1-460b-b477-130e145db32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:51:21 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18d5bc24-df9a-4cb4-bc4e-db3dd24b8edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:51:21 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Volume 861e6a29-4776-4270-af06-d9ad99a5b929: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-861e6a29-4776-4270-af06-d9ad99a5b929', 'volume_size': 1, 'snapshot_id': '353844c3-ec93-4739-91b0-eba1b88a2ad5'} Jul 28 10:51:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:51:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:51:21 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Acquiring lock "cinder-quobyte-353844c3-ec93-4739-91b0-eba1b88a2ad5-861e6a29-4776-4270-af06-d9ad99a5b929" by "_create_volume_from_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:51:21 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Lock "cinder-quobyte-353844c3-ec93-4739-91b0-eba1b88a2ad5-861e6a29-4776-4270-af06-d9ad99a5b929" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:51:21 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Creating volume 861e6a29-4776-4270-af06-d9ad99a5b929 from snapshot 353844c3-ec93-4739-91b0-eba1b88a2ad5 {{(pid=88413) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 28 10:51:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:51:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:51:21 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:51:21 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:51:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:51:21 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:51:21 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Acquiring lock "cinder-quobyte-861e6a29-4776-4270-af06-d9ad99a5b929" by "_copy_volume_from_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:51:21 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Lock "cinder-quobyte-861e6a29-4776-4270-af06-d9ad99a5b929" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:51:21 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] snapshot: 353844c3-ec93-4739-91b0-eba1b88a2ad5, volume: 861e6a29-4776-4270-af06-d9ad99a5b929, {{(pid=88413) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 28 10:51:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:51:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:51:22 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:51:22 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:51:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:51:22 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[3348e682-6bed-41fb-ac3d-dbb2fe9890b2]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:51:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502.353844c3-ec93-4739-91b0-eba1b88a2ad5 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:51:22 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502.353844c3-ec93-4739-91b0-eba1b88a2ad5 Jul 28 10:51:22 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:51:22 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Jul 28 10:51:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502.353844c3-ec93-4739-91b0-eba1b88a2ad5" returned: 0 in 0.562s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:51:22 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b77f0531-5da8-497c-8277-3db903768502(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:51:22 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502 {{(pid=88413) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 28 10:51:22 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Creating direct copy from snapshot {{(pid=88413) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 28 10:51:22 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19e88ed-1bc7-4605-9a91-aac3eb158b48]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:51:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:51:22 devstack sudo[105277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502 Jul 28 10:51:22 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:51:23 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root Jul 28 10:51:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502" returned: 0 in 0.706s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:51:23 devstack cinder-volume[88413]: DEBUG cinder.utils [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Path /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-861e6a29-4776-4270-af06-d9ad99a5b929 not found in is_blk_device check {{(pid=88413) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 28 10:51:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-861e6a29-4776-4270-af06-d9ad99a5b929 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:51:23 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-861e6a29-4776-4270-af06-d9ad99a5b929 Jul 28 10:51:23 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:51:28 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:51:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:51:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:51:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:51:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:51:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:51:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:51:28 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:51:28 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:51:29 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Jul 28 10:51:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.813s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:51:29 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:51:29 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager._thread_info {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:51:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread count: 29 {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 10:51:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread info: [<_MainThread(MainThread, started 137939890385024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 10:51:31 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Jul 28 10:51:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-861e6a29-4776-4270-af06-d9ad99a5b929" returned: 0 in 8.044s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:51:31 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[8589ff70-622d-45d9-bf4d-328ec80a88a4]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:51:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:51:31 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502 Jul 28 10:51:31 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:51:31 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=27,cinder:INSERT=6,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:51:31 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=32,cinder:UPDATE=11,cinder:INSERT=9,cinder:DELETE=1 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:51:32 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Jul 28 10:51:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502" returned: 0 in 0.697s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:51:32 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502, size 1024.00 MB, duration 8.05 sec, destination /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-861e6a29-4776-4270-af06-d9ad99a5b929 {{(pid=88413) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 10:51:32 devstack cinder-volume[88413]: INFO cinder.image.image_utils [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Converted 1024.00 MB image at 127.27 MB/s Jul 28 10:51:32 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-861e6a29-4776-4270-af06-d9ad99a5b929 is being set with open permissions: ugo+rw Jul 28 10:51:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-861e6a29-4776-4270-af06-d9ad99a5b929 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:51:32 devstack sudo[105362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-861e6a29-4776-4270-af06-d9ad99a5b929 Jul 28 10:51:32 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:51:32 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root Jul 28 10:51:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-861e6a29-4776-4270-af06-d9ad99a5b929" returned: 0 in 0.381s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:51:32 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Lock "cinder-quobyte-861e6a29-4776-4270-af06-d9ad99a5b929" released by "_copy_volume_from_snapshot" :: held 10.564s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:51:32 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Lock "cinder-quobyte-353844c3-ec93-4739-91b0-eba1b88a2ad5-861e6a29-4776-4270-af06-d9ad99a5b929" released by "_create_volume_from_snapshot" :: held 10.603s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:51:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.624s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:51:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18d5bc24-df9a-4cb4-bc4e-db3dd24b8edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-861e6a29-4776-4270-af06-d9ad99a5b929', 'volume_size': 1, 'snapshot_id': '353844c3-ec93-4739-91b0-eba1b88a2ad5'}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:51:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f933d985-0f9f-440a-ab97-066db8d5aede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:51:32 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Volume volume-861e6a29-4776-4270-af06-d9ad99a5b929 (861e6a29-4776-4270-af06-d9ad99a5b929): created successfully Jul 28 10:51:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f933d985-0f9f-440a-ab97-066db8d5aede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:51:32 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Flow 'volume_create_manager' (e7a074aa-6a3d-4653-848a-df5baf1c97cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:51:32 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-5c6ca557-9b77-4542-a67b-2343f7e63f00 tempest-TestStampPattern-827573592 None] Created volume successfully. Jul 28 10:51:42 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:UPDATE=1 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:51:42 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:52:01 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-3b831189-105f-4747-bbe8-c118eeeeec3a req-e6107604-0abb-4f8c-b19b-6bf51618a8ba tempest-TestShelveInstance-630767199 None] Terminate volume connection completed successfully. Jul 28 10:52:01 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-3b831189-105f-4747-bbe8-c118eeeeec3a req-e6107604-0abb-4f8c-b19b-6bf51618a8ba tempest-TestShelveInstance-630767199 None] Deleting attachment 9f1ff3af-61b1-4eff-aca5-55a7beea5bbd. {{(pid=88413) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 10:52:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-7c640acf-3096-428c-a8d1-78868aea0f87 req-511c8d8b-df59-4d3f-bf3d-4c81cc989823 tempest-TestShelveInstance-630767199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:52:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-7c640acf-3096-428c-a8d1-78868aea0f87 req-511c8d8b-df59-4d3f-bf3d-4c81cc989823 tempest-TestShelveInstance-630767199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:52:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-7c640acf-3096-428c-a8d1-78868aea0f87 req-511c8d8b-df59-4d3f-bf3d-4c81cc989823 tempest-TestShelveInstance-630767199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:52:03 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-7c640acf-3096-428c-a8d1-78868aea0f87 req-511c8d8b-df59-4d3f-bf3d-4c81cc989823 tempest-TestShelveInstance-630767199 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7', 'name': 'volume-82a37849-2a08-4318-aab9-1b499d4bd8a3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf5d8f21-a282-4eb8-9534-c7e2629f8a84', 'enforce_multipath': True} {{(pid=88413) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 10:52:03 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-7c640acf-3096-428c-a8d1-78868aea0f87 req-511c8d8b-df59-4d3f-bf3d-4c81cc989823 tempest-TestShelveInstance-630767199 None] attachment_update completed successfully. Jul 28 10:52:13 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:52:13 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:52:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-a8aafeab-3da3-4b29-8146-7ca206239267 req-d9f9df8f-cae1-4500-b47c-bbfe3f20d1c2 tempest-TestStampPattern-827573592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:52:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-a8aafeab-3da3-4b29-8146-7ca206239267 req-d9f9df8f-cae1-4500-b47c-bbfe3f20d1c2 tempest-TestStampPattern-827573592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:52:16 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8499903-da55-40ed-92df-3491c9c59720]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:52:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-a8aafeab-3da3-4b29-8146-7ca206239267 req-d9f9df8f-cae1-4500-b47c-bbfe3f20d1c2 tempest-TestStampPattern-827573592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-861e6a29-4776-4270-af06-d9ad99a5b929 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:16 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-861e6a29-4776-4270-af06-d9ad99a5b929 Jul 28 10:52:16 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:16 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-a8aafeab-3da3-4b29-8146-7ca206239267 req-d9f9df8f-cae1-4500-b47c-bbfe3f20d1c2 tempest-TestStampPattern-827573592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-861e6a29-4776-4270-af06-d9ad99a5b929" returned: 0 in 0.381s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-a8aafeab-3da3-4b29-8146-7ca206239267 req-d9f9df8f-cae1-4500-b47c-bbfe3f20d1c2 tempest-TestStampPattern-827573592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.408s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:52:16 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-a8aafeab-3da3-4b29-8146-7ca206239267 req-d9f9df8f-cae1-4500-b47c-bbfe3f20d1c2 tempest-TestStampPattern-827573592 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7', 'name': 'volume-861e6a29-4776-4270-af06-d9ad99a5b929', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '03496e59-e8da-4d63-942d-65c470a4f429', 'enforce_multipath': True} {{(pid=88413) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 10:52:16 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-a8aafeab-3da3-4b29-8146-7ca206239267 req-d9f9df8f-cae1-4500-b47c-bbfe3f20d1c2 tempest-TestStampPattern-827573592 None] attachment_update completed successfully. Jul 28 10:52:19 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-7be80acf-7102-4791-a610-1623f1c2a3fa req-d1b5ed99-147b-4419-ac15-764b1b6b3830 tempest-TestStampPattern-827573592 None] Terminate volume connection completed successfully. Jul 28 10:52:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-7be80acf-7102-4791-a610-1623f1c2a3fa req-d1b5ed99-147b-4419-ac15-764b1b6b3830 tempest-TestStampPattern-827573592 None] Deleting attachment 03496e59-e8da-4d63-942d-65c470a4f429. {{(pid=88413) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 10:52:23 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-01141df3-8359-41ca-bffb-d9050a7fe1cc tempest-TestStampPattern-827573592 None] Acquiring lock "cinder-861e6a29-4776-4270-af06-d9ad99a5b929-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:52:23 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-01141df3-8359-41ca-bffb-d9050a7fe1cc tempest-TestStampPattern-827573592 None] Lock "cinder-861e6a29-4776-4270-af06-d9ad99a5b929-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:52:23 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-01141df3-8359-41ca-bffb-d9050a7fe1cc tempest-TestStampPattern-827573592 None] Acquiring lock "cinder-quobyte-861e6a29-4776-4270-af06-d9ad99a5b929" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:52:23 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-01141df3-8359-41ca-bffb-d9050a7fe1cc tempest-TestStampPattern-827573592 None] Lock "cinder-quobyte-861e6a29-4776-4270-af06-d9ad99a5b929" acquired by "delete_volume" :: waited 0.013s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:52:23 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ea998a-8c8b-45df-973a-5373a9446524]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:52:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01141df3-8359-41ca-bffb-d9050a7fe1cc tempest-TestStampPattern-827573592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-861e6a29-4776-4270-af06-d9ad99a5b929 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:23 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-861e6a29-4776-4270-af06-d9ad99a5b929 Jul 28 10:52:23 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:24 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01141df3-8359-41ca-bffb-d9050a7fe1cc tempest-TestStampPattern-827573592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-861e6a29-4776-4270-af06-d9ad99a5b929" returned: 0 in 0.348s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01141df3-8359-41ca-bffb-d9050a7fe1cc tempest-TestStampPattern-827573592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-861e6a29-4776-4270-af06-d9ad99a5b929 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:24 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-861e6a29-4776-4270-af06-d9ad99a5b929 Jul 28 10:52:24 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:24 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01141df3-8359-41ca-bffb-d9050a7fe1cc tempest-TestStampPattern-827573592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-861e6a29-4776-4270-af06-d9ad99a5b929" returned: 0 in 0.247s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:24 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-01141df3-8359-41ca-bffb-d9050a7fe1cc tempest-TestStampPattern-827573592 None] Lock "cinder-quobyte-861e6a29-4776-4270-af06-d9ad99a5b929" released by "delete_volume" :: held 0.631s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:52:24 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-01141df3-8359-41ca-bffb-d9050a7fe1cc tempest-TestStampPattern-827573592 None] Created reservations ['9a840036-99a6-421c-a5a9-1a780edfc4b7', 'e7278aac-db05-45ac-9785-a5e8f9169193', 'dae5cf80-2905-4fde-b246-5a4a9464692b', '4d5df744-775c-4821-978e-84b4c7b0778b'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:52:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01141df3-8359-41ca-bffb-d9050a7fe1cc tempest-TestStampPattern-827573592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:52:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01141df3-8359-41ca-bffb-d9050a7fe1cc tempest-TestStampPattern-827573592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:52:24 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01141df3-8359-41ca-bffb-d9050a7fe1cc tempest-TestStampPattern-827573592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:52:24 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01141df3-8359-41ca-bffb-d9050a7fe1cc tempest-TestStampPattern-827573592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:52:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01141df3-8359-41ca-bffb-d9050a7fe1cc tempest-TestStampPattern-827573592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:52:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01141df3-8359-41ca-bffb-d9050a7fe1cc tempest-TestStampPattern-827573592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:24 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:52:24 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:24 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01141df3-8359-41ca-bffb-d9050a7fe1cc tempest-TestStampPattern-827573592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.248s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:24 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-01141df3-8359-41ca-bffb-d9050a7fe1cc tempest-TestStampPattern-827573592 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:52:24 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-01141df3-8359-41ca-bffb-d9050a7fe1cc tempest-TestStampPattern-827573592 None] Deleted volume successfully. Jul 28 10:52:24 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-01141df3-8359-41ca-bffb-d9050a7fe1cc tempest-TestStampPattern-827573592 None] Lock "cinder-861e6a29-4776-4270-af06-d9ad99a5b929-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:52:25 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-98b0e456-e268-4833-bccd-ae20667899c4 tempest-TestStampPattern-827573592 None] Acquiring lock "cinder-353844c3-ec93-4739-91b0-eba1b88a2ad5-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:52:25 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-98b0e456-e268-4833-bccd-ae20667899c4 tempest-TestStampPattern-827573592 None] Lock "cinder-353844c3-ec93-4739-91b0-eba1b88a2ad5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:52:25 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-98b0e456-e268-4833-bccd-ae20667899c4 tempest-TestStampPattern-827573592 None] Acquiring lock "cinder-quobyte-b77f0531-5da8-497c-8277-3db903768502" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:52:25 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-98b0e456-e268-4833-bccd-ae20667899c4 tempest-TestStampPattern-827573592 None] Lock "cinder-quobyte-b77f0531-5da8-497c-8277-3db903768502" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:52:25 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-98b0e456-e268-4833-bccd-ae20667899c4 tempest-TestStampPattern-827573592 None] Acquiring lock "cinder-quobyte-353844c3-ec93-4739-91b0-eba1b88a2ad5" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:52:25 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-98b0e456-e268-4833-bccd-ae20667899c4 tempest-TestStampPattern-827573592 None] Lock "cinder-quobyte-353844c3-ec93-4739-91b0-eba1b88a2ad5" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:52:25 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-98b0e456-e268-4833-bccd-ae20667899c4 tempest-TestStampPattern-827573592 None] Deleting offline snapshot 353844c3-ec93-4739-91b0-eba1b88a2ad5 of volume b77f0531-5da8-497c-8277-3db903768502 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:52:25 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-98b0e456-e268-4833-bccd-ae20667899c4 tempest-TestStampPattern-827573592 None] snapshot_file for this snap is: volume-b77f0531-5da8-497c-8277-3db903768502.353844c3-ec93-4739-91b0-eba1b88a2ad5 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:52:25 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d84407-b2eb-4b5e-a302-7cff1d3ddc2e]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:52:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-98b0e456-e268-4833-bccd-ae20667899c4 tempest-TestStampPattern-827573592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502.353844c3-ec93-4739-91b0-eba1b88a2ad5 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:25 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502.353844c3-ec93-4739-91b0-eba1b88a2ad5 Jul 28 10:52:25 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:25 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-98b0e456-e268-4833-bccd-ae20667899c4 tempest-TestStampPattern-827573592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502.353844c3-ec93-4739-91b0-eba1b88a2ad5" returned: 0 in 0.351s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:25 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-98b0e456-e268-4833-bccd-ae20667899c4 tempest-TestStampPattern-827573592 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b77f0531-5da8-497c-8277-3db903768502(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:52:25 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a31692-5241-4a8b-9844-50dff614763b]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:52:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-98b0e456-e268-4833-bccd-ae20667899c4 tempest-TestStampPattern-827573592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:25 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502 Jul 28 10:52:25 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:25 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-98b0e456-e268-4833-bccd-ae20667899c4 tempest-TestStampPattern-827573592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502" returned: 0 in 0.360s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-98b0e456-e268-4833-bccd-ae20667899c4 tempest-TestStampPattern-827573592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502.353844c3-ec93-4739-91b0-eba1b88a2ad5 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:25 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502.353844c3-ec93-4739-91b0-eba1b88a2ad5 Jul 28 10:52:25 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:26 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-98b0e456-e268-4833-bccd-ae20667899c4 tempest-TestStampPattern-827573592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502.353844c3-ec93-4739-91b0-eba1b88a2ad5" returned: 0 in 0.341s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-98b0e456-e268-4833-bccd-ae20667899c4 tempest-TestStampPattern-827573592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502.353844c3-ec93-4739-91b0-eba1b88a2ad5 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:26 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502.353844c3-ec93-4739-91b0-eba1b88a2ad5 Jul 28 10:52:26 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:26 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-98b0e456-e268-4833-bccd-ae20667899c4 tempest-TestStampPattern-827573592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502.353844c3-ec93-4739-91b0-eba1b88a2ad5" returned: 0 in 0.241s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:26 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-98b0e456-e268-4833-bccd-ae20667899c4 tempest-TestStampPattern-827573592 None] Lock "cinder-quobyte-353844c3-ec93-4739-91b0-eba1b88a2ad5" released by "_delete_snapshot" :: held 1.388s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:52:26 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-98b0e456-e268-4833-bccd-ae20667899c4 tempest-TestStampPattern-827573592 None] Lock "cinder-quobyte-b77f0531-5da8-497c-8277-3db903768502" released by "delete_snapshot" :: held 1.407s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:52:26 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-98b0e456-e268-4833-bccd-ae20667899c4 tempest-TestStampPattern-827573592 None] Created reservations ['26ff8ede-0222-469d-9a79-b1ee396cd703', '4b76ea70-0558-44bd-8368-577d095df41d', 'eeebf959-5c37-40af-9762-f9605c64806b', '2f1f18ef-753b-4cfd-ae6a-19f763b2d81d'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:52:26 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-98b0e456-e268-4833-bccd-ae20667899c4 tempest-TestStampPattern-827573592 None] Delete snapshot completed successfully. Jul 28 10:52:26 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-98b0e456-e268-4833-bccd-ae20667899c4 tempest-TestStampPattern-827573592 None] Lock "cinder-353844c3-ec93-4739-91b0-eba1b88a2ad5-delete_snapshot" released by "delete_snapshot" :: held 1.528s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:52:28 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager._thread_info {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:52:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread count: 29 {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 10:52:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread info: [<_MainThread(MainThread, started 137939890385024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 10:52:31 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-2b6afeba-2c23-4fca-9de1-c496c1329025 tempest-TestStampPattern-827573592 None] Acquiring lock "cinder-b77f0531-5da8-497c-8277-3db903768502-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:52:31 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-2b6afeba-2c23-4fca-9de1-c496c1329025 tempest-TestStampPattern-827573592 None] Lock "cinder-b77f0531-5da8-497c-8277-3db903768502-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:52:31 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-2b6afeba-2c23-4fca-9de1-c496c1329025 tempest-TestStampPattern-827573592 None] Acquiring lock "cinder-quobyte-b77f0531-5da8-497c-8277-3db903768502" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:52:31 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-2b6afeba-2c23-4fca-9de1-c496c1329025 tempest-TestStampPattern-827573592 None] Lock "cinder-quobyte-b77f0531-5da8-497c-8277-3db903768502" acquired by "delete_volume" :: waited 0.017s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:52:31 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[624e9721-1f07-4995-bdd2-3588bf6cab6a]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:52:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2b6afeba-2c23-4fca-9de1-c496c1329025 tempest-TestStampPattern-827573592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:31 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502 Jul 28 10:52:31 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:31 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2b6afeba-2c23-4fca-9de1-c496c1329025 tempest-TestStampPattern-827573592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502" returned: 0 in 0.398s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2b6afeba-2c23-4fca-9de1-c496c1329025 tempest-TestStampPattern-827573592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:31 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502 Jul 28 10:52:31 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:31 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2b6afeba-2c23-4fca-9de1-c496c1329025 tempest-TestStampPattern-827573592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b77f0531-5da8-497c-8277-3db903768502" returned: 0 in 0.353s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:31 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-2b6afeba-2c23-4fca-9de1-c496c1329025 tempest-TestStampPattern-827573592 None] Lock "cinder-quobyte-b77f0531-5da8-497c-8277-3db903768502" released by "delete_volume" :: held 0.843s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:52:31 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-cc0d02fe-1ab9-4f5e-972c-89c56a0190ca req-34ef2017-7307-4a46-8db8-c5a2c6d82d3c tempest-TestShelveInstance-630767199 None] Terminate volume connection completed successfully. Jul 28 10:52:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [req-cc0d02fe-1ab9-4f5e-972c-89c56a0190ca req-34ef2017-7307-4a46-8db8-c5a2c6d82d3c tempest-TestShelveInstance-630767199 None] Deleting attachment bf5d8f21-a282-4eb8-9534-c7e2629f8a84. {{(pid=88413) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 10:52:32 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-2b6afeba-2c23-4fca-9de1-c496c1329025 tempest-TestStampPattern-827573592 None] Created reservations ['9f66a721-f2a8-4c4c-aca4-8524b55be62d', 'df3f488c-f530-4262-992f-493572d34038', '6af83f0a-b9a2-4528-9696-02bd548836a8', '1bda9bda-26c5-43e9-a0e7-0265a1b7478b'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:52:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-2b6afeba-2c23-4fca-9de1-c496c1329025 tempest-TestStampPattern-827573592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:52:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-2b6afeba-2c23-4fca-9de1-c496c1329025 tempest-TestStampPattern-827573592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:52:32 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-2b6afeba-2c23-4fca-9de1-c496c1329025 tempest-TestStampPattern-827573592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:52:32 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-2b6afeba-2c23-4fca-9de1-c496c1329025 tempest-TestStampPattern-827573592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:52:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-2b6afeba-2c23-4fca-9de1-c496c1329025 tempest-TestStampPattern-827573592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:52:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2b6afeba-2c23-4fca-9de1-c496c1329025 tempest-TestStampPattern-827573592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:32 devstack cinder-volume[88413]: DEBUG cinder.coordination [req-cc0d02fe-1ab9-4f5e-972c-89c56a0190ca req-d323f96b-904a-4ea8-92d5-ed39e0b8e5ad tempest-TestShelveInstance-630767199 None] Acquiring lock "cinder-82a37849-2a08-4318-aab9-1b499d4bd8a3-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:52:32 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:52:32 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:32 devstack cinder-volume[88413]: DEBUG cinder.coordination [req-cc0d02fe-1ab9-4f5e-972c-89c56a0190ca req-d323f96b-904a-4ea8-92d5-ed39e0b8e5ad tempest-TestShelveInstance-630767199 None] Lock "cinder-82a37849-2a08-4318-aab9-1b499d4bd8a3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:52:32 devstack cinder-volume[88413]: DEBUG cinder.coordination [req-cc0d02fe-1ab9-4f5e-972c-89c56a0190ca req-d323f96b-904a-4ea8-92d5-ed39e0b8e5ad tempest-TestShelveInstance-630767199 None] Acquiring lock "cinder-quobyte-82a37849-2a08-4318-aab9-1b499d4bd8a3" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:52:32 devstack cinder-volume[88413]: DEBUG cinder.coordination [req-cc0d02fe-1ab9-4f5e-972c-89c56a0190ca req-d323f96b-904a-4ea8-92d5-ed39e0b8e5ad tempest-TestShelveInstance-630767199 None] Lock "cinder-quobyte-82a37849-2a08-4318-aab9-1b499d4bd8a3" acquired by "delete_volume" :: waited 0.034s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:52:32 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43dd047-e698-47a7-a9d3-00b47b26dae7]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:52:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-cc0d02fe-1ab9-4f5e-972c-89c56a0190ca req-d323f96b-904a-4ea8-92d5-ed39e0b8e5ad tempest-TestShelveInstance-630767199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-82a37849-2a08-4318-aab9-1b499d4bd8a3 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:32 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2b6afeba-2c23-4fca-9de1-c496c1329025 tempest-TestStampPattern-827573592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.325s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:32 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-2b6afeba-2c23-4fca-9de1-c496c1329025 tempest-TestStampPattern-827573592 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:52:32 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-2b6afeba-2c23-4fca-9de1-c496c1329025 tempest-TestStampPattern-827573592 None] Deleted volume successfully. Jul 28 10:52:32 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-82a37849-2a08-4318-aab9-1b499d4bd8a3 Jul 28 10:52:32 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:32 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-2b6afeba-2c23-4fca-9de1-c496c1329025 tempest-TestStampPattern-827573592 None] Lock "cinder-b77f0531-5da8-497c-8277-3db903768502-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:52:32 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-cc0d02fe-1ab9-4f5e-972c-89c56a0190ca req-d323f96b-904a-4ea8-92d5-ed39e0b8e5ad tempest-TestShelveInstance-630767199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-82a37849-2a08-4318-aab9-1b499d4bd8a3" returned: 0 in 0.498s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-cc0d02fe-1ab9-4f5e-972c-89c56a0190ca req-d323f96b-904a-4ea8-92d5-ed39e0b8e5ad tempest-TestShelveInstance-630767199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-82a37849-2a08-4318-aab9-1b499d4bd8a3 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:32 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-82a37849-2a08-4318-aab9-1b499d4bd8a3 Jul 28 10:52:32 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:33 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-cc0d02fe-1ab9-4f5e-972c-89c56a0190ca req-d323f96b-904a-4ea8-92d5-ed39e0b8e5ad tempest-TestShelveInstance-630767199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-82a37849-2a08-4318-aab9-1b499d4bd8a3" returned: 0 in 0.269s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:33 devstack cinder-volume[88413]: DEBUG cinder.coordination [req-cc0d02fe-1ab9-4f5e-972c-89c56a0190ca req-d323f96b-904a-4ea8-92d5-ed39e0b8e5ad tempest-TestShelveInstance-630767199 None] Lock "cinder-quobyte-82a37849-2a08-4318-aab9-1b499d4bd8a3" released by "delete_volume" :: held 0.855s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:52:33 devstack cinder-volume[88413]: DEBUG cinder.quota [req-cc0d02fe-1ab9-4f5e-972c-89c56a0190ca req-d323f96b-904a-4ea8-92d5-ed39e0b8e5ad tempest-TestShelveInstance-630767199 None] Created reservations ['60f76049-1564-49cd-b255-596ed1f60848', '5cbdf830-cbc2-416d-b9a8-43872cb98fc9', 'a0dcec7d-ac08-483b-860b-5b176985a021', '0deea323-9820-457a-afb0-b67dce7ea7e7'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:52:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-cc0d02fe-1ab9-4f5e-972c-89c56a0190ca req-d323f96b-904a-4ea8-92d5-ed39e0b8e5ad tempest-TestShelveInstance-630767199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:52:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-cc0d02fe-1ab9-4f5e-972c-89c56a0190ca req-d323f96b-904a-4ea8-92d5-ed39e0b8e5ad tempest-TestShelveInstance-630767199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:52:33 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [req-cc0d02fe-1ab9-4f5e-972c-89c56a0190ca req-d323f96b-904a-4ea8-92d5-ed39e0b8e5ad tempest-TestShelveInstance-630767199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:52:33 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [req-cc0d02fe-1ab9-4f5e-972c-89c56a0190ca req-d323f96b-904a-4ea8-92d5-ed39e0b8e5ad tempest-TestShelveInstance-630767199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:52:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [req-cc0d02fe-1ab9-4f5e-972c-89c56a0190ca req-d323f96b-904a-4ea8-92d5-ed39e0b8e5ad tempest-TestShelveInstance-630767199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:52:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-cc0d02fe-1ab9-4f5e-972c-89c56a0190ca req-d323f96b-904a-4ea8-92d5-ed39e0b8e5ad tempest-TestShelveInstance-630767199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:33 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:52:33 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:33 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [req-cc0d02fe-1ab9-4f5e-972c-89c56a0190ca req-d323f96b-904a-4ea8-92d5-ed39e0b8e5ad tempest-TestShelveInstance-630767199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.328s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:33 devstack cinder-volume[88413]: DEBUG cinder.manager [req-cc0d02fe-1ab9-4f5e-972c-89c56a0190ca req-d323f96b-904a-4ea8-92d5-ed39e0b8e5ad tempest-TestShelveInstance-630767199 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:52:33 devstack cinder-volume[88413]: INFO cinder.volume.manager [req-cc0d02fe-1ab9-4f5e-972c-89c56a0190ca req-d323f96b-904a-4ea8-92d5-ed39e0b8e5ad tempest-TestShelveInstance-630767199 None] Deleted volume successfully. Jul 28 10:52:33 devstack cinder-volume[88413]: DEBUG cinder.coordination [req-cc0d02fe-1ab9-4f5e-972c-89c56a0190ca req-d323f96b-904a-4ea8-92d5-ed39e0b8e5ad tempest-TestShelveInstance-630767199 None] Lock "cinder-82a37849-2a08-4318-aab9-1b499d4bd8a3-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:52:43 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=27,cinder:UPDATE=32,cinder:INSERT=8 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:52:43 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-af9a8a54-fa36-4ed9-907b-403922effa25 tempest-CinderUnicodeTest-1681117688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:52:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-af9a8a54-fa36-4ed9-907b-403922effa25 tempest-CinderUnicodeTest-1681117688 None] Flow 'volume_create_manager' (74fe80c8-8693-4433-96d9-fc381b03e1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:52:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-af9a8a54-fa36-4ed9-907b-403922effa25 tempest-CinderUnicodeTest-1681117688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a401cc1-62bf-40be-b9a1-5343dae3558c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:52:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-af9a8a54-fa36-4ed9-907b-403922effa25 tempest-CinderUnicodeTest-1681117688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a401cc1-62bf-40be-b9a1-5343dae3558c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecd2dd12-46f3-415b-919f-7c3a58d87122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a5f51276e29472a9628bcd4acdbd05f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:52:43Z,use_quota=True,user_id='ef0644cc1b3a44ac96da28bf0e12b6fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:52:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-af9a8a54-fa36-4ed9-907b-403922effa25 tempest-CinderUnicodeTest-1681117688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3386e3e0-0e1f-483d-a91b-cd0ee769f551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:52:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-af9a8a54-fa36-4ed9-907b-403922effa25 tempest-CinderUnicodeTest-1681117688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3386e3e0-0e1f-483d-a91b-cd0ee769f551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:52:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-af9a8a54-fa36-4ed9-907b-403922effa25 tempest-CinderUnicodeTest-1681117688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (583e380d-03c5-4050-9d8a-e2f7fef63ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:52:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-af9a8a54-fa36-4ed9-907b-403922effa25 tempest-CinderUnicodeTest-1681117688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (583e380d-03c5-4050-9d8a-e2f7fef63ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecd2dd12-46f3-415b-919f-7c3a58d87122', 'volume_name': 'volume-ecd2dd12-46f3-415b-919f-7c3a58d87122', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:52:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-af9a8a54-fa36-4ed9-907b-403922effa25 tempest-CinderUnicodeTest-1681117688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89c08bbe-18b1-49ea-888f-b3c9031a00a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:52:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-af9a8a54-fa36-4ed9-907b-403922effa25 tempest-CinderUnicodeTest-1681117688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89c08bbe-18b1-49ea-888f-b3c9031a00a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:52:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-af9a8a54-fa36-4ed9-907b-403922effa25 tempest-CinderUnicodeTest-1681117688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59e1289f-4ef0-420d-85b7-dd2220bfb6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:52:43 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-af9a8a54-fa36-4ed9-907b-403922effa25 tempest-CinderUnicodeTest-1681117688 None] Volume ecd2dd12-46f3-415b-919f-7c3a58d87122: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecd2dd12-46f3-415b-919f-7c3a58d87122', 'volume_size': 1} Jul 28 10:52:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-af9a8a54-fa36-4ed9-907b-403922effa25 tempest-CinderUnicodeTest-1681117688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:52:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-af9a8a54-fa36-4ed9-907b-403922effa25 tempest-CinderUnicodeTest-1681117688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:52:43 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-af9a8a54-fa36-4ed9-907b-403922effa25 tempest-CinderUnicodeTest-1681117688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecd2dd12-46f3-415b-919f-7c3a58d87122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a5f51276e29472a9628bcd4acdbd05f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:52:43Z,use_quota=True,user_id='ef0644cc1b3a44ac96da28bf0e12b6fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:52:43 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-af9a8a54-fa36-4ed9-907b-403922effa25 tempest-CinderUnicodeTest-1681117688 None] Creating volume ecd2dd12-46f3-415b-919f-7c3a58d87122 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:52:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-af9a8a54-fa36-4ed9-907b-403922effa25 tempest-CinderUnicodeTest-1681117688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:52:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-af9a8a54-fa36-4ed9-907b-403922effa25 tempest-CinderUnicodeTest-1681117688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:52:43 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-af9a8a54-fa36-4ed9-907b-403922effa25 tempest-CinderUnicodeTest-1681117688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:52:43 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-af9a8a54-fa36-4ed9-907b-403922effa25 tempest-CinderUnicodeTest-1681117688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:52:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-af9a8a54-fa36-4ed9-907b-403922effa25 tempest-CinderUnicodeTest-1681117688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:52:43 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-af9a8a54-fa36-4ed9-907b-403922effa25 tempest-CinderUnicodeTest-1681117688 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:52:43 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-af9a8a54-fa36-4ed9-907b-403922effa25 tempest-CinderUnicodeTest-1681117688 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:52:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-af9a8a54-fa36-4ed9-907b-403922effa25 tempest-CinderUnicodeTest-1681117688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ecd2dd12-46f3-415b-919f-7c3a58d87122 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:43 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=31,cinder:UPDATE=30,cinder:INSERT=8,cinder:DELETE=3 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:52:43 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ecd2dd12-46f3-415b-919f-7c3a58d87122 1073741824 Jul 28 10:52:43 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:44 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-af9a8a54-fa36-4ed9-907b-403922effa25 tempest-CinderUnicodeTest-1681117688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ecd2dd12-46f3-415b-919f-7c3a58d87122 1073741824" returned: 0 in 0.465s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-af9a8a54-fa36-4ed9-907b-403922effa25 tempest-CinderUnicodeTest-1681117688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ecd2dd12-46f3-415b-919f-7c3a58d87122 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:44 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ecd2dd12-46f3-415b-919f-7c3a58d87122 Jul 28 10:52:44 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:44 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-af9a8a54-fa36-4ed9-907b-403922effa25 tempest-CinderUnicodeTest-1681117688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ecd2dd12-46f3-415b-919f-7c3a58d87122" returned: 0 in 0.260s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:44 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-af9a8a54-fa36-4ed9-907b-403922effa25 tempest-CinderUnicodeTest-1681117688 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:52:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-af9a8a54-fa36-4ed9-907b-403922effa25 tempest-CinderUnicodeTest-1681117688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:52:44 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-af9a8a54-fa36-4ed9-907b-403922effa25 tempest-CinderUnicodeTest-1681117688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59e1289f-4ef0-420d-85b7-dd2220bfb6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecd2dd12-46f3-415b-919f-7c3a58d87122', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:52:44 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-af9a8a54-fa36-4ed9-907b-403922effa25 tempest-CinderUnicodeTest-1681117688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1181839f-f870-4b27-9448-f5dec9970050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:52:44 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-af9a8a54-fa36-4ed9-907b-403922effa25 tempest-CinderUnicodeTest-1681117688 None] Volume volume-ecd2dd12-46f3-415b-919f-7c3a58d87122 (ecd2dd12-46f3-415b-919f-7c3a58d87122): created successfully Jul 28 10:52:44 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-af9a8a54-fa36-4ed9-907b-403922effa25 tempest-CinderUnicodeTest-1681117688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1181839f-f870-4b27-9448-f5dec9970050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:52:44 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-af9a8a54-fa36-4ed9-907b-403922effa25 tempest-CinderUnicodeTest-1681117688 None] Flow 'volume_create_manager' (74fe80c8-8693-4433-96d9-fc381b03e1ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:52:44 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-af9a8a54-fa36-4ed9-907b-403922effa25 tempest-CinderUnicodeTest-1681117688 None] Created volume successfully. Jul 28 10:52:45 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c7986ff-91ba-4118-ad9e-7e50edbad511 tempest-CinderUnicodeTest-1681117688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:52:45 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3c7986ff-91ba-4118-ad9e-7e50edbad511 tempest-CinderUnicodeTest-1681117688 None] Flow 'volume_create_manager' (1ef4bffd-6301-490f-96ec-5dc7c9156c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:52:45 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3c7986ff-91ba-4118-ad9e-7e50edbad511 tempest-CinderUnicodeTest-1681117688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6cd84c7-ee77-4df6-b679-eb69d481cba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:52:45 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3c7986ff-91ba-4118-ad9e-7e50edbad511 tempest-CinderUnicodeTest-1681117688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6cd84c7-ee77-4df6-b679-eb69d481cba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:52:45Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-717286845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ad4a7f7-4d9c-4876-8a79-79cfee2b963a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a5f51276e29472a9628bcd4acdbd05f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:52:45Z,use_quota=True,user_id='ef0644cc1b3a44ac96da28bf0e12b6fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:52:45 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3c7986ff-91ba-4118-ad9e-7e50edbad511 tempest-CinderUnicodeTest-1681117688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (117d71e1-7ead-4cd5-8e2e-379b855e3841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:52:45 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3c7986ff-91ba-4118-ad9e-7e50edbad511 tempest-CinderUnicodeTest-1681117688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (117d71e1-7ead-4cd5-8e2e-379b855e3841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:52:45 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3c7986ff-91ba-4118-ad9e-7e50edbad511 tempest-CinderUnicodeTest-1681117688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a619d67c-2515-4dd8-b9a5-3026bab9fb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:52:45 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3c7986ff-91ba-4118-ad9e-7e50edbad511 tempest-CinderUnicodeTest-1681117688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a619d67c-2515-4dd8-b9a5-3026bab9fb4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ad4a7f7-4d9c-4876-8a79-79cfee2b963a', 'volume_name': 'volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:52:45 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3c7986ff-91ba-4118-ad9e-7e50edbad511 tempest-CinderUnicodeTest-1681117688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e17bb907-a6c9-41b9-ae6d-7a698eb91da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:52:45 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3c7986ff-91ba-4118-ad9e-7e50edbad511 tempest-CinderUnicodeTest-1681117688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e17bb907-a6c9-41b9-ae6d-7a698eb91da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:52:45 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3c7986ff-91ba-4118-ad9e-7e50edbad511 tempest-CinderUnicodeTest-1681117688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e00140-030f-4053-8a27-1d97a8688ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:52:45 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-3c7986ff-91ba-4118-ad9e-7e50edbad511 tempest-CinderUnicodeTest-1681117688 None] Volume 0ad4a7f7-4d9c-4876-8a79-79cfee2b963a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a', 'volume_size': 1} Jul 28 10:52:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3c7986ff-91ba-4118-ad9e-7e50edbad511 tempest-CinderUnicodeTest-1681117688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:52:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3c7986ff-91ba-4118-ad9e-7e50edbad511 tempest-CinderUnicodeTest-1681117688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:52:45 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3c7986ff-91ba-4118-ad9e-7e50edbad511 tempest-CinderUnicodeTest-1681117688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:52:45Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-717286845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ad4a7f7-4d9c-4876-8a79-79cfee2b963a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a5f51276e29472a9628bcd4acdbd05f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:52:45Z,use_quota=True,user_id='ef0644cc1b3a44ac96da28bf0e12b6fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:52:45 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-3c7986ff-91ba-4118-ad9e-7e50edbad511 tempest-CinderUnicodeTest-1681117688 None] Creating volume 0ad4a7f7-4d9c-4876-8a79-79cfee2b963a {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:52:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3c7986ff-91ba-4118-ad9e-7e50edbad511 tempest-CinderUnicodeTest-1681117688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:52:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3c7986ff-91ba-4118-ad9e-7e50edbad511 tempest-CinderUnicodeTest-1681117688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:52:45 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3c7986ff-91ba-4118-ad9e-7e50edbad511 tempest-CinderUnicodeTest-1681117688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:52:45 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3c7986ff-91ba-4118-ad9e-7e50edbad511 tempest-CinderUnicodeTest-1681117688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:52:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3c7986ff-91ba-4118-ad9e-7e50edbad511 tempest-CinderUnicodeTest-1681117688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:52:45 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3c7986ff-91ba-4118-ad9e-7e50edbad511 tempest-CinderUnicodeTest-1681117688 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:52:45 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-3c7986ff-91ba-4118-ad9e-7e50edbad511 tempest-CinderUnicodeTest-1681117688 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:52:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3c7986ff-91ba-4118-ad9e-7e50edbad511 tempest-CinderUnicodeTest-1681117688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:45 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a 1073741824 Jul 28 10:52:45 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:45 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3c7986ff-91ba-4118-ad9e-7e50edbad511 tempest-CinderUnicodeTest-1681117688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a 1073741824" returned: 0 in 0.450s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3c7986ff-91ba-4118-ad9e-7e50edbad511 tempest-CinderUnicodeTest-1681117688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:45 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a Jul 28 10:52:45 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:45 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3c7986ff-91ba-4118-ad9e-7e50edbad511 tempest-CinderUnicodeTest-1681117688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a" returned: 0 in 0.255s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:45 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3c7986ff-91ba-4118-ad9e-7e50edbad511 tempest-CinderUnicodeTest-1681117688 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:52:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3c7986ff-91ba-4118-ad9e-7e50edbad511 tempest-CinderUnicodeTest-1681117688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:52:45 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3c7986ff-91ba-4118-ad9e-7e50edbad511 tempest-CinderUnicodeTest-1681117688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e00140-030f-4053-8a27-1d97a8688ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:52:45 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3c7986ff-91ba-4118-ad9e-7e50edbad511 tempest-CinderUnicodeTest-1681117688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e09bd53-96c0-46ed-88db-99c76032aae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:52:45 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-3c7986ff-91ba-4118-ad9e-7e50edbad511 tempest-CinderUnicodeTest-1681117688 None] Volume volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a (0ad4a7f7-4d9c-4876-8a79-79cfee2b963a): created successfully Jul 28 10:52:45 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3c7986ff-91ba-4118-ad9e-7e50edbad511 tempest-CinderUnicodeTest-1681117688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e09bd53-96c0-46ed-88db-99c76032aae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:52:45 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3c7986ff-91ba-4118-ad9e-7e50edbad511 tempest-CinderUnicodeTest-1681117688 None] Flow 'volume_create_manager' (1ef4bffd-6301-490f-96ec-5dc7c9156c06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:52:45 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-3c7986ff-91ba-4118-ad9e-7e50edbad511 tempest-CinderUnicodeTest-1681117688 None] Created volume successfully. Jul 28 10:52:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-03e5ef94-368c-4053-9b38-44e9886be305 tempest-CinderUnicodeTest-1681117688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:52:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-03e5ef94-368c-4053-9b38-44e9886be305 tempest-CinderUnicodeTest-1681117688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:52:46 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-03e5ef94-368c-4053-9b38-44e9886be305 tempest-CinderUnicodeTest-1681117688 None] Creating offline snapshot 098cc628-03b8-4eeb-aab6-0376c9e11664 of volume 0ad4a7f7-4d9c-4876-8a79-79cfee2b963a {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:52:46 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[d682b726-8af4-4918-858d-cedac5e4018e]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:52:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-03e5ef94-368c-4053-9b38-44e9886be305 tempest-CinderUnicodeTest-1681117688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:46 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a Jul 28 10:52:46 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:46 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:52:46 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Flow 'volume_create_manager' (11d60759-3adc-48cf-ba75-8c726a781755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:52:46 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f85d9b0-66e6-4c42-96d9-ee1f452c548f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:52:46 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f85d9b0-66e6-4c42-96d9-ee1f452c548f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:52:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a6009e-1e9a-49e8-89ed-0a0d4f622d7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41538731322b4a38a4b1f0eced9e1b26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:52:46Z,use_quota=True,user_id='087f92494fed4bf091b3efe28945feff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:52:46 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c1524e4-a9ae-4cb2-bb85-b7a2eb8e449b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:52:46 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c1524e4-a9ae-4cb2-bb85-b7a2eb8e449b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:52:46 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (746319c4-df76-4fc4-bc02-fa30e0d816d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:52:46 devstack cinder-volume[88413]: DEBUG cinder.image.glance [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Creating Keystone auth plugin from conf {{(pid=88413) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 28 10:52:46 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-03e5ef94-368c-4053-9b38-44e9886be305 tempest-CinderUnicodeTest-1681117688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a" returned: 0 in 0.372s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-03e5ef94-368c-4053-9b38-44e9886be305 tempest-CinderUnicodeTest-1681117688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a.098cc628-03b8-4eeb-aab6-0376c9e11664 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:46 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a.098cc628-03b8-4eeb-aab6-0376c9e11664 1G Jul 28 10:52:46 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:46 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (746319c4-df76-4fc4-bc02-fa30e0d816d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '19a6009e-1e9a-49e8-89ed-0a0d4f622d7e', 'volume_name': 'volume-19a6009e-1e9a-49e8-89ed-0a0d4f622d7e', 'volume_size': 1, 'image_id': 'f0f76fe0-9d01-4616-a05a-9fd220b28cbf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f0f76fe0-9d01-4616-a05a-9fd220b28cbf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '81996da28f740ccb82d0630e35dfedf8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '41538731322b4a38a4b1f0eced9e1b26', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '98b87e721d024acc1523f6d1a583b89d7bfb2b933172782ecc05476e2089c2be02691cb0735bfc3e69939452be5246926b72845a274a15cb12b831605f0013f5', 'id': 'f0f76fe0-9d01-4616-a05a-9fd220b28cbf', 'created_at': datetime.datetime(2026, 7, 28, 8, 52, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 8, 52, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f0f76fe0-9d01-4616-a05a-9fd220b28cbf/file', 'properties': {}}, 'image_service': }' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:52:46 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447200a7-f90c-47db-829a-958c615f93ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:52:46 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447200a7-f90c-47db-829a-958c615f93ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:52:46 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f37fc55-ce42-4fb1-8b09-a012c799c8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:52:46 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Volume 19a6009e-1e9a-49e8-89ed-0a0d4f622d7e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-19a6009e-1e9a-49e8-89ed-0a0d4f622d7e', 'volume_size': 1, 'image_id': 'f0f76fe0-9d01-4616-a05a-9fd220b28cbf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f0f76fe0-9d01-4616-a05a-9fd220b28cbf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '81996da28f740ccb82d0630e35dfedf8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '41538731322b4a38a4b1f0eced9e1b26', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '98b87e721d024acc1523f6d1a583b89d7bfb2b933172782ecc05476e2089c2be02691cb0735bfc3e69939452be5246926b72845a274a15cb12b831605f0013f5', 'id': 'f0f76fe0-9d01-4616-a05a-9fd220b28cbf', 'created_at': datetime.datetime(2026, 7, 28, 8, 52, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 8, 52, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f0f76fe0-9d01-4616-a05a-9fd220b28cbf/file', 'properties': {}}, 'image_service': } Jul 28 10:52:46 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Trying to clone 19a6009e-1e9a-49e8-89ed-0a0d4f622d7e from image f0f76fe0-9d01-4616-a05a-9fd220b28cbf at location (None, [{'url': 'file:///opt/stack/data/glance/images/f0f76fe0-9d01-4616-a05a-9fd220b28cbf', 'metadata': {}}]). {{(pid=88413) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 28 10:52:46 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f0f76fe0-9d01-4616-a05a-9fd220b28cbf_yoyutpa5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88413) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 28 10:52:46 devstack cinder-volume[88413]: INFO cinder.image.image_utils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Image download 0.00 MB at 0.00 MB/s Jul 28 10:52:46 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f53abbb-d9bc-447c-9ca2-a69a75a40ee9]: (4, 'raw') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:52:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f76fe0-9d01-4616-a05a-9fd220b28cbf_yoyutpa5devstack@QuobyteHD {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:47 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f76fe0-9d01-4616-a05a-9fd220b28cbf_yoyutpa5devstack@QuobyteHD Jul 28 10:52:47 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:47 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-03e5ef94-368c-4053-9b38-44e9886be305 tempest-CinderUnicodeTest-1681117688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a.098cc628-03b8-4eeb-aab6-0376c9e11664 1G" returned: 0 in 0.410s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-03e5ef94-368c-4053-9b38-44e9886be305 tempest-CinderUnicodeTest-1681117688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a.098cc628-03b8-4eeb-aab6-0376c9e11664 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:47 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a.098cc628-03b8-4eeb-aab6-0376c9e11664 Jul 28 10:52:47 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:47 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f76fe0-9d01-4616-a05a-9fd220b28cbf_yoyutpa5devstack@QuobyteHD" returned: 0 in 0.341s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f76fe0-9d01-4616-a05a-9fd220b28cbf_yoyutpa5devstack@QuobyteHD {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:47 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f76fe0-9d01-4616-a05a-9fd220b28cbf_yoyutpa5devstack@QuobyteHD Jul 28 10:52:47 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:47 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-03e5ef94-368c-4053-9b38-44e9886be305 tempest-CinderUnicodeTest-1681117688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a.098cc628-03b8-4eeb-aab6-0376c9e11664" returned: 0 in 0.315s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:47 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-03e5ef94-368c-4053-9b38-44e9886be305 tempest-CinderUnicodeTest-1681117688 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a.098cc628-03b8-4eeb-aab6-0376c9e11664 is being set with open permissions: ugo+rw Jul 28 10:52:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-03e5ef94-368c-4053-9b38-44e9886be305 tempest-CinderUnicodeTest-1681117688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a.098cc628-03b8-4eeb-aab6-0376c9e11664 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:47 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a.098cc628-03b8-4eeb-aab6-0376c9e11664 Jul 28 10:52:47 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:47 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f76fe0-9d01-4616-a05a-9fd220b28cbf_yoyutpa5devstack@QuobyteHD" returned: 1 in 0.333s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f76fe0-9d01-4616-a05a-9fd220b28cbf_yoyutpa5devstack@QuobyteHD' failed. Not Retrying. {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 10:52:47 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Temporary image f0f76fe0-9d01-4616-a05a-9fd220b28cbf is fetched for user 087f92494fed4bf091b3efe28945feff. {{(pid=88413) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 28 10:52:47 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[6954f9e7-4afb-4975-b407-001e3baf070b]: (4, 'raw') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:52:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f76fe0-9d01-4616-a05a-9fd220b28cbf_yoyutpa5devstack@QuobyteHD {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:47 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-03e5ef94-368c-4053-9b38-44e9886be305 tempest-CinderUnicodeTest-1681117688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a.098cc628-03b8-4eeb-aab6-0376c9e11664" returned: 0 in 0.259s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-03e5ef94-368c-4053-9b38-44e9886be305 tempest-CinderUnicodeTest-1681117688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:47 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f76fe0-9d01-4616-a05a-9fd220b28cbf_yoyutpa5devstack@QuobyteHD Jul 28 10:52:47 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:47 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a.info Jul 28 10:52:47 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:48 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f76fe0-9d01-4616-a05a-9fd220b28cbf_yoyutpa5devstack@QuobyteHD" returned: 0 in 0.340s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f76fe0-9d01-4616-a05a-9fd220b28cbf_yoyutpa5devstack@QuobyteHD {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:48 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-03e5ef94-368c-4053-9b38-44e9886be305 tempest-CinderUnicodeTest-1681117688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a.info" returned: 0 in 0.261s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:48 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-03e5ef94-368c-4053-9b38-44e9886be305 tempest-CinderUnicodeTest-1681117688 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a.info is being set with open permissions: ugo+rw Jul 28 10:52:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-03e5ef94-368c-4053-9b38-44e9886be305 tempest-CinderUnicodeTest-1681117688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:48 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a.info Jul 28 10:52:48 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:48 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f76fe0-9d01-4616-a05a-9fd220b28cbf_yoyutpa5devstack@QuobyteHD Jul 28 10:52:48 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:48 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-03e5ef94-368c-4053-9b38-44e9886be305 tempest-CinderUnicodeTest-1681117688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a.info" returned: 0 in 0.243s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-03e5ef94-368c-4053-9b38-44e9886be305 tempest-CinderUnicodeTest-1681117688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.961s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:52:48 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-03e5ef94-368c-4053-9b38-44e9886be305 tempest-CinderUnicodeTest-1681117688 None] Create snapshot completed successfully Jul 28 10:52:48 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f76fe0-9d01-4616-a05a-9fd220b28cbf_yoyutpa5devstack@QuobyteHD" returned: 1 in 0.327s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f76fe0-9d01-4616-a05a-9fd220b28cbf_yoyutpa5devstack@QuobyteHD' failed. Not Retrying. {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 10:52:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:52:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:52:48 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:52:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a6009e-1e9a-49e8-89ed-0a0d4f622d7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41538731322b4a38a4b1f0eced9e1b26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:52:46Z,use_quota=True,user_id='087f92494fed4bf091b3efe28945feff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:52:48 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Creating volume 19a6009e-1e9a-49e8-89ed-0a0d4f622d7e {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:52:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:52:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:52:48 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:52:48 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:52:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:52:48 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:52:48 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:52:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-19a6009e-1e9a-49e8-89ed-0a0d4f622d7e 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:48 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-19a6009e-1e9a-49e8-89ed-0a0d4f622d7e 1073741824 Jul 28 10:52:48 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fe025ce3-78ed-4716-a929-e27203022a27 tempest-CinderUnicodeTest-1681117688 None] Acquiring lock "cinder-098cc628-03b8-4eeb-aab6-0376c9e11664-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:52:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fe025ce3-78ed-4716-a929-e27203022a27 tempest-CinderUnicodeTest-1681117688 None] Lock "cinder-098cc628-03b8-4eeb-aab6-0376c9e11664-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:52:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fe025ce3-78ed-4716-a929-e27203022a27 tempest-CinderUnicodeTest-1681117688 None] Acquiring lock "cinder-quobyte-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:52:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fe025ce3-78ed-4716-a929-e27203022a27 tempest-CinderUnicodeTest-1681117688 None] Lock "cinder-quobyte-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:52:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fe025ce3-78ed-4716-a929-e27203022a27 tempest-CinderUnicodeTest-1681117688 None] Acquiring lock "cinder-quobyte-098cc628-03b8-4eeb-aab6-0376c9e11664" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:52:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fe025ce3-78ed-4716-a929-e27203022a27 tempest-CinderUnicodeTest-1681117688 None] Lock "cinder-quobyte-098cc628-03b8-4eeb-aab6-0376c9e11664" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:52:48 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-fe025ce3-78ed-4716-a929-e27203022a27 tempest-CinderUnicodeTest-1681117688 None] Deleting offline snapshot 098cc628-03b8-4eeb-aab6-0376c9e11664 of volume 0ad4a7f7-4d9c-4876-8a79-79cfee2b963a {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:52:48 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-fe025ce3-78ed-4716-a929-e27203022a27 tempest-CinderUnicodeTest-1681117688 None] snapshot_file for this snap is: volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a.098cc628-03b8-4eeb-aab6-0376c9e11664 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:52:48 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d86f1b-e0f1-4bde-b2e0-0a040caf6966]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:52:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fe025ce3-78ed-4716-a929-e27203022a27 tempest-CinderUnicodeTest-1681117688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a.098cc628-03b8-4eeb-aab6-0376c9e11664 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:48 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a.098cc628-03b8-4eeb-aab6-0376c9e11664 Jul 28 10:52:48 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:48 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-19a6009e-1e9a-49e8-89ed-0a0d4f622d7e 1073741824" returned: 0 in 0.437s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-19a6009e-1e9a-49e8-89ed-0a0d4f622d7e {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:48 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-19a6009e-1e9a-49e8-89ed-0a0d4f622d7e Jul 28 10:52:48 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:48 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fe025ce3-78ed-4716-a929-e27203022a27 tempest-CinderUnicodeTest-1681117688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a.098cc628-03b8-4eeb-aab6-0376c9e11664" returned: 0 in 0.395s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:48 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-fe025ce3-78ed-4716-a929-e27203022a27 tempest-CinderUnicodeTest-1681117688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:52:48 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a01b90-19d7-406b-ba37-2e77f5e3b645]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:52:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fe025ce3-78ed-4716-a929-e27203022a27 tempest-CinderUnicodeTest-1681117688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:49 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-19a6009e-1e9a-49e8-89ed-0a0d4f622d7e" returned: 0 in 0.248s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:49 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:52:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:52:49 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a Jul 28 10:52:49 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:49 devstack cinder-volume[88413]: DEBUG cinder.volume.volume_utils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Attempting download of f0f76fe0-9d01-4616-a05a-9fd220b28cbf ((None, [{'url': 'file:///opt/stack/data/glance/images/f0f76fe0-9d01-4616-a05a-9fd220b28cbf', 'metadata': {}}])) to volume 19a6009e-1e9a-49e8-89ed-0a0d4f622d7e. {{(pid=88413) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 28 10:52:49 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a086f95-4747-4aee-9894-0cf64920d8ef]: (4, 'raw') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:52:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f0f76fe0-9d01-4616-a05a-9fd220b28cbf_ntytgwe1 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:49 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f0f76fe0-9d01-4616-a05a-9fd220b28cbf_ntytgwe1 Jul 28 10:52:49 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:49 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fe025ce3-78ed-4716-a929-e27203022a27 tempest-CinderUnicodeTest-1681117688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a" returned: 0 in 0.347s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fe025ce3-78ed-4716-a929-e27203022a27 tempest-CinderUnicodeTest-1681117688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a.098cc628-03b8-4eeb-aab6-0376c9e11664 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:49 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a.098cc628-03b8-4eeb-aab6-0376c9e11664 Jul 28 10:52:49 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:49 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f0f76fe0-9d01-4616-a05a-9fd220b28cbf_ntytgwe1" returned: 0 in 0.337s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f0f76fe0-9d01-4616-a05a-9fd220b28cbf_ntytgwe1 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:49 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f0f76fe0-9d01-4616-a05a-9fd220b28cbf_ntytgwe1 Jul 28 10:52:49 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:49 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fe025ce3-78ed-4716-a929-e27203022a27 tempest-CinderUnicodeTest-1681117688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a.098cc628-03b8-4eeb-aab6-0376c9e11664" returned: 0 in 0.372s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fe025ce3-78ed-4716-a929-e27203022a27 tempest-CinderUnicodeTest-1681117688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a.098cc628-03b8-4eeb-aab6-0376c9e11664 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:49 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a.098cc628-03b8-4eeb-aab6-0376c9e11664 Jul 28 10:52:49 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:49 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f0f76fe0-9d01-4616-a05a-9fd220b28cbf_ntytgwe1" returned: 1 in 0.339s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f0f76fe0-9d01-4616-a05a-9fd220b28cbf_ntytgwe1' failed. Not Retrying. {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 10:52:49 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[6353ed68-7401-4543-8934-1f8d263f3676]: (4, 'raw') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:52:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f76fe0-9d01-4616-a05a-9fd220b28cbf_yoyutpa5devstack@QuobyteHD {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:49 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f76fe0-9d01-4616-a05a-9fd220b28cbf_yoyutpa5devstack@QuobyteHD Jul 28 10:52:49 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:49 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fe025ce3-78ed-4716-a929-e27203022a27 tempest-CinderUnicodeTest-1681117688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a.098cc628-03b8-4eeb-aab6-0376c9e11664" returned: 0 in 0.253s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fe025ce3-78ed-4716-a929-e27203022a27 tempest-CinderUnicodeTest-1681117688 None] Lock "cinder-quobyte-098cc628-03b8-4eeb-aab6-0376c9e11664" released by "_delete_snapshot" :: held 1.472s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:52:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fe025ce3-78ed-4716-a929-e27203022a27 tempest-CinderUnicodeTest-1681117688 None] Lock "cinder-quobyte-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a" released by "delete_snapshot" :: held 1.498s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:52:50 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-fe025ce3-78ed-4716-a929-e27203022a27 tempest-CinderUnicodeTest-1681117688 None] Created reservations ['4f95acd3-d223-4a03-b045-78028f316bb1', 'a5b0b683-1d02-49de-9624-a6529f022a47', '34873d0c-91f9-4aea-9af2-de0bd0f1d719', 'cb9e8c26-381f-45be-9cd5-b1668aaab853'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:52:50 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-fe025ce3-78ed-4716-a929-e27203022a27 tempest-CinderUnicodeTest-1681117688 None] Delete snapshot completed successfully. Jul 28 10:52:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fe025ce3-78ed-4716-a929-e27203022a27 tempest-CinderUnicodeTest-1681117688 None] Lock "cinder-098cc628-03b8-4eeb-aab6-0376c9e11664-delete_snapshot" released by "delete_snapshot" :: held 1.633s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:52:50 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f76fe0-9d01-4616-a05a-9fd220b28cbf_yoyutpa5devstack@QuobyteHD" returned: 0 in 0.330s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f76fe0-9d01-4616-a05a-9fd220b28cbf_yoyutpa5devstack@QuobyteHD {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:50 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f76fe0-9d01-4616-a05a-9fd220b28cbf_yoyutpa5devstack@QuobyteHD Jul 28 10:52:50 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:50 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f76fe0-9d01-4616-a05a-9fd220b28cbf_yoyutpa5devstack@QuobyteHD" returned: 1 in 0.342s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0f76fe0-9d01-4616-a05a-9fd220b28cbf_yoyutpa5devstack@QuobyteHD' failed. Not Retrying. {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 10:52:50 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] f0f76fe0-9d01-4616-a05a-9fd220b28cbf was raw, converting to qcow2 {{(pid=88413) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 28 10:52:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f0f76fe0-9d01-4616-a05a-9fd220b28cbf_yoyutpa5devstack@QuobyteHD /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-19a6009e-1e9a-49e8-89ed-0a0d4f622d7e {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:50 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f0f76fe0-9d01-4616-a05a-9fd220b28cbf_yoyutpa5devstack@QuobyteHD /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-19a6009e-1e9a-49e8-89ed-0a0d4f622d7e Jul 28 10:52:50 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0fa50d8a-7ddd-4378-b624-9f8fdc6a3b8e tempest-CinderUnicodeTest-1681117688 None] Acquiring lock "cinder-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:52:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0fa50d8a-7ddd-4378-b624-9f8fdc6a3b8e tempest-CinderUnicodeTest-1681117688 None] Lock "cinder-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:52:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0fa50d8a-7ddd-4378-b624-9f8fdc6a3b8e tempest-CinderUnicodeTest-1681117688 None] Acquiring lock "cinder-quobyte-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:52:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0fa50d8a-7ddd-4378-b624-9f8fdc6a3b8e tempest-CinderUnicodeTest-1681117688 None] Lock "cinder-quobyte-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a" acquired by "delete_volume" :: waited 0.016s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:52:50 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b9565f-f220-44ad-82da-f1a3c6a1df89]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:52:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0fa50d8a-7ddd-4378-b624-9f8fdc6a3b8e tempest-CinderUnicodeTest-1681117688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:50 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a Jul 28 10:52:50 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:50 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f0f76fe0-9d01-4616-a05a-9fd220b28cbf_yoyutpa5devstack@QuobyteHD /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-19a6009e-1e9a-49e8-89ed-0a0d4f622d7e" returned: 0 in 0.469s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:50 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f0f76fe0-9d01-4616-a05a-9fd220b28cbf_yoyutpa5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-19a6009e-1e9a-49e8-89ed-0a0d4f622d7e {{(pid=88413) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 10:52:50 devstack cinder-volume[88413]: INFO cinder.image.image_utils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Converted 0.00 MB image at 0.00 MB/s Jul 28 10:52:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-19a6009e-1e9a-49e8-89ed-0a0d4f622d7e 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:51 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-19a6009e-1e9a-49e8-89ed-0a0d4f622d7e 1G Jul 28 10:52:51 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:51 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0fa50d8a-7ddd-4378-b624-9f8fdc6a3b8e tempest-CinderUnicodeTest-1681117688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a" returned: 0 in 0.373s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0fa50d8a-7ddd-4378-b624-9f8fdc6a3b8e tempest-CinderUnicodeTest-1681117688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:51 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a Jul 28 10:52:51 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:51 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-19a6009e-1e9a-49e8-89ed-0a0d4f622d7e 1G" returned: 0 in 0.327s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:51 devstack cinder-volume[88413]: DEBUG cinder.volume.volume_utils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Downloaded image f0f76fe0-9d01-4616-a05a-9fd220b28cbf ((None, [{'url': 'file:///opt/stack/data/glance/images/f0f76fe0-9d01-4616-a05a-9fd220b28cbf', 'metadata': {}}])) to volume 19a6009e-1e9a-49e8-89ed-0a0d4f622d7e successfully. {{(pid=88413) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 28 10:52:51 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Temporary image f0f76fe0-9d01-4616-a05a-9fd220b28cbf for user 087f92494fed4bf091b3efe28945feff is deleted. {{(pid=88413) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 28 10:52:51 devstack cinder-volume[88413]: DEBUG cinder.volume.volume_utils [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Marking volume 19a6009e-1e9a-49e8-89ed-0a0d4f622d7e as bootable. {{(pid=88413) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 28 10:52:51 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Copying metadata from image f0f76fe0-9d01-4616-a05a-9fd220b28cbf to 19a6009e-1e9a-49e8-89ed-0a0d4f622d7e. {{(pid=88413) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 28 10:52:51 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Creating volume glance metadata for volume 19a6009e-1e9a-49e8-89ed-0a0d4f622d7e backed by image f0f76fe0-9d01-4616-a05a-9fd220b28cbf with: {'image_id': 'f0f76fe0-9d01-4616-a05a-9fd220b28cbf', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '81996da28f740ccb82d0630e35dfedf8', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88413) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 28 10:52:51 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f37fc55-ce42-4fb1-8b09-a012c799c8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19a6009e-1e9a-49e8-89ed-0a0d4f622d7e', 'volume_size': 1, 'image_id': 'f0f76fe0-9d01-4616-a05a-9fd220b28cbf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f0f76fe0-9d01-4616-a05a-9fd220b28cbf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '81996da28f740ccb82d0630e35dfedf8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '41538731322b4a38a4b1f0eced9e1b26', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '98b87e721d024acc1523f6d1a583b89d7bfb2b933172782ecc05476e2089c2be02691cb0735bfc3e69939452be5246926b72845a274a15cb12b831605f0013f5', 'id': 'f0f76fe0-9d01-4616-a05a-9fd220b28cbf', 'created_at': datetime.datetime(2026, 7, 28, 8, 52, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 8, 52, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f0f76fe0-9d01-4616-a05a-9fd220b28cbf/file', 'properties': {}}, 'image_service': }' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:52:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a319d3c3-5421-4da8-9650-4c2046a995db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:52:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0fa50d8a-7ddd-4378-b624-9f8fdc6a3b8e tempest-CinderUnicodeTest-1681117688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a" returned: 0 in 0.261s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0fa50d8a-7ddd-4378-b624-9f8fdc6a3b8e tempest-CinderUnicodeTest-1681117688 None] Lock "cinder-quobyte-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a" released by "delete_volume" :: held 0.700s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:52:51 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Volume volume-19a6009e-1e9a-49e8-89ed-0a0d4f622d7e (19a6009e-1e9a-49e8-89ed-0a0d4f622d7e): created successfully Jul 28 10:52:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a319d3c3-5421-4da8-9650-4c2046a995db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:52:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Flow 'volume_create_manager' (11d60759-3adc-48cf-ba75-8c726a781755) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:52:51 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-b3e3eb70-46a7-4298-bc05-7f181544004e tempest-VolumeImageDependencyTests-1698546080 None] Created volume successfully. Jul 28 10:52:51 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-0fa50d8a-7ddd-4378-b624-9f8fdc6a3b8e tempest-CinderUnicodeTest-1681117688 None] Created reservations ['ac3e5a5f-6dae-4ab0-a254-aff3db5c5f0a', '643150a7-fb2a-446c-b372-6f0b58d225a2', 'b21a5a8a-e9f9-4bd1-9631-2ea2e3eb861d', 'b721c27e-84d3-40a7-ad67-1a4fa87bce5a'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:52:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0fa50d8a-7ddd-4378-b624-9f8fdc6a3b8e tempest-CinderUnicodeTest-1681117688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:52:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0fa50d8a-7ddd-4378-b624-9f8fdc6a3b8e tempest-CinderUnicodeTest-1681117688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:52:51 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0fa50d8a-7ddd-4378-b624-9f8fdc6a3b8e tempest-CinderUnicodeTest-1681117688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:52:51 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0fa50d8a-7ddd-4378-b624-9f8fdc6a3b8e tempest-CinderUnicodeTest-1681117688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:52:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0fa50d8a-7ddd-4378-b624-9f8fdc6a3b8e tempest-CinderUnicodeTest-1681117688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:52:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0fa50d8a-7ddd-4378-b624-9f8fdc6a3b8e tempest-CinderUnicodeTest-1681117688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:51 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:52:51 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f2b6badf-2d66-4683-8bb0-a3c817672f8b tempest-CinderUnicodeTest-1681117688 None] Acquiring lock "cinder-ecd2dd12-46f3-415b-919f-7c3a58d87122-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:52:51 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0fa50d8a-7ddd-4378-b624-9f8fdc6a3b8e tempest-CinderUnicodeTest-1681117688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.278s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:51 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-0fa50d8a-7ddd-4378-b624-9f8fdc6a3b8e tempest-CinderUnicodeTest-1681117688 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:52:51 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-0fa50d8a-7ddd-4378-b624-9f8fdc6a3b8e tempest-CinderUnicodeTest-1681117688 None] Deleted volume successfully. Jul 28 10:52:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f2b6badf-2d66-4683-8bb0-a3c817672f8b tempest-CinderUnicodeTest-1681117688 None] Lock "cinder-ecd2dd12-46f3-415b-919f-7c3a58d87122-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:52:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7b01da19-3a41-4855-94c4-44cff70bffb1 tempest-VolumeImageDependencyTests-1698546080 None] Acquiring lock "cinder-19a6009e-1e9a-49e8-89ed-0a0d4f622d7e-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:52:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0fa50d8a-7ddd-4378-b624-9f8fdc6a3b8e tempest-CinderUnicodeTest-1681117688 None] Lock "cinder-0ad4a7f7-4d9c-4876-8a79-79cfee2b963a-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:52:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7b01da19-3a41-4855-94c4-44cff70bffb1 tempest-VolumeImageDependencyTests-1698546080 None] Lock "cinder-19a6009e-1e9a-49e8-89ed-0a0d4f622d7e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:52:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f2b6badf-2d66-4683-8bb0-a3c817672f8b tempest-CinderUnicodeTest-1681117688 None] Acquiring lock "cinder-quobyte-ecd2dd12-46f3-415b-919f-7c3a58d87122" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:52:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7b01da19-3a41-4855-94c4-44cff70bffb1 tempest-VolumeImageDependencyTests-1698546080 None] Acquiring lock "cinder-quobyte-19a6009e-1e9a-49e8-89ed-0a0d4f622d7e" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:52:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f2b6badf-2d66-4683-8bb0-a3c817672f8b tempest-CinderUnicodeTest-1681117688 None] Lock "cinder-quobyte-ecd2dd12-46f3-415b-919f-7c3a58d87122" acquired by "delete_volume" :: waited 0.022s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:52:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7b01da19-3a41-4855-94c4-44cff70bffb1 tempest-VolumeImageDependencyTests-1698546080 None] Lock "cinder-quobyte-19a6009e-1e9a-49e8-89ed-0a0d4f622d7e" acquired by "delete_volume" :: waited 0.027s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:52:51 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2d46f6-8eaa-4eef-89fe-f3bb7638f7b2]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:52:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f2b6badf-2d66-4683-8bb0-a3c817672f8b tempest-CinderUnicodeTest-1681117688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ecd2dd12-46f3-415b-919f-7c3a58d87122 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:51 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6438f7-bfd9-4799-b951-22064f2c7778]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:52:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7b01da19-3a41-4855-94c4-44cff70bffb1 tempest-VolumeImageDependencyTests-1698546080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-19a6009e-1e9a-49e8-89ed-0a0d4f622d7e {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:52 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ecd2dd12-46f3-415b-919f-7c3a58d87122 Jul 28 10:52:52 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:52 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-19a6009e-1e9a-49e8-89ed-0a0d4f622d7e Jul 28 10:52:52 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:52 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f2b6badf-2d66-4683-8bb0-a3c817672f8b tempest-CinderUnicodeTest-1681117688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ecd2dd12-46f3-415b-919f-7c3a58d87122" returned: 0 in 0.388s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f2b6badf-2d66-4683-8bb0-a3c817672f8b tempest-CinderUnicodeTest-1681117688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ecd2dd12-46f3-415b-919f-7c3a58d87122 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:52 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7b01da19-3a41-4855-94c4-44cff70bffb1 tempest-VolumeImageDependencyTests-1698546080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-19a6009e-1e9a-49e8-89ed-0a0d4f622d7e" returned: 0 in 0.392s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7b01da19-3a41-4855-94c4-44cff70bffb1 tempest-VolumeImageDependencyTests-1698546080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-19a6009e-1e9a-49e8-89ed-0a0d4f622d7e {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:52 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ecd2dd12-46f3-415b-919f-7c3a58d87122 Jul 28 10:52:52 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:52 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-19a6009e-1e9a-49e8-89ed-0a0d4f622d7e Jul 28 10:52:52 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:52 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f2b6badf-2d66-4683-8bb0-a3c817672f8b tempest-CinderUnicodeTest-1681117688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ecd2dd12-46f3-415b-919f-7c3a58d87122" returned: 0 in 0.256s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:52 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f2b6badf-2d66-4683-8bb0-a3c817672f8b tempest-CinderUnicodeTest-1681117688 None] Lock "cinder-quobyte-ecd2dd12-46f3-415b-919f-7c3a58d87122" released by "delete_volume" :: held 0.698s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:52:52 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7b01da19-3a41-4855-94c4-44cff70bffb1 tempest-VolumeImageDependencyTests-1698546080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-19a6009e-1e9a-49e8-89ed-0a0d4f622d7e" returned: 0 in 0.258s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:52 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7b01da19-3a41-4855-94c4-44cff70bffb1 tempest-VolumeImageDependencyTests-1698546080 None] Lock "cinder-quobyte-19a6009e-1e9a-49e8-89ed-0a0d4f622d7e" released by "delete_volume" :: held 0.693s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:52:52 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-f2b6badf-2d66-4683-8bb0-a3c817672f8b tempest-CinderUnicodeTest-1681117688 None] Created reservations ['df083f25-92d8-4226-9fbb-1e4fab8529ef', '21419e0a-ad92-4a7d-81b6-e8983dd75e52', '48262681-92e8-4813-adc8-a8832dd5d89e', 'c3b0ede6-c30a-468b-9b7b-6323b17b87dc'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:52:52 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-7b01da19-3a41-4855-94c4-44cff70bffb1 tempest-VolumeImageDependencyTests-1698546080 None] Created reservations ['356ae3cd-5964-487f-9a44-583488cbfb28', 'f445d5f7-e0df-4ff7-8106-92ebb42a4ddb', 'beccd822-4d07-4540-82fe-ed1912a6ba0e', '89e4d89e-5485-416d-943d-fd83709e065e'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:52:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f2b6badf-2d66-4683-8bb0-a3c817672f8b tempest-CinderUnicodeTest-1681117688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:52:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f2b6badf-2d66-4683-8bb0-a3c817672f8b tempest-CinderUnicodeTest-1681117688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:52:52 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f2b6badf-2d66-4683-8bb0-a3c817672f8b tempest-CinderUnicodeTest-1681117688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:52:52 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f2b6badf-2d66-4683-8bb0-a3c817672f8b tempest-CinderUnicodeTest-1681117688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:52:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f2b6badf-2d66-4683-8bb0-a3c817672f8b tempest-CinderUnicodeTest-1681117688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:52:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f2b6badf-2d66-4683-8bb0-a3c817672f8b tempest-CinderUnicodeTest-1681117688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:52 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:52:52 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7b01da19-3a41-4855-94c4-44cff70bffb1 tempest-VolumeImageDependencyTests-1698546080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:52:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7b01da19-3a41-4855-94c4-44cff70bffb1 tempest-VolumeImageDependencyTests-1698546080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:52:52 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7b01da19-3a41-4855-94c4-44cff70bffb1 tempest-VolumeImageDependencyTests-1698546080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:52:52 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7b01da19-3a41-4855-94c4-44cff70bffb1 tempest-VolumeImageDependencyTests-1698546080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:52:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7b01da19-3a41-4855-94c4-44cff70bffb1 tempest-VolumeImageDependencyTests-1698546080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:52:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7b01da19-3a41-4855-94c4-44cff70bffb1 tempest-VolumeImageDependencyTests-1698546080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:52 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:52:52 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:53 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f2b6badf-2d66-4683-8bb0-a3c817672f8b tempest-CinderUnicodeTest-1681117688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.262s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:53 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-f2b6badf-2d66-4683-8bb0-a3c817672f8b tempest-CinderUnicodeTest-1681117688 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:52:53 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-f2b6badf-2d66-4683-8bb0-a3c817672f8b tempest-CinderUnicodeTest-1681117688 None] Deleted volume successfully. Jul 28 10:52:53 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f2b6badf-2d66-4683-8bb0-a3c817672f8b tempest-CinderUnicodeTest-1681117688 None] Lock "cinder-ecd2dd12-46f3-415b-919f-7c3a58d87122-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:52:53 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7b01da19-3a41-4855-94c4-44cff70bffb1 tempest-VolumeImageDependencyTests-1698546080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.294s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:53 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-7b01da19-3a41-4855-94c4-44cff70bffb1 tempest-VolumeImageDependencyTests-1698546080 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:52:53 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-7b01da19-3a41-4855-94c4-44cff70bffb1 tempest-VolumeImageDependencyTests-1698546080 None] Deleted volume successfully. Jul 28 10:52:53 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7b01da19-3a41-4855-94c4-44cff70bffb1 tempest-VolumeImageDependencyTests-1698546080 None] Lock "cinder-19a6009e-1e9a-49e8-89ed-0a0d4f622d7e-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:52:56 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d4697e9-dd4b-44c6-a5a8-d74c14c6c795 tempest-ProjectReaderTests-1108167675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:52:56 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d4697e9-dd4b-44c6-a5a8-d74c14c6c795 tempest-ProjectReaderTests-1108167675 None] Flow 'volume_create_manager' (7a06597b-c2e7-443f-bbed-cd173cb08a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:52:56 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d4697e9-dd4b-44c6-a5a8-d74c14c6c795 tempest-ProjectReaderTests-1108167675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c72e7fe4-fc8c-47f7-b8b9-3f5e758beff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:52:56 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d4697e9-dd4b-44c6-a5a8-d74c14c6c795 tempest-ProjectReaderTests-1108167675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c72e7fe4-fc8c-47f7-b8b9-3f5e758beff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-699108032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a38be8a0-fbdf-4bff-a522-afcdab6c3d56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04f494f6f18a4a7ca600b7ec5d3df82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:52:57Z,use_quota=True,user_id='5b386d2eecdf469598203729982643e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:52:56 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d4697e9-dd4b-44c6-a5a8-d74c14c6c795 tempest-ProjectReaderTests-1108167675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6fd9ed3-5a87-4b99-90c7-1b7a0f0d6a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:52:56 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d4697e9-dd4b-44c6-a5a8-d74c14c6c795 tempest-ProjectReaderTests-1108167675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6fd9ed3-5a87-4b99-90c7-1b7a0f0d6a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:52:56 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d4697e9-dd4b-44c6-a5a8-d74c14c6c795 tempest-ProjectReaderTests-1108167675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f67dc002-1367-4010-936a-75d5b8a64242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:52:56 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d4697e9-dd4b-44c6-a5a8-d74c14c6c795 tempest-ProjectReaderTests-1108167675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f67dc002-1367-4010-936a-75d5b8a64242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a38be8a0-fbdf-4bff-a522-afcdab6c3d56', 'volume_name': 'volume-a38be8a0-fbdf-4bff-a522-afcdab6c3d56', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:52:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d4697e9-dd4b-44c6-a5a8-d74c14c6c795 tempest-ProjectReaderTests-1108167675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2dc9cd1-b289-486a-aacf-edc7fb22405c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:52:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d4697e9-dd4b-44c6-a5a8-d74c14c6c795 tempest-ProjectReaderTests-1108167675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2dc9cd1-b289-486a-aacf-edc7fb22405c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:52:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d4697e9-dd4b-44c6-a5a8-d74c14c6c795 tempest-ProjectReaderTests-1108167675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41626d0e-2691-4605-b9f4-e8744d97b46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:52:57 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-9d4697e9-dd4b-44c6-a5a8-d74c14c6c795 tempest-ProjectReaderTests-1108167675 None] Volume a38be8a0-fbdf-4bff-a522-afcdab6c3d56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a38be8a0-fbdf-4bff-a522-afcdab6c3d56', 'volume_size': 1} Jul 28 10:52:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9d4697e9-dd4b-44c6-a5a8-d74c14c6c795 tempest-ProjectReaderTests-1108167675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:52:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9d4697e9-dd4b-44c6-a5a8-d74c14c6c795 tempest-ProjectReaderTests-1108167675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:52:57 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9d4697e9-dd4b-44c6-a5a8-d74c14c6c795 tempest-ProjectReaderTests-1108167675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-699108032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a38be8a0-fbdf-4bff-a522-afcdab6c3d56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04f494f6f18a4a7ca600b7ec5d3df82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:52:57Z,use_quota=True,user_id='5b386d2eecdf469598203729982643e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:52:57 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-9d4697e9-dd4b-44c6-a5a8-d74c14c6c795 tempest-ProjectReaderTests-1108167675 None] Creating volume a38be8a0-fbdf-4bff-a522-afcdab6c3d56 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:52:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9d4697e9-dd4b-44c6-a5a8-d74c14c6c795 tempest-ProjectReaderTests-1108167675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:52:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9d4697e9-dd4b-44c6-a5a8-d74c14c6c795 tempest-ProjectReaderTests-1108167675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:52:57 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9d4697e9-dd4b-44c6-a5a8-d74c14c6c795 tempest-ProjectReaderTests-1108167675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:52:57 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9d4697e9-dd4b-44c6-a5a8-d74c14c6c795 tempest-ProjectReaderTests-1108167675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:52:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9d4697e9-dd4b-44c6-a5a8-d74c14c6c795 tempest-ProjectReaderTests-1108167675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:52:57 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9d4697e9-dd4b-44c6-a5a8-d74c14c6c795 tempest-ProjectReaderTests-1108167675 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:52:57 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-9d4697e9-dd4b-44c6-a5a8-d74c14c6c795 tempest-ProjectReaderTests-1108167675 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:52:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9d4697e9-dd4b-44c6-a5a8-d74c14c6c795 tempest-ProjectReaderTests-1108167675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a38be8a0-fbdf-4bff-a522-afcdab6c3d56 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:57 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a38be8a0-fbdf-4bff-a522-afcdab6c3d56 1073741824 Jul 28 10:52:57 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:57 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9d4697e9-dd4b-44c6-a5a8-d74c14c6c795 tempest-ProjectReaderTests-1108167675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a38be8a0-fbdf-4bff-a522-afcdab6c3d56 1073741824" returned: 0 in 0.487s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9d4697e9-dd4b-44c6-a5a8-d74c14c6c795 tempest-ProjectReaderTests-1108167675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a38be8a0-fbdf-4bff-a522-afcdab6c3d56 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:57 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a38be8a0-fbdf-4bff-a522-afcdab6c3d56 Jul 28 10:52:57 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:57 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9d4697e9-dd4b-44c6-a5a8-d74c14c6c795 tempest-ProjectReaderTests-1108167675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a38be8a0-fbdf-4bff-a522-afcdab6c3d56" returned: 0 in 0.243s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:57 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9d4697e9-dd4b-44c6-a5a8-d74c14c6c795 tempest-ProjectReaderTests-1108167675 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:52:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9d4697e9-dd4b-44c6-a5a8-d74c14c6c795 tempest-ProjectReaderTests-1108167675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:52:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d4697e9-dd4b-44c6-a5a8-d74c14c6c795 tempest-ProjectReaderTests-1108167675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41626d0e-2691-4605-b9f4-e8744d97b46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a38be8a0-fbdf-4bff-a522-afcdab6c3d56', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:52:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d4697e9-dd4b-44c6-a5a8-d74c14c6c795 tempest-ProjectReaderTests-1108167675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24be5257-60d8-450b-8605-850cbb3b8d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:52:57 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-9d4697e9-dd4b-44c6-a5a8-d74c14c6c795 tempest-ProjectReaderTests-1108167675 None] Volume volume-a38be8a0-fbdf-4bff-a522-afcdab6c3d56 (a38be8a0-fbdf-4bff-a522-afcdab6c3d56): created successfully Jul 28 10:52:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d4697e9-dd4b-44c6-a5a8-d74c14c6c795 tempest-ProjectReaderTests-1108167675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24be5257-60d8-450b-8605-850cbb3b8d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:52:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-9d4697e9-dd4b-44c6-a5a8-d74c14c6c795 tempest-ProjectReaderTests-1108167675 None] Flow 'volume_create_manager' (7a06597b-c2e7-443f-bbed-cd173cb08a59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:52:57 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-9d4697e9-dd4b-44c6-a5a8-d74c14c6c795 tempest-ProjectReaderTests-1108167675 None] Created volume successfully. Jul 28 10:52:58 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-a1872961-cc89-4c88-bce6-8ea6479f4c6d tempest-ProjectReaderTests-1108167675 None] Acquiring lock "cinder-a38be8a0-fbdf-4bff-a522-afcdab6c3d56-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:52:58 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-a1872961-cc89-4c88-bce6-8ea6479f4c6d tempest-ProjectReaderTests-1108167675 None] Lock "cinder-a38be8a0-fbdf-4bff-a522-afcdab6c3d56-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:52:58 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-a1872961-cc89-4c88-bce6-8ea6479f4c6d tempest-ProjectReaderTests-1108167675 None] Acquiring lock "cinder-quobyte-a38be8a0-fbdf-4bff-a522-afcdab6c3d56" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:52:58 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-a1872961-cc89-4c88-bce6-8ea6479f4c6d tempest-ProjectReaderTests-1108167675 None] Lock "cinder-quobyte-a38be8a0-fbdf-4bff-a522-afcdab6c3d56" acquired by "delete_volume" :: waited 0.019s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:52:58 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b5b4d4-2503-436f-bea0-774ba3bf3012]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:52:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a1872961-cc89-4c88-bce6-8ea6479f4c6d tempest-ProjectReaderTests-1108167675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a38be8a0-fbdf-4bff-a522-afcdab6c3d56 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:58 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a38be8a0-fbdf-4bff-a522-afcdab6c3d56 Jul 28 10:52:58 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:58 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a1872961-cc89-4c88-bce6-8ea6479f4c6d tempest-ProjectReaderTests-1108167675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a38be8a0-fbdf-4bff-a522-afcdab6c3d56" returned: 0 in 0.382s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a1872961-cc89-4c88-bce6-8ea6479f4c6d tempest-ProjectReaderTests-1108167675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a38be8a0-fbdf-4bff-a522-afcdab6c3d56 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:58 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a38be8a0-fbdf-4bff-a522-afcdab6c3d56 Jul 28 10:52:58 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:58 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a1872961-cc89-4c88-bce6-8ea6479f4c6d tempest-ProjectReaderTests-1108167675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-a38be8a0-fbdf-4bff-a522-afcdab6c3d56" returned: 0 in 0.266s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:58 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-a1872961-cc89-4c88-bce6-8ea6479f4c6d tempest-ProjectReaderTests-1108167675 None] Lock "cinder-quobyte-a38be8a0-fbdf-4bff-a522-afcdab6c3d56" released by "delete_volume" :: held 0.697s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:52:58 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-a1872961-cc89-4c88-bce6-8ea6479f4c6d tempest-ProjectReaderTests-1108167675 None] Created reservations ['5a62475d-a454-4f21-877a-a61f603d1ed8', 'af17476f-ed62-4ffa-8a81-5e69a65216a5', '2deb91a5-499b-4d6f-a87e-1e6d4c8f99a7', '9fe7b90b-f682-40de-827c-a5f1c846cf78'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:52:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a1872961-cc89-4c88-bce6-8ea6479f4c6d tempest-ProjectReaderTests-1108167675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:52:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a1872961-cc89-4c88-bce6-8ea6479f4c6d tempest-ProjectReaderTests-1108167675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:52:59 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-a1872961-cc89-4c88-bce6-8ea6479f4c6d tempest-ProjectReaderTests-1108167675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:52:59 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-a1872961-cc89-4c88-bce6-8ea6479f4c6d tempest-ProjectReaderTests-1108167675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:52:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-a1872961-cc89-4c88-bce6-8ea6479f4c6d tempest-ProjectReaderTests-1108167675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:52:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a1872961-cc89-4c88-bce6-8ea6479f4c6d tempest-ProjectReaderTests-1108167675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:59 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:52:59 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:52:59 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Jul 28 10:52:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-a1872961-cc89-4c88-bce6-8ea6479f4c6d tempest-ProjectReaderTests-1108167675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.298s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:52:59 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-a1872961-cc89-4c88-bce6-8ea6479f4c6d tempest-ProjectReaderTests-1108167675 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:52:59 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-a1872961-cc89-4c88-bce6-8ea6479f4c6d tempest-ProjectReaderTests-1108167675 None] Deleted volume successfully. Jul 28 10:52:59 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-a1872961-cc89-4c88-bce6-8ea6479f4c6d tempest-ProjectReaderTests-1108167675 None] Lock "cinder-a38be8a0-fbdf-4bff-a522-afcdab6c3d56-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:52:59 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-557decb6-a350-47c7-ad30-dbd9bd4b36dd tempest-ProjectReaderTests-1108167675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:52:59 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-557decb6-a350-47c7-ad30-dbd9bd4b36dd tempest-ProjectReaderTests-1108167675 None] Flow 'volume_create_manager' (f6214f3c-a936-41ec-bf30-cf47200ee224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:52:59 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-557decb6-a350-47c7-ad30-dbd9bd4b36dd tempest-ProjectReaderTests-1108167675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b792be26-7232-464a-80e7-4d83e724fecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:52:59 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-557decb6-a350-47c7-ad30-dbd9bd4b36dd tempest-ProjectReaderTests-1108167675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b792be26-7232-464a-80e7-4d83e724fecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1625139880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad3bcc95-d405-4d1c-a007-e7f5c861fc0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04f494f6f18a4a7ca600b7ec5d3df82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:53:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:53:00Z,use_quota=True,user_id='5b386d2eecdf469598203729982643e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:52:59 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-557decb6-a350-47c7-ad30-dbd9bd4b36dd tempest-ProjectReaderTests-1108167675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f935ea-25bf-4156-b1e4-d7001a3a8ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:52:59 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-557decb6-a350-47c7-ad30-dbd9bd4b36dd tempest-ProjectReaderTests-1108167675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f935ea-25bf-4156-b1e4-d7001a3a8ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:52:59 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-557decb6-a350-47c7-ad30-dbd9bd4b36dd tempest-ProjectReaderTests-1108167675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9555ffb2-3ba2-4a02-a2b3-5cac86756458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:52:59 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-557decb6-a350-47c7-ad30-dbd9bd4b36dd tempest-ProjectReaderTests-1108167675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9555ffb2-3ba2-4a02-a2b3-5cac86756458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad3bcc95-d405-4d1c-a007-e7f5c861fc0a', 'volume_name': 'volume-ad3bcc95-d405-4d1c-a007-e7f5c861fc0a', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:52:59 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-557decb6-a350-47c7-ad30-dbd9bd4b36dd tempest-ProjectReaderTests-1108167675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa9535d4-729e-4694-8fba-a31b80f9744d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:52:59 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-557decb6-a350-47c7-ad30-dbd9bd4b36dd tempest-ProjectReaderTests-1108167675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa9535d4-729e-4694-8fba-a31b80f9744d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:52:59 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-557decb6-a350-47c7-ad30-dbd9bd4b36dd tempest-ProjectReaderTests-1108167675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a318c620-cd2f-480f-ae6e-0a1d1674647b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:52:59 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-557decb6-a350-47c7-ad30-dbd9bd4b36dd tempest-ProjectReaderTests-1108167675 None] Volume ad3bcc95-d405-4d1c-a007-e7f5c861fc0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad3bcc95-d405-4d1c-a007-e7f5c861fc0a', 'volume_size': 1} Jul 28 10:52:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-557decb6-a350-47c7-ad30-dbd9bd4b36dd tempest-ProjectReaderTests-1108167675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:52:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-557decb6-a350-47c7-ad30-dbd9bd4b36dd tempest-ProjectReaderTests-1108167675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:52:59 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-557decb6-a350-47c7-ad30-dbd9bd4b36dd tempest-ProjectReaderTests-1108167675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1625139880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad3bcc95-d405-4d1c-a007-e7f5c861fc0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04f494f6f18a4a7ca600b7ec5d3df82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:53:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:53:00Z,use_quota=True,user_id='5b386d2eecdf469598203729982643e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:52:59 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-557decb6-a350-47c7-ad30-dbd9bd4b36dd tempest-ProjectReaderTests-1108167675 None] Creating volume ad3bcc95-d405-4d1c-a007-e7f5c861fc0a {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:52:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-557decb6-a350-47c7-ad30-dbd9bd4b36dd tempest-ProjectReaderTests-1108167675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:52:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-557decb6-a350-47c7-ad30-dbd9bd4b36dd tempest-ProjectReaderTests-1108167675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:52:59 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-557decb6-a350-47c7-ad30-dbd9bd4b36dd tempest-ProjectReaderTests-1108167675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:52:59 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-557decb6-a350-47c7-ad30-dbd9bd4b36dd tempest-ProjectReaderTests-1108167675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:52:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-557decb6-a350-47c7-ad30-dbd9bd4b36dd tempest-ProjectReaderTests-1108167675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:52:59 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-557decb6-a350-47c7-ad30-dbd9bd4b36dd tempest-ProjectReaderTests-1108167675 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:52:59 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-557decb6-a350-47c7-ad30-dbd9bd4b36dd tempest-ProjectReaderTests-1108167675 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:52:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-557decb6-a350-47c7-ad30-dbd9bd4b36dd tempest-ProjectReaderTests-1108167675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ad3bcc95-d405-4d1c-a007-e7f5c861fc0a 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:52:59 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ad3bcc95-d405-4d1c-a007-e7f5c861fc0a 1073741824 Jul 28 10:52:59 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:00 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-557decb6-a350-47c7-ad30-dbd9bd4b36dd tempest-ProjectReaderTests-1108167675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ad3bcc95-d405-4d1c-a007-e7f5c861fc0a 1073741824" returned: 0 in 0.465s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-557decb6-a350-47c7-ad30-dbd9bd4b36dd tempest-ProjectReaderTests-1108167675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ad3bcc95-d405-4d1c-a007-e7f5c861fc0a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:00 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ad3bcc95-d405-4d1c-a007-e7f5c861fc0a Jul 28 10:53:00 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:00 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-557decb6-a350-47c7-ad30-dbd9bd4b36dd tempest-ProjectReaderTests-1108167675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ad3bcc95-d405-4d1c-a007-e7f5c861fc0a" returned: 0 in 0.259s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:00 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-557decb6-a350-47c7-ad30-dbd9bd4b36dd tempest-ProjectReaderTests-1108167675 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:53:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-557decb6-a350-47c7-ad30-dbd9bd4b36dd tempest-ProjectReaderTests-1108167675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:53:00 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-557decb6-a350-47c7-ad30-dbd9bd4b36dd tempest-ProjectReaderTests-1108167675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a318c620-cd2f-480f-ae6e-0a1d1674647b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad3bcc95-d405-4d1c-a007-e7f5c861fc0a', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:53:00 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-557decb6-a350-47c7-ad30-dbd9bd4b36dd tempest-ProjectReaderTests-1108167675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (936bde2d-cffe-4379-88bf-0e12e9cd6111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:53:00 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-557decb6-a350-47c7-ad30-dbd9bd4b36dd tempest-ProjectReaderTests-1108167675 None] Volume volume-ad3bcc95-d405-4d1c-a007-e7f5c861fc0a (ad3bcc95-d405-4d1c-a007-e7f5c861fc0a): created successfully Jul 28 10:53:00 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-557decb6-a350-47c7-ad30-dbd9bd4b36dd tempest-ProjectReaderTests-1108167675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (936bde2d-cffe-4379-88bf-0e12e9cd6111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:53:00 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-557decb6-a350-47c7-ad30-dbd9bd4b36dd tempest-ProjectReaderTests-1108167675 None] Flow 'volume_create_manager' (f6214f3c-a936-41ec-bf30-cf47200ee224) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:53:00 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-557decb6-a350-47c7-ad30-dbd9bd4b36dd tempest-ProjectReaderTests-1108167675 None] Created volume successfully. Jul 28 10:53:01 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c9e1d9c-f91b-4c3c-9a31-0301f820952b tempest-ProjectReaderTests-244390080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:53:01 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8c9e1d9c-f91b-4c3c-9a31-0301f820952b tempest-ProjectReaderTests-244390080 None] Flow 'volume_create_manager' (db63b210-0e03-4dbe-a506-d15e645efe02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:53:01 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8c9e1d9c-f91b-4c3c-9a31-0301f820952b tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af986ad4-6dc7-48c4-9f53-257dd1344155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:53:01 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8c9e1d9c-f91b-4c3c-9a31-0301f820952b tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af986ad4-6dc7-48c4-9f53-257dd1344155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1196285320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0260fbc6-a703-467a-9152-b7a3c0fa649f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='464cdad3968a41329f6b39055f1895c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:53:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:53:02Z,use_quota=True,user_id='abf5fde5cc3942cf9cf2e5d9310701ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:53:01 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8c9e1d9c-f91b-4c3c-9a31-0301f820952b tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (125b290d-f14d-4f72-9be3-2705dd894ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:53:01 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8c9e1d9c-f91b-4c3c-9a31-0301f820952b tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (125b290d-f14d-4f72-9be3-2705dd894ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:53:01 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8c9e1d9c-f91b-4c3c-9a31-0301f820952b tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b83c87ff-25ff-499c-b533-84631ef72a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:53:01 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8c9e1d9c-f91b-4c3c-9a31-0301f820952b tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b83c87ff-25ff-499c-b533-84631ef72a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0260fbc6-a703-467a-9152-b7a3c0fa649f', 'volume_name': 'volume-0260fbc6-a703-467a-9152-b7a3c0fa649f', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:53:01 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8c9e1d9c-f91b-4c3c-9a31-0301f820952b tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a36ee30d-ce1a-4035-a266-e0884de9f4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:53:01 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8c9e1d9c-f91b-4c3c-9a31-0301f820952b tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a36ee30d-ce1a-4035-a266-e0884de9f4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:53:01 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8c9e1d9c-f91b-4c3c-9a31-0301f820952b tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9fe428b-c498-4cd4-9283-550c4cf3e747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:53:01 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-8c9e1d9c-f91b-4c3c-9a31-0301f820952b tempest-ProjectReaderTests-244390080 None] Volume 0260fbc6-a703-467a-9152-b7a3c0fa649f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0260fbc6-a703-467a-9152-b7a3c0fa649f', 'volume_size': 1} Jul 28 10:53:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8c9e1d9c-f91b-4c3c-9a31-0301f820952b tempest-ProjectReaderTests-244390080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:53:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8c9e1d9c-f91b-4c3c-9a31-0301f820952b tempest-ProjectReaderTests-244390080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:53:01 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8c9e1d9c-f91b-4c3c-9a31-0301f820952b tempest-ProjectReaderTests-244390080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1196285320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0260fbc6-a703-467a-9152-b7a3c0fa649f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='464cdad3968a41329f6b39055f1895c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:53:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:53:02Z,use_quota=True,user_id='abf5fde5cc3942cf9cf2e5d9310701ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:53:01 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-8c9e1d9c-f91b-4c3c-9a31-0301f820952b tempest-ProjectReaderTests-244390080 None] Creating volume 0260fbc6-a703-467a-9152-b7a3c0fa649f {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:53:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8c9e1d9c-f91b-4c3c-9a31-0301f820952b tempest-ProjectReaderTests-244390080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:53:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8c9e1d9c-f91b-4c3c-9a31-0301f820952b tempest-ProjectReaderTests-244390080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:53:01 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8c9e1d9c-f91b-4c3c-9a31-0301f820952b tempest-ProjectReaderTests-244390080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:53:01 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8c9e1d9c-f91b-4c3c-9a31-0301f820952b tempest-ProjectReaderTests-244390080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:53:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8c9e1d9c-f91b-4c3c-9a31-0301f820952b tempest-ProjectReaderTests-244390080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:53:01 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8c9e1d9c-f91b-4c3c-9a31-0301f820952b tempest-ProjectReaderTests-244390080 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:53:01 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-8c9e1d9c-f91b-4c3c-9a31-0301f820952b tempest-ProjectReaderTests-244390080 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:53:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8c9e1d9c-f91b-4c3c-9a31-0301f820952b tempest-ProjectReaderTests-244390080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0260fbc6-a703-467a-9152-b7a3c0fa649f 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:01 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0260fbc6-a703-467a-9152-b7a3c0fa649f 1073741824 Jul 28 10:53:01 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:01 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f87c8949-b229-4114-ae79-9e8c00778f2d tempest-ProjectReaderTests-1108167675 None] Acquiring lock "cinder-ad3bcc95-d405-4d1c-a007-e7f5c861fc0a-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:53:01 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f87c8949-b229-4114-ae79-9e8c00778f2d tempest-ProjectReaderTests-1108167675 None] Lock "cinder-ad3bcc95-d405-4d1c-a007-e7f5c861fc0a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:53:01 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f87c8949-b229-4114-ae79-9e8c00778f2d tempest-ProjectReaderTests-1108167675 None] Acquiring lock "cinder-quobyte-ad3bcc95-d405-4d1c-a007-e7f5c861fc0a" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:53:01 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f87c8949-b229-4114-ae79-9e8c00778f2d tempest-ProjectReaderTests-1108167675 None] Lock "cinder-quobyte-ad3bcc95-d405-4d1c-a007-e7f5c861fc0a" acquired by "delete_volume" :: waited 0.018s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:53:01 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57cc35c-ba32-476f-b92b-78cc7322e16e]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:53:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f87c8949-b229-4114-ae79-9e8c00778f2d tempest-ProjectReaderTests-1108167675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ad3bcc95-d405-4d1c-a007-e7f5c861fc0a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:02 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ad3bcc95-d405-4d1c-a007-e7f5c861fc0a Jul 28 10:53:02 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:02 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8c9e1d9c-f91b-4c3c-9a31-0301f820952b tempest-ProjectReaderTests-244390080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0260fbc6-a703-467a-9152-b7a3c0fa649f 1073741824" returned: 0 in 0.449s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8c9e1d9c-f91b-4c3c-9a31-0301f820952b tempest-ProjectReaderTests-244390080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0260fbc6-a703-467a-9152-b7a3c0fa649f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:02 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0260fbc6-a703-467a-9152-b7a3c0fa649f Jul 28 10:53:02 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:02 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f87c8949-b229-4114-ae79-9e8c00778f2d tempest-ProjectReaderTests-1108167675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ad3bcc95-d405-4d1c-a007-e7f5c861fc0a" returned: 0 in 0.387s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f87c8949-b229-4114-ae79-9e8c00778f2d tempest-ProjectReaderTests-1108167675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ad3bcc95-d405-4d1c-a007-e7f5c861fc0a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:02 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ad3bcc95-d405-4d1c-a007-e7f5c861fc0a Jul 28 10:53:02 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:02 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8c9e1d9c-f91b-4c3c-9a31-0301f820952b tempest-ProjectReaderTests-244390080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0260fbc6-a703-467a-9152-b7a3c0fa649f" returned: 0 in 0.259s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:02 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8c9e1d9c-f91b-4c3c-9a31-0301f820952b tempest-ProjectReaderTests-244390080 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:53:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8c9e1d9c-f91b-4c3c-9a31-0301f820952b tempest-ProjectReaderTests-244390080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:53:02 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8c9e1d9c-f91b-4c3c-9a31-0301f820952b tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9fe428b-c498-4cd4-9283-550c4cf3e747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0260fbc6-a703-467a-9152-b7a3c0fa649f', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:53:02 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8c9e1d9c-f91b-4c3c-9a31-0301f820952b tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (175fbe5a-ed9f-41b9-b3b3-288927f3828e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:53:02 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-8c9e1d9c-f91b-4c3c-9a31-0301f820952b tempest-ProjectReaderTests-244390080 None] Volume volume-0260fbc6-a703-467a-9152-b7a3c0fa649f (0260fbc6-a703-467a-9152-b7a3c0fa649f): created successfully Jul 28 10:53:02 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8c9e1d9c-f91b-4c3c-9a31-0301f820952b tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (175fbe5a-ed9f-41b9-b3b3-288927f3828e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:53:02 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8c9e1d9c-f91b-4c3c-9a31-0301f820952b tempest-ProjectReaderTests-244390080 None] Flow 'volume_create_manager' (db63b210-0e03-4dbe-a506-d15e645efe02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:53:02 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-8c9e1d9c-f91b-4c3c-9a31-0301f820952b tempest-ProjectReaderTests-244390080 None] Created volume successfully. Jul 28 10:53:02 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f87c8949-b229-4114-ae79-9e8c00778f2d tempest-ProjectReaderTests-1108167675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ad3bcc95-d405-4d1c-a007-e7f5c861fc0a" returned: 0 in 0.269s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:02 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f87c8949-b229-4114-ae79-9e8c00778f2d tempest-ProjectReaderTests-1108167675 None] Lock "cinder-quobyte-ad3bcc95-d405-4d1c-a007-e7f5c861fc0a" released by "delete_volume" :: held 0.697s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:53:02 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-f87c8949-b229-4114-ae79-9e8c00778f2d tempest-ProjectReaderTests-1108167675 None] Created reservations ['bc6ef8b4-a007-4cfb-bc59-48cf5d99a97f', '6f3ac31b-6b79-4ac8-810a-49f5723ee1aa', 'fe50662d-ba38-4f56-a447-984993a543ea', '16da1a3f-3a2a-4bd3-86ec-9b9cbd20af20'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:53:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f87c8949-b229-4114-ae79-9e8c00778f2d tempest-ProjectReaderTests-1108167675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:53:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f87c8949-b229-4114-ae79-9e8c00778f2d tempest-ProjectReaderTests-1108167675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:53:02 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f87c8949-b229-4114-ae79-9e8c00778f2d tempest-ProjectReaderTests-1108167675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:53:02 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f87c8949-b229-4114-ae79-9e8c00778f2d tempest-ProjectReaderTests-1108167675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:53:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f87c8949-b229-4114-ae79-9e8c00778f2d tempest-ProjectReaderTests-1108167675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:53:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f87c8949-b229-4114-ae79-9e8c00778f2d tempest-ProjectReaderTests-1108167675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:02 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:53:02 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:02 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-bcccfe61-a013-4a1a-abbf-41bad7800e83 tempest-ProjectReaderTests-244390080 None] Acquiring lock "cinder-0260fbc6-a703-467a-9152-b7a3c0fa649f-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:53:02 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-bcccfe61-a013-4a1a-abbf-41bad7800e83 tempest-ProjectReaderTests-244390080 None] Lock "cinder-0260fbc6-a703-467a-9152-b7a3c0fa649f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:53:02 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-bcccfe61-a013-4a1a-abbf-41bad7800e83 tempest-ProjectReaderTests-244390080 None] Acquiring lock "cinder-quobyte-0260fbc6-a703-467a-9152-b7a3c0fa649f" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:53:02 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-bcccfe61-a013-4a1a-abbf-41bad7800e83 tempest-ProjectReaderTests-244390080 None] Lock "cinder-quobyte-0260fbc6-a703-467a-9152-b7a3c0fa649f" acquired by "delete_volume" :: waited 0.014s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:53:02 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[346ef2b5-26b0-4b3b-a3b2-2281d4ddc493]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:53:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bcccfe61-a013-4a1a-abbf-41bad7800e83 tempest-ProjectReaderTests-244390080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0260fbc6-a703-467a-9152-b7a3c0fa649f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:03 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0260fbc6-a703-467a-9152-b7a3c0fa649f Jul 28 10:53:03 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:03 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f87c8949-b229-4114-ae79-9e8c00778f2d tempest-ProjectReaderTests-1108167675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.271s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:03 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-f87c8949-b229-4114-ae79-9e8c00778f2d tempest-ProjectReaderTests-1108167675 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:53:03 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-f87c8949-b229-4114-ae79-9e8c00778f2d tempest-ProjectReaderTests-1108167675 None] Deleted volume successfully. Jul 28 10:53:03 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f87c8949-b229-4114-ae79-9e8c00778f2d tempest-ProjectReaderTests-1108167675 None] Lock "cinder-ad3bcc95-d405-4d1c-a007-e7f5c861fc0a-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:53:03 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bcccfe61-a013-4a1a-abbf-41bad7800e83 tempest-ProjectReaderTests-244390080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0260fbc6-a703-467a-9152-b7a3c0fa649f" returned: 0 in 0.410s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bcccfe61-a013-4a1a-abbf-41bad7800e83 tempest-ProjectReaderTests-244390080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0260fbc6-a703-467a-9152-b7a3c0fa649f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:03 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0260fbc6-a703-467a-9152-b7a3c0fa649f Jul 28 10:53:03 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:03 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bcccfe61-a013-4a1a-abbf-41bad7800e83 tempest-ProjectReaderTests-244390080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0260fbc6-a703-467a-9152-b7a3c0fa649f" returned: 0 in 0.263s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:03 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-bcccfe61-a013-4a1a-abbf-41bad7800e83 tempest-ProjectReaderTests-244390080 None] Lock "cinder-quobyte-0260fbc6-a703-467a-9152-b7a3c0fa649f" released by "delete_volume" :: held 0.723s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:53:03 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-bcccfe61-a013-4a1a-abbf-41bad7800e83 tempest-ProjectReaderTests-244390080 None] Created reservations ['96a25d16-2e43-4939-ad60-e511dabdff78', '3b46e110-c33a-4188-8b85-2028b5e8e2ce', '5caeae54-52c0-4904-ae46-0b1fcbd65192', '01fcb747-5ce9-44a3-bed1-0a6de3310d53'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:53:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-bcccfe61-a013-4a1a-abbf-41bad7800e83 tempest-ProjectReaderTests-244390080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:53:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-bcccfe61-a013-4a1a-abbf-41bad7800e83 tempest-ProjectReaderTests-244390080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:53:03 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-bcccfe61-a013-4a1a-abbf-41bad7800e83 tempest-ProjectReaderTests-244390080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:53:03 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-bcccfe61-a013-4a1a-abbf-41bad7800e83 tempest-ProjectReaderTests-244390080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:53:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-bcccfe61-a013-4a1a-abbf-41bad7800e83 tempest-ProjectReaderTests-244390080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:53:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bcccfe61-a013-4a1a-abbf-41bad7800e83 tempest-ProjectReaderTests-244390080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:03 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:53:03 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:03 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bcccfe61-a013-4a1a-abbf-41bad7800e83 tempest-ProjectReaderTests-244390080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.254s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:03 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-bcccfe61-a013-4a1a-abbf-41bad7800e83 tempest-ProjectReaderTests-244390080 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:53:04 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-bcccfe61-a013-4a1a-abbf-41bad7800e83 tempest-ProjectReaderTests-244390080 None] Deleted volume successfully. Jul 28 10:53:04 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-bcccfe61-a013-4a1a-abbf-41bad7800e83 tempest-ProjectReaderTests-244390080 None] Lock "cinder-0260fbc6-a703-467a-9152-b7a3c0fa649f-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:53:04 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-218c6aae-8cd3-4a1f-8369-062a1ade62a0 tempest-ProjectReaderTests-244390080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:53:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-218c6aae-8cd3-4a1f-8369-062a1ade62a0 tempest-ProjectReaderTests-244390080 None] Flow 'volume_create_manager' (7b4064aa-c4fa-4482-8920-2a05bedf9dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:53:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-218c6aae-8cd3-4a1f-8369-062a1ade62a0 tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d695f76-c5f0-42b4-a4ee-0ede61a95751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:53:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-218c6aae-8cd3-4a1f-8369-062a1ade62a0 tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d695f76-c5f0-42b4-a4ee-0ede61a95751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-476362880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cfcccdf-b1fd-4460-99f7-6750750a5105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='464cdad3968a41329f6b39055f1895c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:53:04Z,use_quota=True,user_id='abf5fde5cc3942cf9cf2e5d9310701ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:53:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-218c6aae-8cd3-4a1f-8369-062a1ade62a0 tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a9cb229-90f9-471e-886b-b952a45a85bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:53:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-218c6aae-8cd3-4a1f-8369-062a1ade62a0 tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a9cb229-90f9-471e-886b-b952a45a85bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:53:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-218c6aae-8cd3-4a1f-8369-062a1ade62a0 tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab3236c6-9575-48b2-a05e-86b3a03386ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:53:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-218c6aae-8cd3-4a1f-8369-062a1ade62a0 tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab3236c6-9575-48b2-a05e-86b3a03386ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cfcccdf-b1fd-4460-99f7-6750750a5105', 'volume_name': 'volume-7cfcccdf-b1fd-4460-99f7-6750750a5105', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:53:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-218c6aae-8cd3-4a1f-8369-062a1ade62a0 tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93dc1f84-a098-4214-8edc-9c298f1222b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:53:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-218c6aae-8cd3-4a1f-8369-062a1ade62a0 tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93dc1f84-a098-4214-8edc-9c298f1222b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:53:04 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-218c6aae-8cd3-4a1f-8369-062a1ade62a0 tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fa27794-b24c-4d77-bf5b-746128452824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:53:04 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-218c6aae-8cd3-4a1f-8369-062a1ade62a0 tempest-ProjectReaderTests-244390080 None] Volume 7cfcccdf-b1fd-4460-99f7-6750750a5105: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cfcccdf-b1fd-4460-99f7-6750750a5105', 'volume_size': 1} Jul 28 10:53:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-218c6aae-8cd3-4a1f-8369-062a1ade62a0 tempest-ProjectReaderTests-244390080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:53:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-218c6aae-8cd3-4a1f-8369-062a1ade62a0 tempest-ProjectReaderTests-244390080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:53:04 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-218c6aae-8cd3-4a1f-8369-062a1ade62a0 tempest-ProjectReaderTests-244390080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-476362880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cfcccdf-b1fd-4460-99f7-6750750a5105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='464cdad3968a41329f6b39055f1895c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:53:04Z,use_quota=True,user_id='abf5fde5cc3942cf9cf2e5d9310701ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:53:04 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-218c6aae-8cd3-4a1f-8369-062a1ade62a0 tempest-ProjectReaderTests-244390080 None] Creating volume 7cfcccdf-b1fd-4460-99f7-6750750a5105 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:53:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-218c6aae-8cd3-4a1f-8369-062a1ade62a0 tempest-ProjectReaderTests-244390080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:53:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-218c6aae-8cd3-4a1f-8369-062a1ade62a0 tempest-ProjectReaderTests-244390080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:53:04 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-218c6aae-8cd3-4a1f-8369-062a1ade62a0 tempest-ProjectReaderTests-244390080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:53:04 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-218c6aae-8cd3-4a1f-8369-062a1ade62a0 tempest-ProjectReaderTests-244390080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:53:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-218c6aae-8cd3-4a1f-8369-062a1ade62a0 tempest-ProjectReaderTests-244390080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:53:04 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-218c6aae-8cd3-4a1f-8369-062a1ade62a0 tempest-ProjectReaderTests-244390080 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:53:04 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-218c6aae-8cd3-4a1f-8369-062a1ade62a0 tempest-ProjectReaderTests-244390080 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:53:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-218c6aae-8cd3-4a1f-8369-062a1ade62a0 tempest-ProjectReaderTests-244390080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7cfcccdf-b1fd-4460-99f7-6750750a5105 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:04 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7cfcccdf-b1fd-4460-99f7-6750750a5105 1073741824 Jul 28 10:53:04 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:05 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-218c6aae-8cd3-4a1f-8369-062a1ade62a0 tempest-ProjectReaderTests-244390080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7cfcccdf-b1fd-4460-99f7-6750750a5105 1073741824" returned: 0 in 0.461s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-218c6aae-8cd3-4a1f-8369-062a1ade62a0 tempest-ProjectReaderTests-244390080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7cfcccdf-b1fd-4460-99f7-6750750a5105 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:05 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7cfcccdf-b1fd-4460-99f7-6750750a5105 Jul 28 10:53:05 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:05 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-218c6aae-8cd3-4a1f-8369-062a1ade62a0 tempest-ProjectReaderTests-244390080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7cfcccdf-b1fd-4460-99f7-6750750a5105" returned: 0 in 0.253s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:05 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-218c6aae-8cd3-4a1f-8369-062a1ade62a0 tempest-ProjectReaderTests-244390080 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:53:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-218c6aae-8cd3-4a1f-8369-062a1ade62a0 tempest-ProjectReaderTests-244390080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:53:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-218c6aae-8cd3-4a1f-8369-062a1ade62a0 tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fa27794-b24c-4d77-bf5b-746128452824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cfcccdf-b1fd-4460-99f7-6750750a5105', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:53:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-218c6aae-8cd3-4a1f-8369-062a1ade62a0 tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba077902-504d-453d-8843-3ebc833e4ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:53:05 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-218c6aae-8cd3-4a1f-8369-062a1ade62a0 tempest-ProjectReaderTests-244390080 None] Volume volume-7cfcccdf-b1fd-4460-99f7-6750750a5105 (7cfcccdf-b1fd-4460-99f7-6750750a5105): created successfully Jul 28 10:53:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-218c6aae-8cd3-4a1f-8369-062a1ade62a0 tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba077902-504d-453d-8843-3ebc833e4ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:53:05 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-218c6aae-8cd3-4a1f-8369-062a1ade62a0 tempest-ProjectReaderTests-244390080 None] Flow 'volume_create_manager' (7b4064aa-c4fa-4482-8920-2a05bedf9dc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:53:05 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-218c6aae-8cd3-4a1f-8369-062a1ade62a0 tempest-ProjectReaderTests-244390080 None] Created volume successfully. Jul 28 10:53:06 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-dfe72e20-2784-4f54-b9e0-aebc369170d8 tempest-ProjectReaderTests-244390080 None] Acquiring lock "cinder-7cfcccdf-b1fd-4460-99f7-6750750a5105-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:53:06 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-dfe72e20-2784-4f54-b9e0-aebc369170d8 tempest-ProjectReaderTests-244390080 None] Lock "cinder-7cfcccdf-b1fd-4460-99f7-6750750a5105-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:53:06 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-dfe72e20-2784-4f54-b9e0-aebc369170d8 tempest-ProjectReaderTests-244390080 None] Acquiring lock "cinder-quobyte-7cfcccdf-b1fd-4460-99f7-6750750a5105" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:53:06 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-dfe72e20-2784-4f54-b9e0-aebc369170d8 tempest-ProjectReaderTests-244390080 None] Lock "cinder-quobyte-7cfcccdf-b1fd-4460-99f7-6750750a5105" acquired by "delete_volume" :: waited 0.014s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:53:06 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7572fa-60bb-46ed-bdf8-259f813ca6cd]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:53:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dfe72e20-2784-4f54-b9e0-aebc369170d8 tempest-ProjectReaderTests-244390080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7cfcccdf-b1fd-4460-99f7-6750750a5105 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:06 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7cfcccdf-b1fd-4460-99f7-6750750a5105 Jul 28 10:53:06 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:07 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dfe72e20-2784-4f54-b9e0-aebc369170d8 tempest-ProjectReaderTests-244390080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7cfcccdf-b1fd-4460-99f7-6750750a5105" returned: 0 in 0.390s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dfe72e20-2784-4f54-b9e0-aebc369170d8 tempest-ProjectReaderTests-244390080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7cfcccdf-b1fd-4460-99f7-6750750a5105 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:07 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7cfcccdf-b1fd-4460-99f7-6750750a5105 Jul 28 10:53:07 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:07 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dfe72e20-2784-4f54-b9e0-aebc369170d8 tempest-ProjectReaderTests-244390080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7cfcccdf-b1fd-4460-99f7-6750750a5105" returned: 0 in 0.253s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:07 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-dfe72e20-2784-4f54-b9e0-aebc369170d8 tempest-ProjectReaderTests-244390080 None] Lock "cinder-quobyte-7cfcccdf-b1fd-4460-99f7-6750750a5105" released by "delete_volume" :: held 0.694s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:53:07 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-dfe72e20-2784-4f54-b9e0-aebc369170d8 tempest-ProjectReaderTests-244390080 None] Created reservations ['e397154a-230b-4993-9d93-44ac58397534', '6e86e4f1-b913-4778-bb59-180a6dfb7edf', '2eb46d5c-4780-4bcb-b60f-431380212915', 'a8cec087-a3b7-47a2-a189-7899681f65fb'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:53:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-dfe72e20-2784-4f54-b9e0-aebc369170d8 tempest-ProjectReaderTests-244390080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:53:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-dfe72e20-2784-4f54-b9e0-aebc369170d8 tempest-ProjectReaderTests-244390080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:53:07 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-dfe72e20-2784-4f54-b9e0-aebc369170d8 tempest-ProjectReaderTests-244390080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:53:07 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-dfe72e20-2784-4f54-b9e0-aebc369170d8 tempest-ProjectReaderTests-244390080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:53:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-dfe72e20-2784-4f54-b9e0-aebc369170d8 tempest-ProjectReaderTests-244390080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:53:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dfe72e20-2784-4f54-b9e0-aebc369170d8 tempest-ProjectReaderTests-244390080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:07 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:53:07 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:07 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dfe72e20-2784-4f54-b9e0-aebc369170d8 tempest-ProjectReaderTests-244390080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.274s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:07 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-dfe72e20-2784-4f54-b9e0-aebc369170d8 tempest-ProjectReaderTests-244390080 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:53:07 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-dfe72e20-2784-4f54-b9e0-aebc369170d8 tempest-ProjectReaderTests-244390080 None] Deleted volume successfully. Jul 28 10:53:07 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-dfe72e20-2784-4f54-b9e0-aebc369170d8 tempest-ProjectReaderTests-244390080 None] Lock "cinder-7cfcccdf-b1fd-4460-99f7-6750750a5105-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:53:08 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1594fa2-12f4-4cc8-b3ba-906161ba1906 tempest-ProjectReaderTests-244390080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:53:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d1594fa2-12f4-4cc8-b3ba-906161ba1906 tempest-ProjectReaderTests-244390080 None] Flow 'volume_create_manager' (24e37a1e-0b16-4e90-896b-8a5cf1577f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:53:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d1594fa2-12f4-4cc8-b3ba-906161ba1906 tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5240c86b-81b0-494e-872b-be13aeccd8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:53:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d1594fa2-12f4-4cc8-b3ba-906161ba1906 tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5240c86b-81b0-494e-872b-be13aeccd8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1403243114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f19a368-0999-4781-80f5-07b6f8f178d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='464cdad3968a41329f6b39055f1895c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:53:08Z,use_quota=True,user_id='abf5fde5cc3942cf9cf2e5d9310701ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:53:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d1594fa2-12f4-4cc8-b3ba-906161ba1906 tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90b3965d-b737-4230-8481-d72f1ab1a363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:53:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d1594fa2-12f4-4cc8-b3ba-906161ba1906 tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90b3965d-b737-4230-8481-d72f1ab1a363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:53:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d1594fa2-12f4-4cc8-b3ba-906161ba1906 tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfc8616d-a43a-42c1-b1a8-fb1265c2e0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:53:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d1594fa2-12f4-4cc8-b3ba-906161ba1906 tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfc8616d-a43a-42c1-b1a8-fb1265c2e0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f19a368-0999-4781-80f5-07b6f8f178d6', 'volume_name': 'volume-2f19a368-0999-4781-80f5-07b6f8f178d6', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:53:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d1594fa2-12f4-4cc8-b3ba-906161ba1906 tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (964feb5c-b5f3-47b0-bc27-ae2f58d2a4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:53:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d1594fa2-12f4-4cc8-b3ba-906161ba1906 tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (964feb5c-b5f3-47b0-bc27-ae2f58d2a4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:53:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d1594fa2-12f4-4cc8-b3ba-906161ba1906 tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc7d4944-df62-47f1-b976-e896a7ad06c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:53:08 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-d1594fa2-12f4-4cc8-b3ba-906161ba1906 tempest-ProjectReaderTests-244390080 None] Volume 2f19a368-0999-4781-80f5-07b6f8f178d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f19a368-0999-4781-80f5-07b6f8f178d6', 'volume_size': 1} Jul 28 10:53:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d1594fa2-12f4-4cc8-b3ba-906161ba1906 tempest-ProjectReaderTests-244390080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:53:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d1594fa2-12f4-4cc8-b3ba-906161ba1906 tempest-ProjectReaderTests-244390080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:53:08 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-d1594fa2-12f4-4cc8-b3ba-906161ba1906 tempest-ProjectReaderTests-244390080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1403243114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f19a368-0999-4781-80f5-07b6f8f178d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='464cdad3968a41329f6b39055f1895c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:53:08Z,use_quota=True,user_id='abf5fde5cc3942cf9cf2e5d9310701ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:53:08 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-d1594fa2-12f4-4cc8-b3ba-906161ba1906 tempest-ProjectReaderTests-244390080 None] Creating volume 2f19a368-0999-4781-80f5-07b6f8f178d6 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:53:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d1594fa2-12f4-4cc8-b3ba-906161ba1906 tempest-ProjectReaderTests-244390080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:53:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d1594fa2-12f4-4cc8-b3ba-906161ba1906 tempest-ProjectReaderTests-244390080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:53:08 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-d1594fa2-12f4-4cc8-b3ba-906161ba1906 tempest-ProjectReaderTests-244390080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:53:08 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-d1594fa2-12f4-4cc8-b3ba-906161ba1906 tempest-ProjectReaderTests-244390080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:53:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d1594fa2-12f4-4cc8-b3ba-906161ba1906 tempest-ProjectReaderTests-244390080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:53:08 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-d1594fa2-12f4-4cc8-b3ba-906161ba1906 tempest-ProjectReaderTests-244390080 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:53:08 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-d1594fa2-12f4-4cc8-b3ba-906161ba1906 tempest-ProjectReaderTests-244390080 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:53:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d1594fa2-12f4-4cc8-b3ba-906161ba1906 tempest-ProjectReaderTests-244390080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2f19a368-0999-4781-80f5-07b6f8f178d6 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:08 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2f19a368-0999-4781-80f5-07b6f8f178d6 1073741824 Jul 28 10:53:08 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:08 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d1594fa2-12f4-4cc8-b3ba-906161ba1906 tempest-ProjectReaderTests-244390080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2f19a368-0999-4781-80f5-07b6f8f178d6 1073741824" returned: 0 in 0.494s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d1594fa2-12f4-4cc8-b3ba-906161ba1906 tempest-ProjectReaderTests-244390080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2f19a368-0999-4781-80f5-07b6f8f178d6 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:08 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2f19a368-0999-4781-80f5-07b6f8f178d6 Jul 28 10:53:08 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:09 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d1594fa2-12f4-4cc8-b3ba-906161ba1906 tempest-ProjectReaderTests-244390080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2f19a368-0999-4781-80f5-07b6f8f178d6" returned: 0 in 0.259s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:09 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-d1594fa2-12f4-4cc8-b3ba-906161ba1906 tempest-ProjectReaderTests-244390080 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:53:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d1594fa2-12f4-4cc8-b3ba-906161ba1906 tempest-ProjectReaderTests-244390080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:53:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d1594fa2-12f4-4cc8-b3ba-906161ba1906 tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc7d4944-df62-47f1-b976-e896a7ad06c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f19a368-0999-4781-80f5-07b6f8f178d6', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:53:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d1594fa2-12f4-4cc8-b3ba-906161ba1906 tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a0de5f5-20dc-4a02-80fa-ce0496c68015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:53:09 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-d1594fa2-12f4-4cc8-b3ba-906161ba1906 tempest-ProjectReaderTests-244390080 None] Volume volume-2f19a368-0999-4781-80f5-07b6f8f178d6 (2f19a368-0999-4781-80f5-07b6f8f178d6): created successfully Jul 28 10:53:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d1594fa2-12f4-4cc8-b3ba-906161ba1906 tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a0de5f5-20dc-4a02-80fa-ce0496c68015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:53:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d1594fa2-12f4-4cc8-b3ba-906161ba1906 tempest-ProjectReaderTests-244390080 None] Flow 'volume_create_manager' (24e37a1e-0b16-4e90-896b-8a5cf1577f4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:53:09 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-d1594fa2-12f4-4cc8-b3ba-906161ba1906 tempest-ProjectReaderTests-244390080 None] Created volume successfully. Jul 28 10:53:10 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4865ea42-c9b0-4196-a403-368de544a3bf tempest-ProjectReaderTests-244390080 None] Acquiring lock "cinder-2f19a368-0999-4781-80f5-07b6f8f178d6-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:53:10 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4865ea42-c9b0-4196-a403-368de544a3bf tempest-ProjectReaderTests-244390080 None] Lock "cinder-2f19a368-0999-4781-80f5-07b6f8f178d6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:53:10 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4865ea42-c9b0-4196-a403-368de544a3bf tempest-ProjectReaderTests-244390080 None] Acquiring lock "cinder-quobyte-2f19a368-0999-4781-80f5-07b6f8f178d6" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:53:10 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4865ea42-c9b0-4196-a403-368de544a3bf tempest-ProjectReaderTests-244390080 None] Lock "cinder-quobyte-2f19a368-0999-4781-80f5-07b6f8f178d6" acquired by "delete_volume" :: waited 0.015s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:53:10 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd4f02b-f1e4-48ba-b1d8-aec4764f2dc5]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:53:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4865ea42-c9b0-4196-a403-368de544a3bf tempest-ProjectReaderTests-244390080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2f19a368-0999-4781-80f5-07b6f8f178d6 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:10 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2f19a368-0999-4781-80f5-07b6f8f178d6 Jul 28 10:53:10 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:10 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4865ea42-c9b0-4196-a403-368de544a3bf tempest-ProjectReaderTests-244390080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2f19a368-0999-4781-80f5-07b6f8f178d6" returned: 0 in 0.354s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4865ea42-c9b0-4196-a403-368de544a3bf tempest-ProjectReaderTests-244390080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2f19a368-0999-4781-80f5-07b6f8f178d6 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:10 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2f19a368-0999-4781-80f5-07b6f8f178d6 Jul 28 10:53:10 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:11 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4865ea42-c9b0-4196-a403-368de544a3bf tempest-ProjectReaderTests-244390080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2f19a368-0999-4781-80f5-07b6f8f178d6" returned: 0 in 0.250s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:11 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4865ea42-c9b0-4196-a403-368de544a3bf tempest-ProjectReaderTests-244390080 None] Lock "cinder-quobyte-2f19a368-0999-4781-80f5-07b6f8f178d6" released by "delete_volume" :: held 0.642s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:53:11 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-4865ea42-c9b0-4196-a403-368de544a3bf tempest-ProjectReaderTests-244390080 None] Created reservations ['5af1ccdd-b3d2-45bd-bb03-0ea66810d9b8', 'e1c2b95a-3486-4ccc-a602-f9a171bba111', '2c9adb28-8048-4e4e-9217-6d598b4bacdb', 'b5776323-8682-46df-9a60-55af2385894c'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:53:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-4865ea42-c9b0-4196-a403-368de544a3bf tempest-ProjectReaderTests-244390080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:53:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-4865ea42-c9b0-4196-a403-368de544a3bf tempest-ProjectReaderTests-244390080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:53:11 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-4865ea42-c9b0-4196-a403-368de544a3bf tempest-ProjectReaderTests-244390080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:53:11 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-4865ea42-c9b0-4196-a403-368de544a3bf tempest-ProjectReaderTests-244390080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:53:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-4865ea42-c9b0-4196-a403-368de544a3bf tempest-ProjectReaderTests-244390080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:53:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4865ea42-c9b0-4196-a403-368de544a3bf tempest-ProjectReaderTests-244390080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:11 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:53:11 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:11 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4865ea42-c9b0-4196-a403-368de544a3bf tempest-ProjectReaderTests-244390080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.242s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:11 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-4865ea42-c9b0-4196-a403-368de544a3bf tempest-ProjectReaderTests-244390080 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:53:11 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-4865ea42-c9b0-4196-a403-368de544a3bf tempest-ProjectReaderTests-244390080 None] Deleted volume successfully. Jul 28 10:53:11 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4865ea42-c9b0-4196-a403-368de544a3bf tempest-ProjectReaderTests-244390080 None] Lock "cinder-2f19a368-0999-4781-80f5-07b6f8f178d6-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:53:11 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-645a7f6d-e8e7-41fd-bde5-2ca7041c7eb5 tempest-ProjectReaderTests-244390080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:53:11 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-645a7f6d-e8e7-41fd-bde5-2ca7041c7eb5 tempest-ProjectReaderTests-244390080 None] Flow 'volume_create_manager' (ddcf2ad1-8890-43d9-9da7-c3576317c884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:53:11 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-645a7f6d-e8e7-41fd-bde5-2ca7041c7eb5 tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e95fc0b-d8d4-42e6-a645-373459797e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:53:11 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-645a7f6d-e8e7-41fd-bde5-2ca7041c7eb5 tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e95fc0b-d8d4-42e6-a645-373459797e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1457025717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9144d9c-b381-4575-96c6-3301ad215756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='464cdad3968a41329f6b39055f1895c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:53:12Z,use_quota=True,user_id='abf5fde5cc3942cf9cf2e5d9310701ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:53:11 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-645a7f6d-e8e7-41fd-bde5-2ca7041c7eb5 tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (697807f8-2b0e-454c-9de6-989c19778fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:53:11 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-645a7f6d-e8e7-41fd-bde5-2ca7041c7eb5 tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (697807f8-2b0e-454c-9de6-989c19778fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:53:11 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-645a7f6d-e8e7-41fd-bde5-2ca7041c7eb5 tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e2ac41-f419-4fe7-b1b7-8cefbd63d8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:53:11 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-645a7f6d-e8e7-41fd-bde5-2ca7041c7eb5 tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e2ac41-f419-4fe7-b1b7-8cefbd63d8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9144d9c-b381-4575-96c6-3301ad215756', 'volume_name': 'volume-e9144d9c-b381-4575-96c6-3301ad215756', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:53:11 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-645a7f6d-e8e7-41fd-bde5-2ca7041c7eb5 tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f668f5af-c24f-428f-b7b6-b22849939a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:53:11 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-645a7f6d-e8e7-41fd-bde5-2ca7041c7eb5 tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f668f5af-c24f-428f-b7b6-b22849939a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:53:11 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-645a7f6d-e8e7-41fd-bde5-2ca7041c7eb5 tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a423c6c-8c76-4d72-b961-6dde5033c3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:53:11 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-645a7f6d-e8e7-41fd-bde5-2ca7041c7eb5 tempest-ProjectReaderTests-244390080 None] Volume e9144d9c-b381-4575-96c6-3301ad215756: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9144d9c-b381-4575-96c6-3301ad215756', 'volume_size': 1} Jul 28 10:53:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-645a7f6d-e8e7-41fd-bde5-2ca7041c7eb5 tempest-ProjectReaderTests-244390080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:53:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-645a7f6d-e8e7-41fd-bde5-2ca7041c7eb5 tempest-ProjectReaderTests-244390080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:53:11 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-645a7f6d-e8e7-41fd-bde5-2ca7041c7eb5 tempest-ProjectReaderTests-244390080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1457025717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9144d9c-b381-4575-96c6-3301ad215756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='464cdad3968a41329f6b39055f1895c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:53:12Z,use_quota=True,user_id='abf5fde5cc3942cf9cf2e5d9310701ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:53:11 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-645a7f6d-e8e7-41fd-bde5-2ca7041c7eb5 tempest-ProjectReaderTests-244390080 None] Creating volume e9144d9c-b381-4575-96c6-3301ad215756 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:53:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-645a7f6d-e8e7-41fd-bde5-2ca7041c7eb5 tempest-ProjectReaderTests-244390080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:53:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-645a7f6d-e8e7-41fd-bde5-2ca7041c7eb5 tempest-ProjectReaderTests-244390080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:53:11 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-645a7f6d-e8e7-41fd-bde5-2ca7041c7eb5 tempest-ProjectReaderTests-244390080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:53:11 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-645a7f6d-e8e7-41fd-bde5-2ca7041c7eb5 tempest-ProjectReaderTests-244390080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:53:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-645a7f6d-e8e7-41fd-bde5-2ca7041c7eb5 tempest-ProjectReaderTests-244390080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:53:11 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-645a7f6d-e8e7-41fd-bde5-2ca7041c7eb5 tempest-ProjectReaderTests-244390080 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:53:11 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-645a7f6d-e8e7-41fd-bde5-2ca7041c7eb5 tempest-ProjectReaderTests-244390080 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:53:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-645a7f6d-e8e7-41fd-bde5-2ca7041c7eb5 tempest-ProjectReaderTests-244390080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e9144d9c-b381-4575-96c6-3301ad215756 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:12 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e9144d9c-b381-4575-96c6-3301ad215756 1073741824 Jul 28 10:53:12 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:12 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-645a7f6d-e8e7-41fd-bde5-2ca7041c7eb5 tempest-ProjectReaderTests-244390080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e9144d9c-b381-4575-96c6-3301ad215756 1073741824" returned: 0 in 0.410s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-645a7f6d-e8e7-41fd-bde5-2ca7041c7eb5 tempest-ProjectReaderTests-244390080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e9144d9c-b381-4575-96c6-3301ad215756 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:12 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e9144d9c-b381-4575-96c6-3301ad215756 Jul 28 10:53:12 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:12 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-645a7f6d-e8e7-41fd-bde5-2ca7041c7eb5 tempest-ProjectReaderTests-244390080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e9144d9c-b381-4575-96c6-3301ad215756" returned: 0 in 0.242s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-645a7f6d-e8e7-41fd-bde5-2ca7041c7eb5 tempest-ProjectReaderTests-244390080 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:53:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-645a7f6d-e8e7-41fd-bde5-2ca7041c7eb5 tempest-ProjectReaderTests-244390080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:53:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-645a7f6d-e8e7-41fd-bde5-2ca7041c7eb5 tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a423c6c-8c76-4d72-b961-6dde5033c3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9144d9c-b381-4575-96c6-3301ad215756', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:53:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-645a7f6d-e8e7-41fd-bde5-2ca7041c7eb5 tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3fc5c8f-4663-4509-878b-75c1061397ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:53:12 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-645a7f6d-e8e7-41fd-bde5-2ca7041c7eb5 tempest-ProjectReaderTests-244390080 None] Volume volume-e9144d9c-b381-4575-96c6-3301ad215756 (e9144d9c-b381-4575-96c6-3301ad215756): created successfully Jul 28 10:53:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-645a7f6d-e8e7-41fd-bde5-2ca7041c7eb5 tempest-ProjectReaderTests-244390080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3fc5c8f-4663-4509-878b-75c1061397ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:53:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-645a7f6d-e8e7-41fd-bde5-2ca7041c7eb5 tempest-ProjectReaderTests-244390080 None] Flow 'volume_create_manager' (ddcf2ad1-8890-43d9-9da7-c3576317c884) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:53:12 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-645a7f6d-e8e7-41fd-bde5-2ca7041c7eb5 tempest-ProjectReaderTests-244390080 None] Created volume successfully. Jul 28 10:53:12 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-52d297ca-b9e9-4525-953b-7ba83f640a7a tempest-ProjectReaderTests-244390080 None] Acquiring lock "cinder-e9144d9c-b381-4575-96c6-3301ad215756-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:53:12 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-52d297ca-b9e9-4525-953b-7ba83f640a7a tempest-ProjectReaderTests-244390080 None] Lock "cinder-e9144d9c-b381-4575-96c6-3301ad215756-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:53:12 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-52d297ca-b9e9-4525-953b-7ba83f640a7a tempest-ProjectReaderTests-244390080 None] Acquiring lock "cinder-quobyte-e9144d9c-b381-4575-96c6-3301ad215756" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:53:12 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-52d297ca-b9e9-4525-953b-7ba83f640a7a tempest-ProjectReaderTests-244390080 None] Lock "cinder-quobyte-e9144d9c-b381-4575-96c6-3301ad215756" acquired by "delete_volume" :: waited 0.018s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:53:13 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[b628974f-f6ea-4434-91fe-f9cf724d19a3]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:53:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-52d297ca-b9e9-4525-953b-7ba83f640a7a tempest-ProjectReaderTests-244390080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e9144d9c-b381-4575-96c6-3301ad215756 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:13 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e9144d9c-b381-4575-96c6-3301ad215756 Jul 28 10:53:13 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:13 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-52d297ca-b9e9-4525-953b-7ba83f640a7a tempest-ProjectReaderTests-244390080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e9144d9c-b381-4575-96c6-3301ad215756" returned: 0 in 0.360s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-52d297ca-b9e9-4525-953b-7ba83f640a7a tempest-ProjectReaderTests-244390080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e9144d9c-b381-4575-96c6-3301ad215756 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:13 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e9144d9c-b381-4575-96c6-3301ad215756 Jul 28 10:53:13 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:13 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-52d297ca-b9e9-4525-953b-7ba83f640a7a tempest-ProjectReaderTests-244390080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e9144d9c-b381-4575-96c6-3301ad215756" returned: 0 in 0.244s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:13 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-52d297ca-b9e9-4525-953b-7ba83f640a7a tempest-ProjectReaderTests-244390080 None] Lock "cinder-quobyte-e9144d9c-b381-4575-96c6-3301ad215756" released by "delete_volume" :: held 0.643s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:53:13 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-52d297ca-b9e9-4525-953b-7ba83f640a7a tempest-ProjectReaderTests-244390080 None] Created reservations ['2ac2e439-33ba-4a8a-8b97-b7104a2fecb3', 'e3ba2988-53e0-4389-a7ed-07bca02fe3d9', '25264f01-f078-4abd-b621-80924c402e7a', '34cedfe6-48d8-493f-b193-168a459abd3d'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:53:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-52d297ca-b9e9-4525-953b-7ba83f640a7a tempest-ProjectReaderTests-244390080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:53:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-52d297ca-b9e9-4525-953b-7ba83f640a7a tempest-ProjectReaderTests-244390080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:53:13 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-52d297ca-b9e9-4525-953b-7ba83f640a7a tempest-ProjectReaderTests-244390080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:53:13 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-52d297ca-b9e9-4525-953b-7ba83f640a7a tempest-ProjectReaderTests-244390080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:53:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-52d297ca-b9e9-4525-953b-7ba83f640a7a tempest-ProjectReaderTests-244390080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:53:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-52d297ca-b9e9-4525-953b-7ba83f640a7a tempest-ProjectReaderTests-244390080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:13 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:53:13 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:13 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-52d297ca-b9e9-4525-953b-7ba83f640a7a tempest-ProjectReaderTests-244390080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.239s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:13 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-52d297ca-b9e9-4525-953b-7ba83f640a7a tempest-ProjectReaderTests-244390080 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:53:13 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-52d297ca-b9e9-4525-953b-7ba83f640a7a tempest-ProjectReaderTests-244390080 None] Deleted volume successfully. Jul 28 10:53:14 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-52d297ca-b9e9-4525-953b-7ba83f640a7a tempest-ProjectReaderTests-244390080 None] Lock "cinder-e9144d9c-b381-4575-96c6-3301ad215756-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:53:23 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=79,cinder:UPDATE=106,cinder:INSERT=28,cinder:DELETE=9 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:53:24 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:UPDATE=110,cinder:DELETE=10,cinder:SELECT=77,cinder:INSERT=31 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:53:28 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:53:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:53:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:53:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:53:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:53:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:53:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:28 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:53:28 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:28 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.310s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:28 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:53:28 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager._thread_info {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:53:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread count: 29 {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 10:53:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread info: [<_MainThread(MainThread, started 137939890385024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 10:53:35 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfcb40c9-979a-4752-9b87-632a7543f760 tempest-SnapshotDependencyTests-1808779901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:53:35 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bfcb40c9-979a-4752-9b87-632a7543f760 tempest-SnapshotDependencyTests-1808779901 None] Flow 'volume_create_manager' (7c43ac0f-e87a-48d0-80af-29f477f10a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:53:35 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bfcb40c9-979a-4752-9b87-632a7543f760 tempest-SnapshotDependencyTests-1808779901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3344a1dc-3606-4171-9219-820349db4ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:53:35 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bfcb40c9-979a-4752-9b87-632a7543f760 tempest-SnapshotDependencyTests-1808779901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3344a1dc-3606-4171-9219-820349db4ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-98813963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d0b5f76-5ba0-4a64-8714-0cb88d50cff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17ac3dd58a243bda6b8b6a580b65c04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:53:36Z,use_quota=True,user_id='0d3afb209cb041f58e194b213914d1a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:53:35 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bfcb40c9-979a-4752-9b87-632a7543f760 tempest-SnapshotDependencyTests-1808779901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (546ec416-4449-4c17-9d87-089b5de5e4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:53:35 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bfcb40c9-979a-4752-9b87-632a7543f760 tempest-SnapshotDependencyTests-1808779901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (546ec416-4449-4c17-9d87-089b5de5e4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:53:35 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bfcb40c9-979a-4752-9b87-632a7543f760 tempest-SnapshotDependencyTests-1808779901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f83ff05-4631-49f7-bdfb-c077cfaff8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:53:35 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bfcb40c9-979a-4752-9b87-632a7543f760 tempest-SnapshotDependencyTests-1808779901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f83ff05-4631-49f7-bdfb-c077cfaff8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d0b5f76-5ba0-4a64-8714-0cb88d50cff2', 'volume_name': 'volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:53:35 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bfcb40c9-979a-4752-9b87-632a7543f760 tempest-SnapshotDependencyTests-1808779901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8590650-8fe6-462f-abdb-af69b65529f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:53:35 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bfcb40c9-979a-4752-9b87-632a7543f760 tempest-SnapshotDependencyTests-1808779901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8590650-8fe6-462f-abdb-af69b65529f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:53:35 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bfcb40c9-979a-4752-9b87-632a7543f760 tempest-SnapshotDependencyTests-1808779901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e55896e-88c3-45f6-8d82-b1093f162238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:53:35 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-bfcb40c9-979a-4752-9b87-632a7543f760 tempest-SnapshotDependencyTests-1808779901 None] Volume 9d0b5f76-5ba0-4a64-8714-0cb88d50cff2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2', 'volume_size': 1} Jul 28 10:53:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-bfcb40c9-979a-4752-9b87-632a7543f760 tempest-SnapshotDependencyTests-1808779901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:53:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-bfcb40c9-979a-4752-9b87-632a7543f760 tempest-SnapshotDependencyTests-1808779901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:53:35 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-bfcb40c9-979a-4752-9b87-632a7543f760 tempest-SnapshotDependencyTests-1808779901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-98813963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d0b5f76-5ba0-4a64-8714-0cb88d50cff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17ac3dd58a243bda6b8b6a580b65c04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:53:36Z,use_quota=True,user_id='0d3afb209cb041f58e194b213914d1a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:53:35 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-bfcb40c9-979a-4752-9b87-632a7543f760 tempest-SnapshotDependencyTests-1808779901 None] Creating volume 9d0b5f76-5ba0-4a64-8714-0cb88d50cff2 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:53:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-bfcb40c9-979a-4752-9b87-632a7543f760 tempest-SnapshotDependencyTests-1808779901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:53:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-bfcb40c9-979a-4752-9b87-632a7543f760 tempest-SnapshotDependencyTests-1808779901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:53:35 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-bfcb40c9-979a-4752-9b87-632a7543f760 tempest-SnapshotDependencyTests-1808779901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:53:35 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-bfcb40c9-979a-4752-9b87-632a7543f760 tempest-SnapshotDependencyTests-1808779901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:53:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-bfcb40c9-979a-4752-9b87-632a7543f760 tempest-SnapshotDependencyTests-1808779901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:53:35 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-bfcb40c9-979a-4752-9b87-632a7543f760 tempest-SnapshotDependencyTests-1808779901 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:53:35 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-bfcb40c9-979a-4752-9b87-632a7543f760 tempest-SnapshotDependencyTests-1808779901 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:53:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bfcb40c9-979a-4752-9b87-632a7543f760 tempest-SnapshotDependencyTests-1808779901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:35 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2 1073741824 Jul 28 10:53:35 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:36 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bfcb40c9-979a-4752-9b87-632a7543f760 tempest-SnapshotDependencyTests-1808779901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2 1073741824" returned: 0 in 0.401s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bfcb40c9-979a-4752-9b87-632a7543f760 tempest-SnapshotDependencyTests-1808779901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:36 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2 Jul 28 10:53:36 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:36 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bfcb40c9-979a-4752-9b87-632a7543f760 tempest-SnapshotDependencyTests-1808779901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2" returned: 0 in 0.243s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:36 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-bfcb40c9-979a-4752-9b87-632a7543f760 tempest-SnapshotDependencyTests-1808779901 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:53:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-bfcb40c9-979a-4752-9b87-632a7543f760 tempest-SnapshotDependencyTests-1808779901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:53:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bfcb40c9-979a-4752-9b87-632a7543f760 tempest-SnapshotDependencyTests-1808779901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e55896e-88c3-45f6-8d82-b1093f162238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:53:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bfcb40c9-979a-4752-9b87-632a7543f760 tempest-SnapshotDependencyTests-1808779901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7196a35a-106b-430d-b014-2a84b329dc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:53:36 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-bfcb40c9-979a-4752-9b87-632a7543f760 tempest-SnapshotDependencyTests-1808779901 None] Volume volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2 (9d0b5f76-5ba0-4a64-8714-0cb88d50cff2): created successfully Jul 28 10:53:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bfcb40c9-979a-4752-9b87-632a7543f760 tempest-SnapshotDependencyTests-1808779901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7196a35a-106b-430d-b014-2a84b329dc44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:53:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bfcb40c9-979a-4752-9b87-632a7543f760 tempest-SnapshotDependencyTests-1808779901 None] Flow 'volume_create_manager' (7c43ac0f-e87a-48d0-80af-29f477f10a6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:53:36 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-bfcb40c9-979a-4752-9b87-632a7543f760 tempest-SnapshotDependencyTests-1808779901 None] Created volume successfully. Jul 28 10:53:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-98b9c42e-b544-4820-97fc-24858668a5db tempest-SnapshotDependencyTests-1808779901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:53:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-98b9c42e-b544-4820-97fc-24858668a5db tempest-SnapshotDependencyTests-1808779901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:53:37 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-98b9c42e-b544-4820-97fc-24858668a5db tempest-SnapshotDependencyTests-1808779901 None] Creating offline snapshot 35c7c2dd-3e23-423f-8762-a0ae9511e17c of volume 9d0b5f76-5ba0-4a64-8714-0cb88d50cff2 {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:53:37 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[91da66f0-6cfd-4b78-b8b1-ada1219a87b3]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:53:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-98b9c42e-b544-4820-97fc-24858668a5db tempest-SnapshotDependencyTests-1808779901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:37 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2 Jul 28 10:53:37 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:37 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-98b9c42e-b544-4820-97fc-24858668a5db tempest-SnapshotDependencyTests-1808779901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2" returned: 0 in 0.350s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-98b9c42e-b544-4820-97fc-24858668a5db tempest-SnapshotDependencyTests-1808779901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2.35c7c2dd-3e23-423f-8762-a0ae9511e17c 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:37 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2.35c7c2dd-3e23-423f-8762-a0ae9511e17c 1G Jul 28 10:53:37 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:37 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-98b9c42e-b544-4820-97fc-24858668a5db tempest-SnapshotDependencyTests-1808779901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2.35c7c2dd-3e23-423f-8762-a0ae9511e17c 1G" returned: 0 in 0.379s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-98b9c42e-b544-4820-97fc-24858668a5db tempest-SnapshotDependencyTests-1808779901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2.35c7c2dd-3e23-423f-8762-a0ae9511e17c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:37 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2.35c7c2dd-3e23-423f-8762-a0ae9511e17c Jul 28 10:53:37 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:38 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-98b9c42e-b544-4820-97fc-24858668a5db tempest-SnapshotDependencyTests-1808779901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2.35c7c2dd-3e23-423f-8762-a0ae9511e17c" returned: 0 in 0.276s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:38 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-98b9c42e-b544-4820-97fc-24858668a5db tempest-SnapshotDependencyTests-1808779901 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2.35c7c2dd-3e23-423f-8762-a0ae9511e17c is being set with open permissions: ugo+rw Jul 28 10:53:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-98b9c42e-b544-4820-97fc-24858668a5db tempest-SnapshotDependencyTests-1808779901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2.35c7c2dd-3e23-423f-8762-a0ae9511e17c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:38 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2.35c7c2dd-3e23-423f-8762-a0ae9511e17c Jul 28 10:53:38 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:38 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-98b9c42e-b544-4820-97fc-24858668a5db tempest-SnapshotDependencyTests-1808779901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2.35c7c2dd-3e23-423f-8762-a0ae9511e17c" returned: 0 in 0.247s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-98b9c42e-b544-4820-97fc-24858668a5db tempest-SnapshotDependencyTests-1808779901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:38 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2.info Jul 28 10:53:38 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:38 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-98b9c42e-b544-4820-97fc-24858668a5db tempest-SnapshotDependencyTests-1808779901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2.info" returned: 0 in 0.240s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:38 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-98b9c42e-b544-4820-97fc-24858668a5db tempest-SnapshotDependencyTests-1808779901 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2.info is being set with open permissions: ugo+rw Jul 28 10:53:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-98b9c42e-b544-4820-97fc-24858668a5db tempest-SnapshotDependencyTests-1808779901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:38 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2.info Jul 28 10:53:38 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:38 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-98b9c42e-b544-4820-97fc-24858668a5db tempest-SnapshotDependencyTests-1808779901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2.info" returned: 0 in 0.238s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-98b9c42e-b544-4820-97fc-24858668a5db tempest-SnapshotDependencyTests-1808779901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.819s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:53:38 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-98b9c42e-b544-4820-97fc-24858668a5db tempest-SnapshotDependencyTests-1808779901 None] Create snapshot completed successfully Jul 28 10:53:39 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:53:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Flow 'volume_create_manager' (de294d72-d682-43b2-8662-1ddd9e081507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:53:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ddc36e4-c5b0-441f-a4d5-9ca6ea7080e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:53:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ddc36e4-c5b0-441f-a4d5-9ca6ea7080e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8da6ae1e-5fdf-4520-97aa-03ae743eda8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17ac3dd58a243bda6b8b6a580b65c04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=35c7c2dd-3e23-423f-8762-a0ae9511e17c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:53:40Z,use_quota=True,user_id='0d3afb209cb041f58e194b213914d1a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:53:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e19242e-4a02-4d2f-8d44-2c1180fb70d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:53:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e19242e-4a02-4d2f-8d44-2c1180fb70d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:53:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a02fc4da-5f24-4fb0-a187-1dc2717c30c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:53:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a02fc4da-5f24-4fb0-a187-1dc2717c30c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8da6ae1e-5fdf-4520-97aa-03ae743eda8d', 'volume_name': 'volume-8da6ae1e-5fdf-4520-97aa-03ae743eda8d', 'volume_size': 1, 'snapshot_id': '35c7c2dd-3e23-423f-8762-a0ae9511e17c'}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:53:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fccb2c98-98a6-4829-be1f-4040da812ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:53:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fccb2c98-98a6-4829-be1f-4040da812ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:53:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf13608a-2bc7-4263-a922-5cbbcac2b331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:53:39 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Volume 8da6ae1e-5fdf-4520-97aa-03ae743eda8d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8da6ae1e-5fdf-4520-97aa-03ae743eda8d', 'volume_size': 1, 'snapshot_id': '35c7c2dd-3e23-423f-8762-a0ae9511e17c'} Jul 28 10:53:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:53:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:53:39 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Acquiring lock "cinder-quobyte-35c7c2dd-3e23-423f-8762-a0ae9511e17c-8da6ae1e-5fdf-4520-97aa-03ae743eda8d" by "_create_volume_from_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:53:39 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Lock "cinder-quobyte-35c7c2dd-3e23-423f-8762-a0ae9511e17c-8da6ae1e-5fdf-4520-97aa-03ae743eda8d" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:53:39 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Creating volume 8da6ae1e-5fdf-4520-97aa-03ae743eda8d from snapshot 35c7c2dd-3e23-423f-8762-a0ae9511e17c {{(pid=88413) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 28 10:53:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:53:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:53:39 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:53:39 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:53:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:53:39 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:53:39 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Acquiring lock "cinder-quobyte-8da6ae1e-5fdf-4520-97aa-03ae743eda8d" by "_copy_volume_from_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:53:39 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Lock "cinder-quobyte-8da6ae1e-5fdf-4520-97aa-03ae743eda8d" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:53:39 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] snapshot: 35c7c2dd-3e23-423f-8762-a0ae9511e17c, volume: 8da6ae1e-5fdf-4520-97aa-03ae743eda8d, {{(pid=88413) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 28 10:53:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:53:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:53:39 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:53:39 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:53:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:53:39 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7d8367-cd2f-4bb8-b1b9-81a348290509]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:53:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2.35c7c2dd-3e23-423f-8762-a0ae9511e17c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:39 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2.35c7c2dd-3e23-423f-8762-a0ae9511e17c Jul 28 10:53:39 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:40 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2.35c7c2dd-3e23-423f-8762-a0ae9511e17c" returned: 0 in 0.355s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:40 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:53:40 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2 {{(pid=88413) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 28 10:53:40 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Creating direct copy from snapshot {{(pid=88413) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 28 10:53:40 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b5d6ba-4b06-42ac-a295-563290c8f362]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:53:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:40 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2 Jul 28 10:53:40 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:40 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2" returned: 0 in 0.356s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:40 devstack cinder-volume[88413]: DEBUG cinder.utils [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Path /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-8da6ae1e-5fdf-4520-97aa-03ae743eda8d not found in is_blk_device check {{(pid=88413) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 28 10:53:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-8da6ae1e-5fdf-4520-97aa-03ae743eda8d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:40 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-8da6ae1e-5fdf-4520-97aa-03ae743eda8d Jul 28 10:53:40 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:44 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-8da6ae1e-5fdf-4520-97aa-03ae743eda8d" returned: 0 in 4.052s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:44 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fd1852-2ead-428f-9295-0587282f407c]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:53:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:44 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2 Jul 28 10:53:44 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:45 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2" returned: 0 in 0.535s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:45 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2, size 1024.00 MB, duration 4.05 sec, destination /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-8da6ae1e-5fdf-4520-97aa-03ae743eda8d {{(pid=88413) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 10:53:45 devstack cinder-volume[88413]: INFO cinder.image.image_utils [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Converted 1024.00 MB image at 252.66 MB/s Jul 28 10:53:45 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-8da6ae1e-5fdf-4520-97aa-03ae743eda8d is being set with open permissions: ugo+rw Jul 28 10:53:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-8da6ae1e-5fdf-4520-97aa-03ae743eda8d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:45 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-8da6ae1e-5fdf-4520-97aa-03ae743eda8d Jul 28 10:53:45 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:45 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-8da6ae1e-5fdf-4520-97aa-03ae743eda8d" returned: 0 in 0.237s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:45 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Lock "cinder-quobyte-8da6ae1e-5fdf-4520-97aa-03ae743eda8d" released by "_copy_volume_from_snapshot" :: held 5.622s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:53:45 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Lock "cinder-quobyte-35c7c2dd-3e23-423f-8762-a0ae9511e17c-8da6ae1e-5fdf-4520-97aa-03ae743eda8d" released by "_create_volume_from_snapshot" :: held 5.652s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:53:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.668s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:53:45 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf13608a-2bc7-4263-a922-5cbbcac2b331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8da6ae1e-5fdf-4520-97aa-03ae743eda8d', 'volume_size': 1, 'snapshot_id': '35c7c2dd-3e23-423f-8762-a0ae9511e17c'}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:53:45 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a53c718c-eed9-4e5d-bda3-047a777f7595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:53:45 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Volume volume-8da6ae1e-5fdf-4520-97aa-03ae743eda8d (8da6ae1e-5fdf-4520-97aa-03ae743eda8d): created successfully Jul 28 10:53:45 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a53c718c-eed9-4e5d-bda3-047a777f7595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:53:45 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Flow 'volume_create_manager' (de294d72-d682-43b2-8662-1ddd9e081507) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:53:45 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-134450b7-b29d-4bbf-a839-a8764d441731 tempest-SnapshotDependencyTests-1808779901 None] Created volume successfully. Jul 28 10:53:46 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-402c69a8-a6f3-47db-9984-c8c0a69666a3 tempest-SnapshotDependencyTests-1808779901 None] Acquiring lock "cinder-35c7c2dd-3e23-423f-8762-a0ae9511e17c-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:53:46 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-402c69a8-a6f3-47db-9984-c8c0a69666a3 tempest-SnapshotDependencyTests-1808779901 None] Lock "cinder-35c7c2dd-3e23-423f-8762-a0ae9511e17c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:53:46 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-402c69a8-a6f3-47db-9984-c8c0a69666a3 tempest-SnapshotDependencyTests-1808779901 None] Acquiring lock "cinder-quobyte-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:53:46 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-402c69a8-a6f3-47db-9984-c8c0a69666a3 tempest-SnapshotDependencyTests-1808779901 None] Lock "cinder-quobyte-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:53:46 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-402c69a8-a6f3-47db-9984-c8c0a69666a3 tempest-SnapshotDependencyTests-1808779901 None] Acquiring lock "cinder-quobyte-35c7c2dd-3e23-423f-8762-a0ae9511e17c" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:53:46 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-402c69a8-a6f3-47db-9984-c8c0a69666a3 tempest-SnapshotDependencyTests-1808779901 None] Lock "cinder-quobyte-35c7c2dd-3e23-423f-8762-a0ae9511e17c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:53:46 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-402c69a8-a6f3-47db-9984-c8c0a69666a3 tempest-SnapshotDependencyTests-1808779901 None] Deleting offline snapshot 35c7c2dd-3e23-423f-8762-a0ae9511e17c of volume 9d0b5f76-5ba0-4a64-8714-0cb88d50cff2 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:53:46 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-402c69a8-a6f3-47db-9984-c8c0a69666a3 tempest-SnapshotDependencyTests-1808779901 None] snapshot_file for this snap is: volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2.35c7c2dd-3e23-423f-8762-a0ae9511e17c {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:53:46 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff45f29-556a-4701-b938-d038dff1bf51]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:53:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-402c69a8-a6f3-47db-9984-c8c0a69666a3 tempest-SnapshotDependencyTests-1808779901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2.35c7c2dd-3e23-423f-8762-a0ae9511e17c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:46 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2.35c7c2dd-3e23-423f-8762-a0ae9511e17c Jul 28 10:53:46 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:46 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-402c69a8-a6f3-47db-9984-c8c0a69666a3 tempest-SnapshotDependencyTests-1808779901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2.35c7c2dd-3e23-423f-8762-a0ae9511e17c" returned: 0 in 0.358s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:46 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-402c69a8-a6f3-47db-9984-c8c0a69666a3 tempest-SnapshotDependencyTests-1808779901 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:53:46 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94494cb-6857-4fa1-9f35-42069b2146a3]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:53:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-402c69a8-a6f3-47db-9984-c8c0a69666a3 tempest-SnapshotDependencyTests-1808779901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:46 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2 Jul 28 10:53:46 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:47 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-402c69a8-a6f3-47db-9984-c8c0a69666a3 tempest-SnapshotDependencyTests-1808779901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2" returned: 0 in 0.342s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-402c69a8-a6f3-47db-9984-c8c0a69666a3 tempest-SnapshotDependencyTests-1808779901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2.35c7c2dd-3e23-423f-8762-a0ae9511e17c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:47 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2.35c7c2dd-3e23-423f-8762-a0ae9511e17c Jul 28 10:53:47 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:47 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-402c69a8-a6f3-47db-9984-c8c0a69666a3 tempest-SnapshotDependencyTests-1808779901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2.35c7c2dd-3e23-423f-8762-a0ae9511e17c" returned: 0 in 0.327s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-402c69a8-a6f3-47db-9984-c8c0a69666a3 tempest-SnapshotDependencyTests-1808779901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2.35c7c2dd-3e23-423f-8762-a0ae9511e17c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:47 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2.35c7c2dd-3e23-423f-8762-a0ae9511e17c Jul 28 10:53:47 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:47 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-402c69a8-a6f3-47db-9984-c8c0a69666a3 tempest-SnapshotDependencyTests-1808779901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2.35c7c2dd-3e23-423f-8762-a0ae9511e17c" returned: 0 in 0.247s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:47 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-402c69a8-a6f3-47db-9984-c8c0a69666a3 tempest-SnapshotDependencyTests-1808779901 None] Lock "cinder-quobyte-35c7c2dd-3e23-423f-8762-a0ae9511e17c" released by "_delete_snapshot" :: held 1.372s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:53:47 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-402c69a8-a6f3-47db-9984-c8c0a69666a3 tempest-SnapshotDependencyTests-1808779901 None] Lock "cinder-quobyte-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2" released by "delete_snapshot" :: held 1.393s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:53:47 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-402c69a8-a6f3-47db-9984-c8c0a69666a3 tempest-SnapshotDependencyTests-1808779901 None] Created reservations ['e280bf33-82ff-4d25-9c78-ad27f1b3658c', '9b3a9e55-67c2-48a4-8691-735544832ae1', 'dbe7fd73-6fc3-4a27-bb85-f9f5830acb2b', '8cb4d780-c9e5-4573-b02d-26a4a3d3446d'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:53:47 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-402c69a8-a6f3-47db-9984-c8c0a69666a3 tempest-SnapshotDependencyTests-1808779901 None] Delete snapshot completed successfully. Jul 28 10:53:47 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-402c69a8-a6f3-47db-9984-c8c0a69666a3 tempest-SnapshotDependencyTests-1808779901 None] Lock "cinder-35c7c2dd-3e23-423f-8762-a0ae9511e17c-delete_snapshot" released by "delete_snapshot" :: held 1.518s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:53:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-931d9c9d-5132-40f8-a5aa-71407a3a263d tempest-SnapshotDependencyTests-1808779901 None] Acquiring lock "cinder-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:53:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-931d9c9d-5132-40f8-a5aa-71407a3a263d tempest-SnapshotDependencyTests-1808779901 None] Lock "cinder-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:53:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-931d9c9d-5132-40f8-a5aa-71407a3a263d tempest-SnapshotDependencyTests-1808779901 None] Acquiring lock "cinder-quobyte-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:53:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-931d9c9d-5132-40f8-a5aa-71407a3a263d tempest-SnapshotDependencyTests-1808779901 None] Lock "cinder-quobyte-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2" acquired by "delete_volume" :: waited 0.013s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:53:48 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb74f9c-b927-459b-bf03-0605eedb005a]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:53:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-931d9c9d-5132-40f8-a5aa-71407a3a263d tempest-SnapshotDependencyTests-1808779901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:48 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2 Jul 28 10:53:48 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:48 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-931d9c9d-5132-40f8-a5aa-71407a3a263d tempest-SnapshotDependencyTests-1808779901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2" returned: 0 in 0.346s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-931d9c9d-5132-40f8-a5aa-71407a3a263d tempest-SnapshotDependencyTests-1808779901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:48 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2 Jul 28 10:53:48 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:49 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-931d9c9d-5132-40f8-a5aa-71407a3a263d tempest-SnapshotDependencyTests-1808779901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2" returned: 0 in 0.243s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:49 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-931d9c9d-5132-40f8-a5aa-71407a3a263d tempest-SnapshotDependencyTests-1808779901 None] Lock "cinder-quobyte-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2" released by "delete_volume" :: held 0.643s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:53:49 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-931d9c9d-5132-40f8-a5aa-71407a3a263d tempest-SnapshotDependencyTests-1808779901 None] Created reservations ['909ba9c2-4795-42b9-a6f9-4ee00efbd33f', '0c4602f0-1343-4d72-a67b-f12d71909cab', '0ff85676-2d57-440b-b72e-b63a2ffee148', '5a3576b5-fb1a-4d02-9563-eb8126a41898'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:53:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-931d9c9d-5132-40f8-a5aa-71407a3a263d tempest-SnapshotDependencyTests-1808779901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:53:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-931d9c9d-5132-40f8-a5aa-71407a3a263d tempest-SnapshotDependencyTests-1808779901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:53:49 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-931d9c9d-5132-40f8-a5aa-71407a3a263d tempest-SnapshotDependencyTests-1808779901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:53:49 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-931d9c9d-5132-40f8-a5aa-71407a3a263d tempest-SnapshotDependencyTests-1808779901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:53:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-931d9c9d-5132-40f8-a5aa-71407a3a263d tempest-SnapshotDependencyTests-1808779901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:53:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-931d9c9d-5132-40f8-a5aa-71407a3a263d tempest-SnapshotDependencyTests-1808779901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:49 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:53:49 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:49 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-931d9c9d-5132-40f8-a5aa-71407a3a263d tempest-SnapshotDependencyTests-1808779901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.236s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:49 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-931d9c9d-5132-40f8-a5aa-71407a3a263d tempest-SnapshotDependencyTests-1808779901 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:53:49 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-931d9c9d-5132-40f8-a5aa-71407a3a263d tempest-SnapshotDependencyTests-1808779901 None] Deleted volume successfully. Jul 28 10:53:49 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-931d9c9d-5132-40f8-a5aa-71407a3a263d tempest-SnapshotDependencyTests-1808779901 None] Lock "cinder-9d0b5f76-5ba0-4a64-8714-0cb88d50cff2-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:53:49 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-80999f0d-2827-4c11-901e-2cc5f6a3d467 tempest-SnapshotDependencyTests-1808779901 None] Acquiring lock "cinder-8da6ae1e-5fdf-4520-97aa-03ae743eda8d-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:53:49 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-80999f0d-2827-4c11-901e-2cc5f6a3d467 tempest-SnapshotDependencyTests-1808779901 None] Lock "cinder-8da6ae1e-5fdf-4520-97aa-03ae743eda8d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:53:49 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-80999f0d-2827-4c11-901e-2cc5f6a3d467 tempest-SnapshotDependencyTests-1808779901 None] Acquiring lock "cinder-quobyte-8da6ae1e-5fdf-4520-97aa-03ae743eda8d" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:53:49 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-80999f0d-2827-4c11-901e-2cc5f6a3d467 tempest-SnapshotDependencyTests-1808779901 None] Lock "cinder-quobyte-8da6ae1e-5fdf-4520-97aa-03ae743eda8d" acquired by "delete_volume" :: waited 0.015s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:53:49 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b7e744-c7fd-4372-b8ba-3b29ff17406c]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:53:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-80999f0d-2827-4c11-901e-2cc5f6a3d467 tempest-SnapshotDependencyTests-1808779901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-8da6ae1e-5fdf-4520-97aa-03ae743eda8d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:49 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-8da6ae1e-5fdf-4520-97aa-03ae743eda8d Jul 28 10:53:49 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:50 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-80999f0d-2827-4c11-901e-2cc5f6a3d467 tempest-SnapshotDependencyTests-1808779901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-8da6ae1e-5fdf-4520-97aa-03ae743eda8d" returned: 0 in 0.359s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-80999f0d-2827-4c11-901e-2cc5f6a3d467 tempest-SnapshotDependencyTests-1808779901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-8da6ae1e-5fdf-4520-97aa-03ae743eda8d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:50 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-8da6ae1e-5fdf-4520-97aa-03ae743eda8d Jul 28 10:53:50 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:50 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-80999f0d-2827-4c11-901e-2cc5f6a3d467 tempest-SnapshotDependencyTests-1808779901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-8da6ae1e-5fdf-4520-97aa-03ae743eda8d" returned: 0 in 0.243s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-80999f0d-2827-4c11-901e-2cc5f6a3d467 tempest-SnapshotDependencyTests-1808779901 None] Lock "cinder-quobyte-8da6ae1e-5fdf-4520-97aa-03ae743eda8d" released by "delete_volume" :: held 0.643s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:53:50 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-80999f0d-2827-4c11-901e-2cc5f6a3d467 tempest-SnapshotDependencyTests-1808779901 None] Created reservations ['6641b57c-f957-4dc0-acae-75868a1f4696', 'd8f6c422-1fd2-4a42-b29f-0187fd92c8c3', 'd57cada1-4967-4da2-8902-38ba6bae38c4', '803604cc-576a-4422-aac9-9dd26e3f3c25'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:53:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-80999f0d-2827-4c11-901e-2cc5f6a3d467 tempest-SnapshotDependencyTests-1808779901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:53:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-80999f0d-2827-4c11-901e-2cc5f6a3d467 tempest-SnapshotDependencyTests-1808779901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:53:50 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-80999f0d-2827-4c11-901e-2cc5f6a3d467 tempest-SnapshotDependencyTests-1808779901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:53:50 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-80999f0d-2827-4c11-901e-2cc5f6a3d467 tempest-SnapshotDependencyTests-1808779901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:53:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-80999f0d-2827-4c11-901e-2cc5f6a3d467 tempest-SnapshotDependencyTests-1808779901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:53:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-80999f0d-2827-4c11-901e-2cc5f6a3d467 tempest-SnapshotDependencyTests-1808779901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:53:50 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:53:50 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:53:50 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Jul 28 10:53:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-80999f0d-2827-4c11-901e-2cc5f6a3d467 tempest-SnapshotDependencyTests-1808779901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.238s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:53:50 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-80999f0d-2827-4c11-901e-2cc5f6a3d467 tempest-SnapshotDependencyTests-1808779901 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:53:50 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-80999f0d-2827-4c11-901e-2cc5f6a3d467 tempest-SnapshotDependencyTests-1808779901 None] Deleted volume successfully. Jul 28 10:53:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-80999f0d-2827-4c11-901e-2cc5f6a3d467 tempest-SnapshotDependencyTests-1808779901 None] Lock "cinder-8da6ae1e-5fdf-4520-97aa-03ae743eda8d-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:00 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=25,cinder:UPDATE=27,cinder:INSERT=9,cinder:DELETE=2 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:54:00 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:UPDATE=29,cinder:SELECT=22,cinder:INSERT=5,cinder:DELETE=3 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:54:08 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdadb117-d064-4f80-93fc-ed6636af16fd tempest-CreateVolumesFromImageTest-411654455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:54:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fdadb117-d064-4f80-93fc-ed6636af16fd tempest-CreateVolumesFromImageTest-411654455 None] Flow 'volume_create_manager' (0561a736-8c9f-45e7-a6ba-971c8fab9c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fdadb117-d064-4f80-93fc-ed6636af16fd tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56517389-ad81-4367-bca4-cd2e02704f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fdadb117-d064-4f80-93fc-ed6636af16fd tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56517389-ad81-4367-bca4-cd2e02704f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1652252012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14053f10-9789-419d-835a-733e92c156c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21168c2f5773492d852a63e247ed896a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:09Z,use_quota=True,user_id='e37c953c757d4af78eef4d4521fbb5ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fdadb117-d064-4f80-93fc-ed6636af16fd tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8dd3bdf-3edf-457d-a696-06135bdd51d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fdadb117-d064-4f80-93fc-ed6636af16fd tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8dd3bdf-3edf-457d-a696-06135bdd51d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fdadb117-d064-4f80-93fc-ed6636af16fd tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52238c72-cc5d-4a07-a296-f0bed05fc12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fdadb117-d064-4f80-93fc-ed6636af16fd tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52238c72-cc5d-4a07-a296-f0bed05fc12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14053f10-9789-419d-835a-733e92c156c1', 'volume_name': 'volume-14053f10-9789-419d-835a-733e92c156c1', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fdadb117-d064-4f80-93fc-ed6636af16fd tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d954d68-2bca-4233-b0ed-40bec3d5b417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fdadb117-d064-4f80-93fc-ed6636af16fd tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d954d68-2bca-4233-b0ed-40bec3d5b417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fdadb117-d064-4f80-93fc-ed6636af16fd tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d56ecc69-da10-4862-a03a-689a269c0a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:08 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-fdadb117-d064-4f80-93fc-ed6636af16fd tempest-CreateVolumesFromImageTest-411654455 None] Volume 14053f10-9789-419d-835a-733e92c156c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14053f10-9789-419d-835a-733e92c156c1', 'volume_size': 1} Jul 28 10:54:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fdadb117-d064-4f80-93fc-ed6636af16fd tempest-CreateVolumesFromImageTest-411654455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fdadb117-d064-4f80-93fc-ed6636af16fd tempest-CreateVolumesFromImageTest-411654455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:08 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-fdadb117-d064-4f80-93fc-ed6636af16fd tempest-CreateVolumesFromImageTest-411654455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1652252012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14053f10-9789-419d-835a-733e92c156c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21168c2f5773492d852a63e247ed896a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:09Z,use_quota=True,user_id='e37c953c757d4af78eef4d4521fbb5ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:54:08 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-fdadb117-d064-4f80-93fc-ed6636af16fd tempest-CreateVolumesFromImageTest-411654455 None] Creating volume 14053f10-9789-419d-835a-733e92c156c1 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:54:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fdadb117-d064-4f80-93fc-ed6636af16fd tempest-CreateVolumesFromImageTest-411654455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fdadb117-d064-4f80-93fc-ed6636af16fd tempest-CreateVolumesFromImageTest-411654455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:08 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-fdadb117-d064-4f80-93fc-ed6636af16fd tempest-CreateVolumesFromImageTest-411654455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:08 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-fdadb117-d064-4f80-93fc-ed6636af16fd tempest-CreateVolumesFromImageTest-411654455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fdadb117-d064-4f80-93fc-ed6636af16fd tempest-CreateVolumesFromImageTest-411654455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:08 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-fdadb117-d064-4f80-93fc-ed6636af16fd tempest-CreateVolumesFromImageTest-411654455 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:54:08 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-fdadb117-d064-4f80-93fc-ed6636af16fd tempest-CreateVolumesFromImageTest-411654455 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:54:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fdadb117-d064-4f80-93fc-ed6636af16fd tempest-CreateVolumesFromImageTest-411654455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-14053f10-9789-419d-835a-733e92c156c1 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:08 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-14053f10-9789-419d-835a-733e92c156c1 1073741824 Jul 28 10:54:08 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:08 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-26edeb67-acdf-4c49-b120-f4bbf1e58371 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-26edeb67-acdf-4c49-b120-f4bbf1e58371 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Flow 'volume_create_manager' (7a73b3aa-7f50-464c-a3a4-112c2d729c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-26edeb67-acdf-4c49-b120-f4bbf1e58371 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2d53fcd-1c51-4b04-a6e3-75fc798897bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-26edeb67-acdf-4c49-b120-f4bbf1e58371 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2d53fcd-1c51-4b04-a6e3-75fc798897bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1320256258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0755b410-165a-41d9-9b79-9aa57932ff25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4d103646faa484ebc45312e15c257f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:09Z,use_quota=True,user_id='ea8c813a083c4a98bed9b6738efe9609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-26edeb67-acdf-4c49-b120-f4bbf1e58371 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6baec601-be47-4c2c-83ca-68c5a0212816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-26edeb67-acdf-4c49-b120-f4bbf1e58371 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6baec601-be47-4c2c-83ca-68c5a0212816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-26edeb67-acdf-4c49-b120-f4bbf1e58371 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e571eef-b121-4ef9-b850-40d1f9495fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-26edeb67-acdf-4c49-b120-f4bbf1e58371 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e571eef-b121-4ef9-b850-40d1f9495fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0755b410-165a-41d9-9b79-9aa57932ff25', 'volume_name': 'volume-0755b410-165a-41d9-9b79-9aa57932ff25', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-26edeb67-acdf-4c49-b120-f4bbf1e58371 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10969195-13cb-4e3c-aee3-cb319cb649b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-26edeb67-acdf-4c49-b120-f4bbf1e58371 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10969195-13cb-4e3c-aee3-cb319cb649b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-26edeb67-acdf-4c49-b120-f4bbf1e58371 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06e6e68c-544d-4001-95ee-f4ba0b9e6511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:09 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-26edeb67-acdf-4c49-b120-f4bbf1e58371 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Volume 0755b410-165a-41d9-9b79-9aa57932ff25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0755b410-165a-41d9-9b79-9aa57932ff25', 'volume_size': 1} Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-26edeb67-acdf-4c49-b120-f4bbf1e58371 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a355ed5-f03f-4bc9-a9c1-cb6584f4cf4d tempest-CreateVolumesFromImageTest-411654455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2a355ed5-f03f-4bc9-a9c1-cb6584f4cf4d tempest-CreateVolumesFromImageTest-411654455 None] Flow 'volume_create_manager' (6f5486e1-9238-49ce-a970-4f05a2552a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2a355ed5-f03f-4bc9-a9c1-cb6584f4cf4d tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f103c111-80b3-48c5-ab2c-9a5f9681cec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2a355ed5-f03f-4bc9-a9c1-cb6584f4cf4d tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f103c111-80b3-48c5-ab2c-9a5f9681cec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-112578349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4807645b-747c-40ad-907d-ca65149adcdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21168c2f5773492d852a63e247ed896a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:09Z,use_quota=True,user_id='e37c953c757d4af78eef4d4521fbb5ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2a355ed5-f03f-4bc9-a9c1-cb6584f4cf4d tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28c6e026-b464-4127-bb1a-a1acf68bf3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2a355ed5-f03f-4bc9-a9c1-cb6584f4cf4d tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28c6e026-b464-4127-bb1a-a1acf68bf3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2a355ed5-f03f-4bc9-a9c1-cb6584f4cf4d tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc5f333-f678-4e8a-a512-e715ff83ddfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2a355ed5-f03f-4bc9-a9c1-cb6584f4cf4d tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc5f333-f678-4e8a-a512-e715ff83ddfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4807645b-747c-40ad-907d-ca65149adcdb', 'volume_name': 'volume-4807645b-747c-40ad-907d-ca65149adcdb', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2a355ed5-f03f-4bc9-a9c1-cb6584f4cf4d tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad3c54b9-b41b-48c5-930c-0c2e8dcdf61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2a355ed5-f03f-4bc9-a9c1-cb6584f4cf4d tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad3c54b9-b41b-48c5-930c-0c2e8dcdf61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2a355ed5-f03f-4bc9-a9c1-cb6584f4cf4d tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8041b8a5-d0df-4400-b988-c21bfd9b166c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:09 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-2a355ed5-f03f-4bc9-a9c1-cb6584f4cf4d tempest-CreateVolumesFromImageTest-411654455 None] Volume 4807645b-747c-40ad-907d-ca65149adcdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4807645b-747c-40ad-907d-ca65149adcdb', 'volume_size': 1} Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-2a355ed5-f03f-4bc9-a9c1-cb6584f4cf4d tempest-CreateVolumesFromImageTest-411654455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:09 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fdadb117-d064-4f80-93fc-ed6636af16fd tempest-CreateVolumesFromImageTest-411654455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-14053f10-9789-419d-835a-733e92c156c1 1073741824" returned: 0 in 0.568s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fdadb117-d064-4f80-93fc-ed6636af16fd tempest-CreateVolumesFromImageTest-411654455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-14053f10-9789-419d-835a-733e92c156c1 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:09 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-14053f10-9789-419d-835a-733e92c156c1 Jul 28 10:54:09 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:09 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fdadb117-d064-4f80-93fc-ed6636af16fd tempest-CreateVolumesFromImageTest-411654455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-14053f10-9789-419d-835a-733e92c156c1" returned: 0 in 0.354s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-fdadb117-d064-4f80-93fc-ed6636af16fd tempest-CreateVolumesFromImageTest-411654455 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fdadb117-d064-4f80-93fc-ed6636af16fd tempest-CreateVolumesFromImageTest-411654455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-26edeb67-acdf-4c49-b120-f4bbf1e58371 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.715s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-26edeb67-acdf-4c49-b120-f4bbf1e58371 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1320256258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0755b410-165a-41d9-9b79-9aa57932ff25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4d103646faa484ebc45312e15c257f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:09Z,use_quota=True,user_id='ea8c813a083c4a98bed9b6738efe9609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-26edeb67-acdf-4c49-b120-f4bbf1e58371 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Creating volume 0755b410-165a-41d9-9b79-9aa57932ff25 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-26edeb67-acdf-4c49-b120-f4bbf1e58371 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-26edeb67-acdf-4c49-b120-f4bbf1e58371 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-26edeb67-acdf-4c49-b120-f4bbf1e58371 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-26edeb67-acdf-4c49-b120-f4bbf1e58371 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-26edeb67-acdf-4c49-b120-f4bbf1e58371 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-26edeb67-acdf-4c49-b120-f4bbf1e58371 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:54:09 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-26edeb67-acdf-4c49-b120-f4bbf1e58371 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-26edeb67-acdf-4c49-b120-f4bbf1e58371 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0755b410-165a-41d9-9b79-9aa57932ff25 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fdadb117-d064-4f80-93fc-ed6636af16fd tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d56ecc69-da10-4862-a03a-689a269c0a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14053f10-9789-419d-835a-733e92c156c1', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:09 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0755b410-165a-41d9-9b79-9aa57932ff25 1073741824 Jul 28 10:54:09 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fdadb117-d064-4f80-93fc-ed6636af16fd tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (add420b9-9aaf-4237-aab5-68e4d730f485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:09 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-fdadb117-d064-4f80-93fc-ed6636af16fd tempest-CreateVolumesFromImageTest-411654455 None] Volume volume-14053f10-9789-419d-835a-733e92c156c1 (14053f10-9789-419d-835a-733e92c156c1): created successfully Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fdadb117-d064-4f80-93fc-ed6636af16fd tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (add420b9-9aaf-4237-aab5-68e4d730f485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:09 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fdadb117-d064-4f80-93fc-ed6636af16fd tempest-CreateVolumesFromImageTest-411654455 None] Flow 'volume_create_manager' (0561a736-8c9f-45e7-a6ba-971c8fab9c0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:10 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-fdadb117-d064-4f80-93fc-ed6636af16fd tempest-CreateVolumesFromImageTest-411654455 None] Created volume successfully. Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-73e5b8b3-fd25-4a14-98a2-aa435c7b00fa tempest-CreateVolumesFromSnapshotTest-1608055624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:54:10 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-73e5b8b3-fd25-4a14-98a2-aa435c7b00fa tempest-CreateVolumesFromSnapshotTest-1608055624 None] Flow 'volume_create_manager' (a7835895-a43b-467b-965d-47da14020890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-73e5b8b3-fd25-4a14-98a2-aa435c7b00fa tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eca07b96-0334-4e75-9a8b-27b80295daf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-26edeb67-acdf-4c49-b120-f4bbf1e58371 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0755b410-165a-41d9-9b79-9aa57932ff25 1073741824" returned: 0 in 0.566s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-73e5b8b3-fd25-4a14-98a2-aa435c7b00fa tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eca07b96-0334-4e75-9a8b-27b80295daf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1828845230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e203f27c-6e03-4139-afa9-7c4ee02da213,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeab7e9f807d4eefa059c324c03cb1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:10Z,use_quota=True,user_id='3cfd23eb40324b52814523ccf3da9db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-73e5b8b3-fd25-4a14-98a2-aa435c7b00fa tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d16836-b7a7-4f43-bfd0-b91c13dd315b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-73e5b8b3-fd25-4a14-98a2-aa435c7b00fa tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d16836-b7a7-4f43-bfd0-b91c13dd315b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-73e5b8b3-fd25-4a14-98a2-aa435c7b00fa tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e54e2be-7bcc-4646-a8e0-a0b1683d5893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-73e5b8b3-fd25-4a14-98a2-aa435c7b00fa tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e54e2be-7bcc-4646-a8e0-a0b1683d5893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e203f27c-6e03-4139-afa9-7c4ee02da213', 'volume_name': 'volume-e203f27c-6e03-4139-afa9-7c4ee02da213', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-73e5b8b3-fd25-4a14-98a2-aa435c7b00fa tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fa9ba45-c036-416f-b4eb-e76aa9b04cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-73e5b8b3-fd25-4a14-98a2-aa435c7b00fa tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fa9ba45-c036-416f-b4eb-e76aa9b04cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-73e5b8b3-fd25-4a14-98a2-aa435c7b00fa tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3181f8ba-251f-47c8-a5ae-e821a30885fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:10 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-73e5b8b3-fd25-4a14-98a2-aa435c7b00fa tempest-CreateVolumesFromSnapshotTest-1608055624 None] Volume e203f27c-6e03-4139-afa9-7c4ee02da213: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e203f27c-6e03-4139-afa9-7c4ee02da213', 'volume_size': 1} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-73e5b8b3-fd25-4a14-98a2-aa435c7b00fa tempest-CreateVolumesFromSnapshotTest-1608055624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3c93d2f-b1ba-4239-989c-628c067f31c1 tempest-CreateVolumesFromImageTest-411654455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b3c93d2f-b1ba-4239-989c-628c067f31c1 tempest-CreateVolumesFromImageTest-411654455 None] Flow 'volume_create_manager' (03d11d2b-4af4-4456-9f11-926e45be4bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b3c93d2f-b1ba-4239-989c-628c067f31c1 tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c35def-0e7d-4494-ab89-e87afa137bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-26edeb67-acdf-4c49-b120-f4bbf1e58371 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0755b410-165a-41d9-9b79-9aa57932ff25 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b3c93d2f-b1ba-4239-989c-628c067f31c1 tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c35def-0e7d-4494-ab89-e87afa137bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-528951213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c88d6afb-472e-4fa3-ba6c-ed579c065445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21168c2f5773492d852a63e247ed896a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:10Z,use_quota=True,user_id='e37c953c757d4af78eef4d4521fbb5ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b3c93d2f-b1ba-4239-989c-628c067f31c1 tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eea6785e-34e4-4f29-887e-f1f9a29f6cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b3c93d2f-b1ba-4239-989c-628c067f31c1 tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eea6785e-34e4-4f29-887e-f1f9a29f6cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:10 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0755b410-165a-41d9-9b79-9aa57932ff25 Jul 28 10:54:10 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b3c93d2f-b1ba-4239-989c-628c067f31c1 tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65b29522-eb90-4500-bce7-834095e1cec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b3c93d2f-b1ba-4239-989c-628c067f31c1 tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65b29522-eb90-4500-bce7-834095e1cec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c88d6afb-472e-4fa3-ba6c-ed579c065445', 'volume_name': 'volume-c88d6afb-472e-4fa3-ba6c-ed579c065445', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b3c93d2f-b1ba-4239-989c-628c067f31c1 tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6891efe-f583-42fc-aa32-15c6eb04171b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b3c93d2f-b1ba-4239-989c-628c067f31c1 tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6891efe-f583-42fc-aa32-15c6eb04171b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b3c93d2f-b1ba-4239-989c-628c067f31c1 tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fca9ab3-f5a4-4dfd-8f96-e4d67bc3564a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:10 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-b3c93d2f-b1ba-4239-989c-628c067f31c1 tempest-CreateVolumesFromImageTest-411654455 None] Volume c88d6afb-472e-4fa3-ba6c-ed579c065445: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c88d6afb-472e-4fa3-ba6c-ed579c065445', 'volume_size': 1} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b3c93d2f-b1ba-4239-989c-628c067f31c1 tempest-CreateVolumesFromImageTest-411654455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbb84416-bb9c-49a7-a9d9-105661fcf89a tempest-CreateVolumesFromImageTest-411654455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bbb84416-bb9c-49a7-a9d9-105661fcf89a tempest-CreateVolumesFromImageTest-411654455 None] Flow 'volume_create_manager' (7072ead6-414e-4e3a-9bda-41868372d53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bbb84416-bb9c-49a7-a9d9-105661fcf89a tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8db5ec6-0569-468c-abb7-936585a08cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bbb84416-bb9c-49a7-a9d9-105661fcf89a tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8db5ec6-0569-468c-abb7-936585a08cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-598036626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af080b45-b825-4e29-a380-97efa2b8b832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21168c2f5773492d852a63e247ed896a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:10Z,use_quota=True,user_id='e37c953c757d4af78eef4d4521fbb5ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bbb84416-bb9c-49a7-a9d9-105661fcf89a tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a589b9c2-13e3-49e1-88af-9269e7c84675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bbb84416-bb9c-49a7-a9d9-105661fcf89a tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a589b9c2-13e3-49e1-88af-9269e7c84675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bbb84416-bb9c-49a7-a9d9-105661fcf89a tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f4b26a0-f557-40a6-8458-f69354f9a7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bbb84416-bb9c-49a7-a9d9-105661fcf89a tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f4b26a0-f557-40a6-8458-f69354f9a7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af080b45-b825-4e29-a380-97efa2b8b832', 'volume_name': 'volume-af080b45-b825-4e29-a380-97efa2b8b832', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bbb84416-bb9c-49a7-a9d9-105661fcf89a tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56f84efb-add2-42f0-b96b-785c5b919933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bbb84416-bb9c-49a7-a9d9-105661fcf89a tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56f84efb-add2-42f0-b96b-785c5b919933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bbb84416-bb9c-49a7-a9d9-105661fcf89a tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45080566-f54f-444c-b976-e444fedb0e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:10 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-bbb84416-bb9c-49a7-a9d9-105661fcf89a tempest-CreateVolumesFromImageTest-411654455 None] Volume af080b45-b825-4e29-a380-97efa2b8b832: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af080b45-b825-4e29-a380-97efa2b8b832', 'volume_size': 1} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-bbb84416-bb9c-49a7-a9d9-105661fcf89a tempest-CreateVolumesFromImageTest-411654455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-060a9a0e-7653-40b8-b4ce-dc5622fe46de tempest-CreateVolumesFromImageTest-411654455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-060a9a0e-7653-40b8-b4ce-dc5622fe46de tempest-CreateVolumesFromImageTest-411654455 None] Flow 'volume_create_manager' (23835f33-e285-4115-b0b8-b1321cd3ad6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-060a9a0e-7653-40b8-b4ce-dc5622fe46de tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36c72087-10e9-4591-8980-bc2f61c802e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-060a9a0e-7653-40b8-b4ce-dc5622fe46de tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36c72087-10e9-4591-8980-bc2f61c802e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2035719336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ce4e4db-09bf-4aa6-8a64-bbccee063d33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21168c2f5773492d852a63e247ed896a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:11Z,use_quota=True,user_id='e37c953c757d4af78eef4d4521fbb5ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-060a9a0e-7653-40b8-b4ce-dc5622fe46de tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38009aeb-8304-4536-93d8-24dfce94d166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-060a9a0e-7653-40b8-b4ce-dc5622fe46de tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38009aeb-8304-4536-93d8-24dfce94d166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-060a9a0e-7653-40b8-b4ce-dc5622fe46de tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39759a2d-3f43-443e-9013-29479d8b55dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-060a9a0e-7653-40b8-b4ce-dc5622fe46de tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39759a2d-3f43-443e-9013-29479d8b55dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ce4e4db-09bf-4aa6-8a64-bbccee063d33', 'volume_name': 'volume-6ce4e4db-09bf-4aa6-8a64-bbccee063d33', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-060a9a0e-7653-40b8-b4ce-dc5622fe46de tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b675c73-08aa-4b35-965a-665b9dcebd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-060a9a0e-7653-40b8-b4ce-dc5622fe46de tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b675c73-08aa-4b35-965a-665b9dcebd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:10 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-060a9a0e-7653-40b8-b4ce-dc5622fe46de tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a09d2675-1707-4bd7-8e62-12c5488c9025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:10 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-060a9a0e-7653-40b8-b4ce-dc5622fe46de tempest-CreateVolumesFromImageTest-411654455 None] Volume 6ce4e4db-09bf-4aa6-8a64-bbccee063d33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ce4e4db-09bf-4aa6-8a64-bbccee063d33', 'volume_size': 1} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-060a9a0e-7653-40b8-b4ce-dc5622fe46de tempest-CreateVolumesFromImageTest-411654455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-26edeb67-acdf-4c49-b120-f4bbf1e58371 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0755b410-165a-41d9-9b79-9aa57932ff25" returned: 0 in 0.272s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-26edeb67-acdf-4c49-b120-f4bbf1e58371 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-26edeb67-acdf-4c49-b120-f4bbf1e58371 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-2a355ed5-f03f-4bc9-a9c1-cb6584f4cf4d tempest-CreateVolumesFromImageTest-411654455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.430s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-2a355ed5-f03f-4bc9-a9c1-cb6584f4cf4d tempest-CreateVolumesFromImageTest-411654455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-112578349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4807645b-747c-40ad-907d-ca65149adcdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21168c2f5773492d852a63e247ed896a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:09Z,use_quota=True,user_id='e37c953c757d4af78eef4d4521fbb5ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-2a355ed5-f03f-4bc9-a9c1-cb6584f4cf4d tempest-CreateVolumesFromImageTest-411654455 None] Creating volume 4807645b-747c-40ad-907d-ca65149adcdb {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-2a355ed5-f03f-4bc9-a9c1-cb6584f4cf4d tempest-CreateVolumesFromImageTest-411654455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-2a355ed5-f03f-4bc9-a9c1-cb6584f4cf4d tempest-CreateVolumesFromImageTest-411654455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-2a355ed5-f03f-4bc9-a9c1-cb6584f4cf4d tempest-CreateVolumesFromImageTest-411654455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-2a355ed5-f03f-4bc9-a9c1-cb6584f4cf4d tempest-CreateVolumesFromImageTest-411654455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-2a355ed5-f03f-4bc9-a9c1-cb6584f4cf4d tempest-CreateVolumesFromImageTest-411654455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-2a355ed5-f03f-4bc9-a9c1-cb6584f4cf4d tempest-CreateVolumesFromImageTest-411654455 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:54:10 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-2a355ed5-f03f-4bc9-a9c1-cb6584f4cf4d tempest-CreateVolumesFromImageTest-411654455 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2a355ed5-f03f-4bc9-a9c1-cb6584f4cf4d tempest-CreateVolumesFromImageTest-411654455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4807645b-747c-40ad-907d-ca65149adcdb 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-26edeb67-acdf-4c49-b120-f4bbf1e58371 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06e6e68c-544d-4001-95ee-f4ba0b9e6511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0755b410-165a-41d9-9b79-9aa57932ff25', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:10 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4807645b-747c-40ad-907d-ca65149adcdb 1073741824 Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-26edeb67-acdf-4c49-b120-f4bbf1e58371 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f509304f-8215-4321-b508-16469d889369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:10 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:10 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-26edeb67-acdf-4c49-b120-f4bbf1e58371 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Volume volume-0755b410-165a-41d9-9b79-9aa57932ff25 (0755b410-165a-41d9-9b79-9aa57932ff25): created successfully Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-26edeb67-acdf-4c49-b120-f4bbf1e58371 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f509304f-8215-4321-b508-16469d889369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:10 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-26edeb67-acdf-4c49-b120-f4bbf1e58371 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Flow 'volume_create_manager' (7a73b3aa-7f50-464c-a3a4-112c2d729c4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:10 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-26edeb67-acdf-4c49-b120-f4bbf1e58371 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Created volume successfully. Jul 28 10:54:11 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2a355ed5-f03f-4bc9-a9c1-cb6584f4cf4d tempest-CreateVolumesFromImageTest-411654455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4807645b-747c-40ad-907d-ca65149adcdb 1073741824" returned: 0 in 0.597s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2a355ed5-f03f-4bc9-a9c1-cb6584f4cf4d tempest-CreateVolumesFromImageTest-411654455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4807645b-747c-40ad-907d-ca65149adcdb {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:11 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4807645b-747c-40ad-907d-ca65149adcdb Jul 28 10:54:11 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:11 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-c79c3cc2-d12f-4b57-aed8-a85cb4080359 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:54:11 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c79c3cc2-d12f-4b57-aed8-a85cb4080359 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Flow 'volume_create_manager' (24257924-913c-45e5-869d-6a0ed2fca013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:11 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c79c3cc2-d12f-4b57-aed8-a85cb4080359 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbbc5593-06af-4590-9df7-be13b16b620a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:11 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c79c3cc2-d12f-4b57-aed8-a85cb4080359 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbbc5593-06af-4590-9df7-be13b16b620a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1469129518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=435470fe-0a56-477d-9b0a-4891ed004529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4d103646faa484ebc45312e15c257f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:12Z,use_quota=True,user_id='ea8c813a083c4a98bed9b6738efe9609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:11 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c79c3cc2-d12f-4b57-aed8-a85cb4080359 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (839fbe67-1eb0-4688-90aa-c81196db6233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:11 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c79c3cc2-d12f-4b57-aed8-a85cb4080359 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (839fbe67-1eb0-4688-90aa-c81196db6233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:11 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c79c3cc2-d12f-4b57-aed8-a85cb4080359 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b04a68e7-117e-4194-bc2c-5d52518b0800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:11 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c79c3cc2-d12f-4b57-aed8-a85cb4080359 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b04a68e7-117e-4194-bc2c-5d52518b0800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '435470fe-0a56-477d-9b0a-4891ed004529', 'volume_name': 'volume-435470fe-0a56-477d-9b0a-4891ed004529', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:11 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c79c3cc2-d12f-4b57-aed8-a85cb4080359 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c12822d4-5d22-4e36-8148-342cc30e732c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:11 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:11 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c79c3cc2-d12f-4b57-aed8-a85cb4080359 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c12822d4-5d22-4e36-8148-342cc30e732c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:11 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c79c3cc2-d12f-4b57-aed8-a85cb4080359 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5225f05-68ab-4c6c-93eb-4c5e5a02b181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:11 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-c79c3cc2-d12f-4b57-aed8-a85cb4080359 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Volume 435470fe-0a56-477d-9b0a-4891ed004529: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-435470fe-0a56-477d-9b0a-4891ed004529', 'volume_size': 1} Jul 28 10:54:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c79c3cc2-d12f-4b57-aed8-a85cb4080359 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2a355ed5-f03f-4bc9-a9c1-cb6584f4cf4d tempest-CreateVolumesFromImageTest-411654455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4807645b-747c-40ad-907d-ca65149adcdb" returned: 0 in 0.306s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:11 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-2a355ed5-f03f-4bc9-a9c1-cb6584f4cf4d tempest-CreateVolumesFromImageTest-411654455 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:54:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-2a355ed5-f03f-4bc9-a9c1-cb6584f4cf4d tempest-CreateVolumesFromImageTest-411654455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-73e5b8b3-fd25-4a14-98a2-aa435c7b00fa tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.292s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:11 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-73e5b8b3-fd25-4a14-98a2-aa435c7b00fa tempest-CreateVolumesFromSnapshotTest-1608055624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1828845230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e203f27c-6e03-4139-afa9-7c4ee02da213,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeab7e9f807d4eefa059c324c03cb1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:10Z,use_quota=True,user_id='3cfd23eb40324b52814523ccf3da9db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:54:11 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-73e5b8b3-fd25-4a14-98a2-aa435c7b00fa tempest-CreateVolumesFromSnapshotTest-1608055624 None] Creating volume e203f27c-6e03-4139-afa9-7c4ee02da213 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:54:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-73e5b8b3-fd25-4a14-98a2-aa435c7b00fa tempest-CreateVolumesFromSnapshotTest-1608055624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-73e5b8b3-fd25-4a14-98a2-aa435c7b00fa tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:11 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-73e5b8b3-fd25-4a14-98a2-aa435c7b00fa tempest-CreateVolumesFromSnapshotTest-1608055624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:11 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-73e5b8b3-fd25-4a14-98a2-aa435c7b00fa tempest-CreateVolumesFromSnapshotTest-1608055624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-73e5b8b3-fd25-4a14-98a2-aa435c7b00fa tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:11 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-73e5b8b3-fd25-4a14-98a2-aa435c7b00fa tempest-CreateVolumesFromSnapshotTest-1608055624 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:54:11 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-73e5b8b3-fd25-4a14-98a2-aa435c7b00fa tempest-CreateVolumesFromSnapshotTest-1608055624 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:54:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-73e5b8b3-fd25-4a14-98a2-aa435c7b00fa tempest-CreateVolumesFromSnapshotTest-1608055624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:11 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2a355ed5-f03f-4bc9-a9c1-cb6584f4cf4d tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8041b8a5-d0df-4400-b988-c21bfd9b166c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4807645b-747c-40ad-907d-ca65149adcdb', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:11 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2a355ed5-f03f-4bc9-a9c1-cb6584f4cf4d tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b242802-c218-4566-9756-4cc87d037625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:11 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213 1073741824 Jul 28 10:54:11 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:11 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-2a355ed5-f03f-4bc9-a9c1-cb6584f4cf4d tempest-CreateVolumesFromImageTest-411654455 None] Volume volume-4807645b-747c-40ad-907d-ca65149adcdb (4807645b-747c-40ad-907d-ca65149adcdb): created successfully Jul 28 10:54:11 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2a355ed5-f03f-4bc9-a9c1-cb6584f4cf4d tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b242802-c218-4566-9756-4cc87d037625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:11 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-2a355ed5-f03f-4bc9-a9c1-cb6584f4cf4d tempest-CreateVolumesFromImageTest-411654455 None] Flow 'volume_create_manager' (6f5486e1-9238-49ce-a970-4f05a2552a9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:11 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-2a355ed5-f03f-4bc9-a9c1-cb6584f4cf4d tempest-CreateVolumesFromImageTest-411654455 None] Created volume successfully. Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-96a1dd69-6a8a-4c92-823d-99486fdc16ed tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-96a1dd69-6a8a-4c92-823d-99486fdc16ed tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Flow 'volume_create_manager' (4e886ead-8cfe-4bfd-bdc5-57d5b5b8efb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-96a1dd69-6a8a-4c92-823d-99486fdc16ed tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (419c092c-e707-4e95-8bb6-93b8ca1f12dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-96a1dd69-6a8a-4c92-823d-99486fdc16ed tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (419c092c-e707-4e95-8bb6-93b8ca1f12dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1005184665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb44e871-c899-4e07-a6e4-4405795f7bcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4d103646faa484ebc45312e15c257f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:12Z,use_quota=True,user_id='ea8c813a083c4a98bed9b6738efe9609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-96a1dd69-6a8a-4c92-823d-99486fdc16ed tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68c88e05-3a9c-49b7-a8d8-b8b5e643b06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-96a1dd69-6a8a-4c92-823d-99486fdc16ed tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68c88e05-3a9c-49b7-a8d8-b8b5e643b06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-96a1dd69-6a8a-4c92-823d-99486fdc16ed tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f9cfe4d-62fb-44fb-92b6-6564e490b752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-96a1dd69-6a8a-4c92-823d-99486fdc16ed tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f9cfe4d-62fb-44fb-92b6-6564e490b752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb44e871-c899-4e07-a6e4-4405795f7bcd', 'volume_name': 'volume-bb44e871-c899-4e07-a6e4-4405795f7bcd', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-96a1dd69-6a8a-4c92-823d-99486fdc16ed tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c919f5dd-4632-4364-b25e-289d64785dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-96a1dd69-6a8a-4c92-823d-99486fdc16ed tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c919f5dd-4632-4364-b25e-289d64785dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-96a1dd69-6a8a-4c92-823d-99486fdc16ed tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7abaaea6-42b9-4ed7-88d6-dc36fd274f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:12 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-96a1dd69-6a8a-4c92-823d-99486fdc16ed tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Volume bb44e871-c899-4e07-a6e4-4405795f7bcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb44e871-c899-4e07-a6e4-4405795f7bcd', 'volume_size': 1} Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-96a1dd69-6a8a-4c92-823d-99486fdc16ed tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:12 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-73e5b8b3-fd25-4a14-98a2-aa435c7b00fa tempest-CreateVolumesFromSnapshotTest-1608055624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213 1073741824" returned: 0 in 0.615s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-73e5b8b3-fd25-4a14-98a2-aa435c7b00fa tempest-CreateVolumesFromSnapshotTest-1608055624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:12 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213 Jul 28 10:54:12 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcde8df5-0b6e-4085-a6ff-663c27849270 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fcde8df5-0b6e-4085-a6ff-663c27849270 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Flow 'volume_create_manager' (ce616f76-4259-47a3-b0aa-dee9595635d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fcde8df5-0b6e-4085-a6ff-663c27849270 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (045560b2-b5f5-4d87-b5db-15de3e356a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fcde8df5-0b6e-4085-a6ff-663c27849270 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (045560b2-b5f5-4d87-b5db-15de3e356a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1468703109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e9c8abf-8bfd-496b-a0f1-1cff7a4b140b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4d103646faa484ebc45312e15c257f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:12Z,use_quota=True,user_id='ea8c813a083c4a98bed9b6738efe9609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fcde8df5-0b6e-4085-a6ff-663c27849270 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da439dfb-aeb9-42bf-9e08-30e8f809e6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fcde8df5-0b6e-4085-a6ff-663c27849270 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da439dfb-aeb9-42bf-9e08-30e8f809e6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fcde8df5-0b6e-4085-a6ff-663c27849270 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e83cc6f-d86f-451f-bdcc-c8736b8cbdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fcde8df5-0b6e-4085-a6ff-663c27849270 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e83cc6f-d86f-451f-bdcc-c8736b8cbdf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e9c8abf-8bfd-496b-a0f1-1cff7a4b140b', 'volume_name': 'volume-5e9c8abf-8bfd-496b-a0f1-1cff7a4b140b', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fcde8df5-0b6e-4085-a6ff-663c27849270 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3791d2c-f9f5-47c6-9ee2-f19ede316066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fcde8df5-0b6e-4085-a6ff-663c27849270 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3791d2c-f9f5-47c6-9ee2-f19ede316066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fcde8df5-0b6e-4085-a6ff-663c27849270 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e168f237-43ec-4dd3-8856-c5db9164bd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:12 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-fcde8df5-0b6e-4085-a6ff-663c27849270 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Volume 5e9c8abf-8bfd-496b-a0f1-1cff7a4b140b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e9c8abf-8bfd-496b-a0f1-1cff7a4b140b', 'volume_size': 1} Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fcde8df5-0b6e-4085-a6ff-663c27849270 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:12 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-73e5b8b3-fd25-4a14-98a2-aa435c7b00fa tempest-CreateVolumesFromSnapshotTest-1608055624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213" returned: 0 in 0.368s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-73e5b8b3-fd25-4a14-98a2-aa435c7b00fa tempest-CreateVolumesFromSnapshotTest-1608055624 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-73e5b8b3-fd25-4a14-98a2-aa435c7b00fa tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b3c93d2f-b1ba-4239-989c-628c067f31c1 tempest-CreateVolumesFromImageTest-411654455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.234s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b3c93d2f-b1ba-4239-989c-628c067f31c1 tempest-CreateVolumesFromImageTest-411654455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-528951213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c88d6afb-472e-4fa3-ba6c-ed579c065445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21168c2f5773492d852a63e247ed896a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:10Z,use_quota=True,user_id='e37c953c757d4af78eef4d4521fbb5ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-b3c93d2f-b1ba-4239-989c-628c067f31c1 tempest-CreateVolumesFromImageTest-411654455 None] Creating volume c88d6afb-472e-4fa3-ba6c-ed579c065445 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b3c93d2f-b1ba-4239-989c-628c067f31c1 tempest-CreateVolumesFromImageTest-411654455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b3c93d2f-b1ba-4239-989c-628c067f31c1 tempest-CreateVolumesFromImageTest-411654455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b3c93d2f-b1ba-4239-989c-628c067f31c1 tempest-CreateVolumesFromImageTest-411654455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b3c93d2f-b1ba-4239-989c-628c067f31c1 tempest-CreateVolumesFromImageTest-411654455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b3c93d2f-b1ba-4239-989c-628c067f31c1 tempest-CreateVolumesFromImageTest-411654455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b3c93d2f-b1ba-4239-989c-628c067f31c1 tempest-CreateVolumesFromImageTest-411654455 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:54:12 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-b3c93d2f-b1ba-4239-989c-628c067f31c1 tempest-CreateVolumesFromImageTest-411654455 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b3c93d2f-b1ba-4239-989c-628c067f31c1 tempest-CreateVolumesFromImageTest-411654455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c88d6afb-472e-4fa3-ba6c-ed579c065445 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:12 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c88d6afb-472e-4fa3-ba6c-ed579c065445 1073741824 Jul 28 10:54:12 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-73e5b8b3-fd25-4a14-98a2-aa435c7b00fa tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3181f8ba-251f-47c8-a5ae-e821a30885fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e203f27c-6e03-4139-afa9-7c4ee02da213', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-73e5b8b3-fd25-4a14-98a2-aa435c7b00fa tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5c82f26-3450-4577-a1fd-6f716e8343e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:12 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-73e5b8b3-fd25-4a14-98a2-aa435c7b00fa tempest-CreateVolumesFromSnapshotTest-1608055624 None] Volume volume-e203f27c-6e03-4139-afa9-7c4ee02da213 (e203f27c-6e03-4139-afa9-7c4ee02da213): created successfully Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-73e5b8b3-fd25-4a14-98a2-aa435c7b00fa tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5c82f26-3450-4577-a1fd-6f716e8343e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:12 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-73e5b8b3-fd25-4a14-98a2-aa435c7b00fa tempest-CreateVolumesFromSnapshotTest-1608055624 None] Flow 'volume_create_manager' (a7835895-a43b-467b-965d-47da14020890) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:12 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-73e5b8b3-fd25-4a14-98a2-aa435c7b00fa tempest-CreateVolumesFromSnapshotTest-1608055624 None] Created volume successfully. Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-86c18eb8-9125-403f-b4dd-ff1adcbe574b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-86c18eb8-9125-403f-b4dd-ff1adcbe574b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Flow 'volume_create_manager' (c62bef85-f064-4504-acc8-7f2774ee1fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-86c18eb8-9125-403f-b4dd-ff1adcbe574b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cdbc373-ba10-4275-ab66-10a29e2d04fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-86c18eb8-9125-403f-b4dd-ff1adcbe574b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cdbc373-ba10-4275-ab66-10a29e2d04fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1222910104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42467876-2a4e-47b6-9b13-ed0eaee46db3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4d103646faa484ebc45312e15c257f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:13Z,use_quota=True,user_id='ea8c813a083c4a98bed9b6738efe9609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-86c18eb8-9125-403f-b4dd-ff1adcbe574b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04466d6e-5452-44fd-a589-269c301f06dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-86c18eb8-9125-403f-b4dd-ff1adcbe574b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04466d6e-5452-44fd-a589-269c301f06dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-86c18eb8-9125-403f-b4dd-ff1adcbe574b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ba4cd6f-716a-4dcd-bff6-0eff2b430cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-86c18eb8-9125-403f-b4dd-ff1adcbe574b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ba4cd6f-716a-4dcd-bff6-0eff2b430cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42467876-2a4e-47b6-9b13-ed0eaee46db3', 'volume_name': 'volume-42467876-2a4e-47b6-9b13-ed0eaee46db3', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-86c18eb8-9125-403f-b4dd-ff1adcbe574b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3ac4ff-52a4-4cc6-a88e-a15732b5e569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-86c18eb8-9125-403f-b4dd-ff1adcbe574b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3ac4ff-52a4-4cc6-a88e-a15732b5e569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-86c18eb8-9125-403f-b4dd-ff1adcbe574b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f3b7b29-cbf7-4f93-b28b-7eed079e888f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:13 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-86c18eb8-9125-403f-b4dd-ff1adcbe574b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Volume 42467876-2a4e-47b6-9b13-ed0eaee46db3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42467876-2a4e-47b6-9b13-ed0eaee46db3', 'volume_size': 1} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-86c18eb8-9125-403f-b4dd-ff1adcbe574b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee50e36a-a709-4f8c-85ef-eef69c0bb999 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ee50e36a-a709-4f8c-85ef-eef69c0bb999 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Flow 'volume_create_manager' (e2db07ae-3db6-4184-9a8e-761c6f6f9076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ee50e36a-a709-4f8c-85ef-eef69c0bb999 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb594ae-807b-4d36-b336-6c187ceb79cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ee50e36a-a709-4f8c-85ef-eef69c0bb999 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb594ae-807b-4d36-b336-6c187ceb79cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1610759032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10351eba-31dd-434a-bbfe-6e9bef70878a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4d103646faa484ebc45312e15c257f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:13Z,use_quota=True,user_id='ea8c813a083c4a98bed9b6738efe9609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ee50e36a-a709-4f8c-85ef-eef69c0bb999 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (468625b0-91f6-4f4f-8db4-6bfa099857b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ee50e36a-a709-4f8c-85ef-eef69c0bb999 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (468625b0-91f6-4f4f-8db4-6bfa099857b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ee50e36a-a709-4f8c-85ef-eef69c0bb999 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd4be557-f357-4468-b936-0cffa3c5418c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ee50e36a-a709-4f8c-85ef-eef69c0bb999 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd4be557-f357-4468-b936-0cffa3c5418c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10351eba-31dd-434a-bbfe-6e9bef70878a', 'volume_name': 'volume-10351eba-31dd-434a-bbfe-6e9bef70878a', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ee50e36a-a709-4f8c-85ef-eef69c0bb999 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15326b0-a923-4d30-9f76-5ce5192d94fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ee50e36a-a709-4f8c-85ef-eef69c0bb999 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15326b0-a923-4d30-9f76-5ce5192d94fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ee50e36a-a709-4f8c-85ef-eef69c0bb999 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee45e2a5-89fb-4670-8d81-b5e80f83e21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:13 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-ee50e36a-a709-4f8c-85ef-eef69c0bb999 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Volume 10351eba-31dd-434a-bbfe-6e9bef70878a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10351eba-31dd-434a-bbfe-6e9bef70878a', 'volume_size': 1} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ee50e36a-a709-4f8c-85ef-eef69c0bb999 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:13 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b3c93d2f-b1ba-4239-989c-628c067f31c1 tempest-CreateVolumesFromImageTest-411654455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c88d6afb-472e-4fa3-ba6c-ed579c065445 1073741824" returned: 0 in 0.684s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b3c93d2f-b1ba-4239-989c-628c067f31c1 tempest-CreateVolumesFromImageTest-411654455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c88d6afb-472e-4fa3-ba6c-ed579c065445 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:13 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c88d6afb-472e-4fa3-ba6c-ed579c065445 Jul 28 10:54:13 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-87579101-e1e7-46d2-be90-279b4ceacf55 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Flow 'volume_create_manager' (156d80f5-b85e-401d-9562-96b1aa603abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7355945-bcef-499a-8755-070ccb5fe451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:13 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7355945-bcef-499a-8755-070ccb5fe451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11ec1cd8-8067-4d63-8e77-673ad56a0d91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d5a9ed8b964c7a8fb5fb12bdfd8c48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:14Z,use_quota=True,user_id='3460bf80ce304f13bf37b4abbad7b9a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20d73260-8b54-4954-aad7-faa2dcfd892d),volume_type_id=20d73260-8b54-4954-aad7-faa2dcfd892d)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d7cd8e9-fea7-4212-9cf6-e246929bdd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d7cd8e9-fea7-4212-9cf6-e246929bdd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32fd638-55d2-4384-893b-4a0e704f2bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG cinder.image.glance [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Creating Keystone auth plugin from conf {{(pid=88413) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b3c93d2f-b1ba-4239-989c-628c067f31c1 tempest-CreateVolumesFromImageTest-411654455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c88d6afb-472e-4fa3-ba6c-ed579c065445" returned: 0 in 0.298s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b3c93d2f-b1ba-4239-989c-628c067f31c1 tempest-CreateVolumesFromImageTest-411654455 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b3c93d2f-b1ba-4239-989c-628c067f31c1 tempest-CreateVolumesFromImageTest-411654455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-bbb84416-bb9c-49a7-a9d9-105661fcf89a tempest-CreateVolumesFromImageTest-411654455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.155s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-bbb84416-bb9c-49a7-a9d9-105661fcf89a tempest-CreateVolumesFromImageTest-411654455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-598036626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af080b45-b825-4e29-a380-97efa2b8b832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21168c2f5773492d852a63e247ed896a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:10Z,use_quota=True,user_id='e37c953c757d4af78eef4d4521fbb5ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-bbb84416-bb9c-49a7-a9d9-105661fcf89a tempest-CreateVolumesFromImageTest-411654455 None] Creating volume af080b45-b825-4e29-a380-97efa2b8b832 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-bbb84416-bb9c-49a7-a9d9-105661fcf89a tempest-CreateVolumesFromImageTest-411654455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-bbb84416-bb9c-49a7-a9d9-105661fcf89a tempest-CreateVolumesFromImageTest-411654455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-bbb84416-bb9c-49a7-a9d9-105661fcf89a tempest-CreateVolumesFromImageTest-411654455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-bbb84416-bb9c-49a7-a9d9-105661fcf89a tempest-CreateVolumesFromImageTest-411654455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-bbb84416-bb9c-49a7-a9d9-105661fcf89a tempest-CreateVolumesFromImageTest-411654455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-bbb84416-bb9c-49a7-a9d9-105661fcf89a tempest-CreateVolumesFromImageTest-411654455 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:54:13 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-bbb84416-bb9c-49a7-a9d9-105661fcf89a tempest-CreateVolumesFromImageTest-411654455 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bbb84416-bb9c-49a7-a9d9-105661fcf89a tempest-CreateVolumesFromImageTest-411654455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af080b45-b825-4e29-a380-97efa2b8b832 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b3c93d2f-b1ba-4239-989c-628c067f31c1 tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fca9ab3-f5a4-4dfd-8f96-e4d67bc3564a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c88d6afb-472e-4fa3-ba6c-ed579c065445', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:13 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af080b45-b825-4e29-a380-97efa2b8b832 1073741824 Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b3c93d2f-b1ba-4239-989c-628c067f31c1 tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32dfaeca-0895-445e-996d-ab43ece03af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:13 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:13 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-b3c93d2f-b1ba-4239-989c-628c067f31c1 tempest-CreateVolumesFromImageTest-411654455 None] Volume volume-c88d6afb-472e-4fa3-ba6c-ed579c065445 (c88d6afb-472e-4fa3-ba6c-ed579c065445): created successfully Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b3c93d2f-b1ba-4239-989c-628c067f31c1 tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32dfaeca-0895-445e-996d-ab43ece03af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b3c93d2f-b1ba-4239-989c-628c067f31c1 tempest-CreateVolumesFromImageTest-411654455 None] Flow 'volume_create_manager' (03d11d2b-4af4-4456-9f11-926e45be4bb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:13 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-b3c93d2f-b1ba-4239-989c-628c067f31c1 tempest-CreateVolumesFromImageTest-411654455 None] Created volume successfully. Jul 28 10:54:14 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32fd638-55d2-4384-893b-4a0e704f2bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '11ec1cd8-8067-4d63-8e77-673ad56a0d91', 'volume_name': 'volume-11ec1cd8-8067-4d63-8e77-673ad56a0d91', 'volume_size': 1, 'image_id': '4eb74110-af34-4442-917a-8c540943c044', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4eb74110-af34-4442-917a-8c540943c044', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cf6a5daed94ece64b355bd30b24d901b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '12d5a9ed8b964c7a8fb5fb12bdfd8c48', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a96c40f4b23f32d2c7b8adefb43f70708a23e2af54bcfa4a1d710bf332b7345582e2acbea08784fa8ab55bc44e57728f7ef220af90b473558456f1f5948f8d55', 'id': '4eb74110-af34-4442-917a-8c540943c044', 'created_at': datetime.datetime(2026, 7, 28, 8, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 8, 54, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4eb74110-af34-4442-917a-8c540943c044/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:14 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dddaa1b-2f30-46fd-95c5-81f4d55a3e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:14 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dddaa1b-2f30-46fd-95c5-81f4d55a3e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:14 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7fc4dfe-867f-4cfa-a504-bc87a2a48759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:14 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Volume 11ec1cd8-8067-4d63-8e77-673ad56a0d91: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-11ec1cd8-8067-4d63-8e77-673ad56a0d91', 'volume_size': 1, 'image_id': '4eb74110-af34-4442-917a-8c540943c044', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4eb74110-af34-4442-917a-8c540943c044', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cf6a5daed94ece64b355bd30b24d901b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '12d5a9ed8b964c7a8fb5fb12bdfd8c48', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a96c40f4b23f32d2c7b8adefb43f70708a23e2af54bcfa4a1d710bf332b7345582e2acbea08784fa8ab55bc44e57728f7ef220af90b473558456f1f5948f8d55', 'id': '4eb74110-af34-4442-917a-8c540943c044', 'created_at': datetime.datetime(2026, 7, 28, 8, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 8, 54, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4eb74110-af34-4442-917a-8c540943c044/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 28 10:54:14 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Trying to clone 11ec1cd8-8067-4d63-8e77-673ad56a0d91 from image 4eb74110-af34-4442-917a-8c540943c044 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4eb74110-af34-4442-917a-8c540943c044', 'metadata': {}}]). {{(pid=88413) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 28 10:54:14 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4eb74110-af34-4442-917a-8c540943c044_yt_lu88mdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88413) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 28 10:54:14 devstack cinder-volume[88413]: INFO cinder.image.image_utils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Image download 0.00 MB at 0.00 MB/s Jul 28 10:54:14 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[25163af2-30af-4756-b7ab-c3bed69cbf8b]: (4, 'raw') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4eb74110-af34-4442-917a-8c540943c044_yt_lu88mdevstack@QuobyteHD {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:14 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bbb84416-bb9c-49a7-a9d9-105661fcf89a tempest-CreateVolumesFromImageTest-411654455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af080b45-b825-4e29-a380-97efa2b8b832 1073741824" returned: 0 in 0.483s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bbb84416-bb9c-49a7-a9d9-105661fcf89a tempest-CreateVolumesFromImageTest-411654455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af080b45-b825-4e29-a380-97efa2b8b832 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:14 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4eb74110-af34-4442-917a-8c540943c044_yt_lu88mdevstack@QuobyteHD Jul 28 10:54:14 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:14 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af080b45-b825-4e29-a380-97efa2b8b832 Jul 28 10:54:14 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:14 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4eb74110-af34-4442-917a-8c540943c044_yt_lu88mdevstack@QuobyteHD" returned: 0 in 0.334s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4eb74110-af34-4442-917a-8c540943c044_yt_lu88mdevstack@QuobyteHD {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:14 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bbb84416-bb9c-49a7-a9d9-105661fcf89a tempest-CreateVolumesFromImageTest-411654455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af080b45-b825-4e29-a380-97efa2b8b832" returned: 0 in 0.270s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:14 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-bbb84416-bb9c-49a7-a9d9-105661fcf89a tempest-CreateVolumesFromImageTest-411654455 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:54:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-bbb84416-bb9c-49a7-a9d9-105661fcf89a tempest-CreateVolumesFromImageTest-411654455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-060a9a0e-7653-40b8-b4ce-dc5622fe46de tempest-CreateVolumesFromImageTest-411654455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.868s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:14 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-060a9a0e-7653-40b8-b4ce-dc5622fe46de tempest-CreateVolumesFromImageTest-411654455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2035719336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ce4e4db-09bf-4aa6-8a64-bbccee063d33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21168c2f5773492d852a63e247ed896a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:11Z,use_quota=True,user_id='e37c953c757d4af78eef4d4521fbb5ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:54:14 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-060a9a0e-7653-40b8-b4ce-dc5622fe46de tempest-CreateVolumesFromImageTest-411654455 None] Creating volume 6ce4e4db-09bf-4aa6-8a64-bbccee063d33 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:54:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-060a9a0e-7653-40b8-b4ce-dc5622fe46de tempest-CreateVolumesFromImageTest-411654455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-060a9a0e-7653-40b8-b4ce-dc5622fe46de tempest-CreateVolumesFromImageTest-411654455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:14 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-060a9a0e-7653-40b8-b4ce-dc5622fe46de tempest-CreateVolumesFromImageTest-411654455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:14 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-060a9a0e-7653-40b8-b4ce-dc5622fe46de tempest-CreateVolumesFromImageTest-411654455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-060a9a0e-7653-40b8-b4ce-dc5622fe46de tempest-CreateVolumesFromImageTest-411654455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:14 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-060a9a0e-7653-40b8-b4ce-dc5622fe46de tempest-CreateVolumesFromImageTest-411654455 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:54:14 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-060a9a0e-7653-40b8-b4ce-dc5622fe46de tempest-CreateVolumesFromImageTest-411654455 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:54:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-060a9a0e-7653-40b8-b4ce-dc5622fe46de tempest-CreateVolumesFromImageTest-411654455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6ce4e4db-09bf-4aa6-8a64-bbccee063d33 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:14 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6ce4e4db-09bf-4aa6-8a64-bbccee063d33 1073741824 Jul 28 10:54:14 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bbb84416-bb9c-49a7-a9d9-105661fcf89a tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45080566-f54f-444c-b976-e444fedb0e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af080b45-b825-4e29-a380-97efa2b8b832', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:14 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:14 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bbb84416-bb9c-49a7-a9d9-105661fcf89a tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dec303a-6f30-42df-b92f-ef16556e428a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:14 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-bbb84416-bb9c-49a7-a9d9-105661fcf89a tempest-CreateVolumesFromImageTest-411654455 None] Volume volume-af080b45-b825-4e29-a380-97efa2b8b832 (af080b45-b825-4e29-a380-97efa2b8b832): created successfully Jul 28 10:54:14 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bbb84416-bb9c-49a7-a9d9-105661fcf89a tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dec303a-6f30-42df-b92f-ef16556e428a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:14 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-bbb84416-bb9c-49a7-a9d9-105661fcf89a tempest-CreateVolumesFromImageTest-411654455 None] Flow 'volume_create_manager' (7072ead6-414e-4e3a-9bda-41868372d53b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:14 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-bbb84416-bb9c-49a7-a9d9-105661fcf89a tempest-CreateVolumesFromImageTest-411654455 None] Created volume successfully. Jul 28 10:54:14 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4eb74110-af34-4442-917a-8c540943c044_yt_lu88mdevstack@QuobyteHD Jul 28 10:54:14 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:14 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4eb74110-af34-4442-917a-8c540943c044_yt_lu88mdevstack@QuobyteHD" returned: 1 in 0.333s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4eb74110-af34-4442-917a-8c540943c044_yt_lu88mdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 10:54:15 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Temporary image 4eb74110-af34-4442-917a-8c540943c044 is fetched for user 3460bf80ce304f13bf37b4abbad7b9a0. {{(pid=88413) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 28 10:54:15 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[f852b68f-c96e-4a1e-ad43-87b9c85e33a1]: (4, 'raw') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4eb74110-af34-4442-917a-8c540943c044_yt_lu88mdevstack@QuobyteHD {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:15 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-060a9a0e-7653-40b8-b4ce-dc5622fe46de tempest-CreateVolumesFromImageTest-411654455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6ce4e4db-09bf-4aa6-8a64-bbccee063d33 1073741824" returned: 0 in 0.484s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:15 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4eb74110-af34-4442-917a-8c540943c044_yt_lu88mdevstack@QuobyteHD Jul 28 10:54:15 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-060a9a0e-7653-40b8-b4ce-dc5622fe46de tempest-CreateVolumesFromImageTest-411654455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6ce4e4db-09bf-4aa6-8a64-bbccee063d33 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:15 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6ce4e4db-09bf-4aa6-8a64-bbccee063d33 Jul 28 10:54:15 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:15 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4eb74110-af34-4442-917a-8c540943c044_yt_lu88mdevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4eb74110-af34-4442-917a-8c540943c044_yt_lu88mdevstack@QuobyteHD {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:15 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-060a9a0e-7653-40b8-b4ce-dc5622fe46de tempest-CreateVolumesFromImageTest-411654455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6ce4e4db-09bf-4aa6-8a64-bbccee063d33" returned: 0 in 0.260s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:15 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-060a9a0e-7653-40b8-b4ce-dc5622fe46de tempest-CreateVolumesFromImageTest-411654455 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:54:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-060a9a0e-7653-40b8-b4ce-dc5622fe46de tempest-CreateVolumesFromImageTest-411654455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c79c3cc2-d12f-4b57-aed8-a85cb4080359 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.716s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:15 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c79c3cc2-d12f-4b57-aed8-a85cb4080359 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1469129518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=435470fe-0a56-477d-9b0a-4891ed004529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4d103646faa484ebc45312e15c257f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:12Z,use_quota=True,user_id='ea8c813a083c4a98bed9b6738efe9609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:54:15 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-c79c3cc2-d12f-4b57-aed8-a85cb4080359 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Creating volume 435470fe-0a56-477d-9b0a-4891ed004529 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:54:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c79c3cc2-d12f-4b57-aed8-a85cb4080359 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c79c3cc2-d12f-4b57-aed8-a85cb4080359 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:15 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c79c3cc2-d12f-4b57-aed8-a85cb4080359 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:15 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c79c3cc2-d12f-4b57-aed8-a85cb4080359 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c79c3cc2-d12f-4b57-aed8-a85cb4080359 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:15 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c79c3cc2-d12f-4b57-aed8-a85cb4080359 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:54:15 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-c79c3cc2-d12f-4b57-aed8-a85cb4080359 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:54:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c79c3cc2-d12f-4b57-aed8-a85cb4080359 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-435470fe-0a56-477d-9b0a-4891ed004529 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:15 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4eb74110-af34-4442-917a-8c540943c044_yt_lu88mdevstack@QuobyteHD Jul 28 10:54:15 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:15 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-060a9a0e-7653-40b8-b4ce-dc5622fe46de tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a09d2675-1707-4bd7-8e62-12c5488c9025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ce4e4db-09bf-4aa6-8a64-bbccee063d33', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:15 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-435470fe-0a56-477d-9b0a-4891ed004529 1073741824 Jul 28 10:54:15 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:15 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-060a9a0e-7653-40b8-b4ce-dc5622fe46de tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bafc424d-3941-4ccf-805d-bd6b483d7558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:15 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-060a9a0e-7653-40b8-b4ce-dc5622fe46de tempest-CreateVolumesFromImageTest-411654455 None] Volume volume-6ce4e4db-09bf-4aa6-8a64-bbccee063d33 (6ce4e4db-09bf-4aa6-8a64-bbccee063d33): created successfully Jul 28 10:54:15 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-060a9a0e-7653-40b8-b4ce-dc5622fe46de tempest-CreateVolumesFromImageTest-411654455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bafc424d-3941-4ccf-805d-bd6b483d7558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:15 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-060a9a0e-7653-40b8-b4ce-dc5622fe46de tempest-CreateVolumesFromImageTest-411654455 None] Flow 'volume_create_manager' (23835f33-e285-4115-b0b8-b1321cd3ad6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:15 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-060a9a0e-7653-40b8-b4ce-dc5622fe46de tempest-CreateVolumesFromImageTest-411654455 None] Created volume successfully. Jul 28 10:54:15 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4eb74110-af34-4442-917a-8c540943c044_yt_lu88mdevstack@QuobyteHD" returned: 1 in 0.330s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4eb74110-af34-4442-917a-8c540943c044_yt_lu88mdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 10:54:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:15 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c79c3cc2-d12f-4b57-aed8-a85cb4080359 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-435470fe-0a56-477d-9b0a-4891ed004529 1073741824" returned: 0 in 0.438s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c79c3cc2-d12f-4b57-aed8-a85cb4080359 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-435470fe-0a56-477d-9b0a-4891ed004529 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:15 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-435470fe-0a56-477d-9b0a-4891ed004529 Jul 28 10:54:15 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:16 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c79c3cc2-d12f-4b57-aed8-a85cb4080359 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-435470fe-0a56-477d-9b0a-4891ed004529" returned: 0 in 0.242s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:16 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c79c3cc2-d12f-4b57-aed8-a85cb4080359 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:54:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c79c3cc2-d12f-4b57-aed8-a85cb4080359 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-96a1dd69-6a8a-4c92-823d-99486fdc16ed tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.066s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:16 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-96a1dd69-6a8a-4c92-823d-99486fdc16ed tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1005184665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb44e871-c899-4e07-a6e4-4405795f7bcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4d103646faa484ebc45312e15c257f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:12Z,use_quota=True,user_id='ea8c813a083c4a98bed9b6738efe9609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:54:16 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-96a1dd69-6a8a-4c92-823d-99486fdc16ed tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Creating volume bb44e871-c899-4e07-a6e4-4405795f7bcd {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:54:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-96a1dd69-6a8a-4c92-823d-99486fdc16ed tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-96a1dd69-6a8a-4c92-823d-99486fdc16ed tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:16 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-96a1dd69-6a8a-4c92-823d-99486fdc16ed tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:16 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-96a1dd69-6a8a-4c92-823d-99486fdc16ed tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-96a1dd69-6a8a-4c92-823d-99486fdc16ed tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:16 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-96a1dd69-6a8a-4c92-823d-99486fdc16ed tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:54:16 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-96a1dd69-6a8a-4c92-823d-99486fdc16ed tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:54:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-96a1dd69-6a8a-4c92-823d-99486fdc16ed tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-bb44e871-c899-4e07-a6e4-4405795f7bcd 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:16 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c79c3cc2-d12f-4b57-aed8-a85cb4080359 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5225f05-68ab-4c6c-93eb-4c5e5a02b181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-435470fe-0a56-477d-9b0a-4891ed004529', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:16 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c79c3cc2-d12f-4b57-aed8-a85cb4080359 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83fae5a3-c10d-49a6-b133-8a34a74a0458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:16 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-bb44e871-c899-4e07-a6e4-4405795f7bcd 1073741824 Jul 28 10:54:16 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:16 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-c79c3cc2-d12f-4b57-aed8-a85cb4080359 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Volume volume-435470fe-0a56-477d-9b0a-4891ed004529 (435470fe-0a56-477d-9b0a-4891ed004529): created successfully Jul 28 10:54:16 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c79c3cc2-d12f-4b57-aed8-a85cb4080359 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83fae5a3-c10d-49a6-b133-8a34a74a0458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:16 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c79c3cc2-d12f-4b57-aed8-a85cb4080359 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Flow 'volume_create_manager' (24257924-913c-45e5-869d-6a0ed2fca013) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:16 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-c79c3cc2-d12f-4b57-aed8-a85cb4080359 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Created volume successfully. Jul 28 10:54:16 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0810efbf-e5ab-4124-848c-d0702a2fd7fd tempest-CreateVolumesFromImageTest-411654455 None] Acquiring lock "cinder-6ce4e4db-09bf-4aa6-8a64-bbccee063d33-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:16 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0810efbf-e5ab-4124-848c-d0702a2fd7fd tempest-CreateVolumesFromImageTest-411654455 None] Lock "cinder-6ce4e4db-09bf-4aa6-8a64-bbccee063d33-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:16 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0810efbf-e5ab-4124-848c-d0702a2fd7fd tempest-CreateVolumesFromImageTest-411654455 None] Acquiring lock "cinder-quobyte-6ce4e4db-09bf-4aa6-8a64-bbccee063d33" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:16 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0810efbf-e5ab-4124-848c-d0702a2fd7fd tempest-CreateVolumesFromImageTest-411654455 None] Lock "cinder-quobyte-6ce4e4db-09bf-4aa6-8a64-bbccee063d33" acquired by "delete_volume" :: waited 0.014s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:16 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15dcf65-0a49-4989-bcf5-5623c12ea511]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0810efbf-e5ab-4124-848c-d0702a2fd7fd tempest-CreateVolumesFromImageTest-411654455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6ce4e4db-09bf-4aa6-8a64-bbccee063d33 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:16 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6ce4e4db-09bf-4aa6-8a64-bbccee063d33 Jul 28 10:54:16 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:16 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-96a1dd69-6a8a-4c92-823d-99486fdc16ed tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-bb44e871-c899-4e07-a6e4-4405795f7bcd 1073741824" returned: 0 in 0.483s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-96a1dd69-6a8a-4c92-823d-99486fdc16ed tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-bb44e871-c899-4e07-a6e4-4405795f7bcd {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:16 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-bb44e871-c899-4e07-a6e4-4405795f7bcd Jul 28 10:54:16 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:16 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0810efbf-e5ab-4124-848c-d0702a2fd7fd tempest-CreateVolumesFromImageTest-411654455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6ce4e4db-09bf-4aa6-8a64-bbccee063d33" returned: 0 in 0.394s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0810efbf-e5ab-4124-848c-d0702a2fd7fd tempest-CreateVolumesFromImageTest-411654455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6ce4e4db-09bf-4aa6-8a64-bbccee063d33 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:16 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6ce4e4db-09bf-4aa6-8a64-bbccee063d33 Jul 28 10:54:16 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:16 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-96a1dd69-6a8a-4c92-823d-99486fdc16ed tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-bb44e871-c899-4e07-a6e4-4405795f7bcd" returned: 0 in 0.239s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-96a1dd69-6a8a-4c92-823d-99486fdc16ed tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-96a1dd69-6a8a-4c92-823d-99486fdc16ed tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fcde8df5-0b6e-4085-a6ff-663c27849270 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.182s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-fcde8df5-0b6e-4085-a6ff-663c27849270 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1468703109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e9c8abf-8bfd-496b-a0f1-1cff7a4b140b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4d103646faa484ebc45312e15c257f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:12Z,use_quota=True,user_id='ea8c813a083c4a98bed9b6738efe9609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-fcde8df5-0b6e-4085-a6ff-663c27849270 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Creating volume 5e9c8abf-8bfd-496b-a0f1-1cff7a4b140b {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fcde8df5-0b6e-4085-a6ff-663c27849270 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fcde8df5-0b6e-4085-a6ff-663c27849270 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-fcde8df5-0b6e-4085-a6ff-663c27849270 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-fcde8df5-0b6e-4085-a6ff-663c27849270 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fcde8df5-0b6e-4085-a6ff-663c27849270 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-fcde8df5-0b6e-4085-a6ff-663c27849270 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:54:17 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-fcde8df5-0b6e-4085-a6ff-663c27849270 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fcde8df5-0b6e-4085-a6ff-663c27849270 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5e9c8abf-8bfd-496b-a0f1-1cff7a4b140b 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-96a1dd69-6a8a-4c92-823d-99486fdc16ed tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7abaaea6-42b9-4ed7-88d6-dc36fd274f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb44e871-c899-4e07-a6e4-4405795f7bcd', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:17 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5e9c8abf-8bfd-496b-a0f1-1cff7a4b140b 1073741824 Jul 28 10:54:17 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-96a1dd69-6a8a-4c92-823d-99486fdc16ed tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b88322-2467-4bf6-bdc1-97a56b80cfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:17 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-96a1dd69-6a8a-4c92-823d-99486fdc16ed tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Volume volume-bb44e871-c899-4e07-a6e4-4405795f7bcd (bb44e871-c899-4e07-a6e4-4405795f7bcd): created successfully Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-96a1dd69-6a8a-4c92-823d-99486fdc16ed tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b88322-2467-4bf6-bdc1-97a56b80cfef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-96a1dd69-6a8a-4c92-823d-99486fdc16ed tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Flow 'volume_create_manager' (4e886ead-8cfe-4bfd-bdc5-57d5b5b8efb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:17 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-96a1dd69-6a8a-4c92-823d-99486fdc16ed tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Created volume successfully. Jul 28 10:54:17 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0810efbf-e5ab-4124-848c-d0702a2fd7fd tempest-CreateVolumesFromImageTest-411654455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-6ce4e4db-09bf-4aa6-8a64-bbccee063d33" returned: 0 in 0.265s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0810efbf-e5ab-4124-848c-d0702a2fd7fd tempest-CreateVolumesFromImageTest-411654455 None] Lock "cinder-quobyte-6ce4e4db-09bf-4aa6-8a64-bbccee063d33" released by "delete_volume" :: held 0.717s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-0810efbf-e5ab-4124-848c-d0702a2fd7fd tempest-CreateVolumesFromImageTest-411654455 None] Created reservations ['1de1b863-b24b-4693-ac1b-19ae85e46c7f', '600398f8-dfb5-44b1-8dae-9f0e80798752', 'ea0cf184-e111-4f43-9356-14e03ec50803', '3ffa9802-1805-4921-8927-c56a8a8d3245'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0810efbf-e5ab-4124-848c-d0702a2fd7fd tempest-CreateVolumesFromImageTest-411654455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0810efbf-e5ab-4124-848c-d0702a2fd7fd tempest-CreateVolumesFromImageTest-411654455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0810efbf-e5ab-4124-848c-d0702a2fd7fd tempest-CreateVolumesFromImageTest-411654455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0810efbf-e5ab-4124-848c-d0702a2fd7fd tempest-CreateVolumesFromImageTest-411654455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0810efbf-e5ab-4124-848c-d0702a2fd7fd tempest-CreateVolumesFromImageTest-411654455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0810efbf-e5ab-4124-848c-d0702a2fd7fd tempest-CreateVolumesFromImageTest-411654455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:17 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:54:17 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:17 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fcde8df5-0b6e-4085-a6ff-663c27849270 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5e9c8abf-8bfd-496b-a0f1-1cff7a4b140b 1073741824" returned: 0 in 0.456s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:17 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-961e89f2-4af9-4fe7-98e4-b632595d23b8 tempest-CreateVolumesFromImageTest-411654455 None] Acquiring lock "cinder-af080b45-b825-4e29-a380-97efa2b8b832-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0810efbf-e5ab-4124-848c-d0702a2fd7fd tempest-CreateVolumesFromImageTest-411654455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.281s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-0810efbf-e5ab-4124-848c-d0702a2fd7fd tempest-CreateVolumesFromImageTest-411654455 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:54:17 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-0810efbf-e5ab-4124-848c-d0702a2fd7fd tempest-CreateVolumesFromImageTest-411654455 None] Deleted volume successfully. Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-961e89f2-4af9-4fe7-98e4-b632595d23b8 tempest-CreateVolumesFromImageTest-411654455 None] Lock "cinder-af080b45-b825-4e29-a380-97efa2b8b832-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fcde8df5-0b6e-4085-a6ff-663c27849270 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5e9c8abf-8bfd-496b-a0f1-1cff7a4b140b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0810efbf-e5ab-4124-848c-d0702a2fd7fd tempest-CreateVolumesFromImageTest-411654455 None] Lock "cinder-6ce4e4db-09bf-4aa6-8a64-bbccee063d33-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:17 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5e9c8abf-8bfd-496b-a0f1-1cff7a4b140b Jul 28 10:54:17 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-961e89f2-4af9-4fe7-98e4-b632595d23b8 tempest-CreateVolumesFromImageTest-411654455 None] Acquiring lock "cinder-quobyte-af080b45-b825-4e29-a380-97efa2b8b832" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-961e89f2-4af9-4fe7-98e4-b632595d23b8 tempest-CreateVolumesFromImageTest-411654455 None] Lock "cinder-quobyte-af080b45-b825-4e29-a380-97efa2b8b832" acquired by "delete_volume" :: waited 0.020s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[4825e1fa-1a19-425e-ade3-67359bab7bd5]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-961e89f2-4af9-4fe7-98e4-b632595d23b8 tempest-CreateVolumesFromImageTest-411654455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af080b45-b825-4e29-a380-97efa2b8b832 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:17 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af080b45-b825-4e29-a380-97efa2b8b832 Jul 28 10:54:17 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:17 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fcde8df5-0b6e-4085-a6ff-663c27849270 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5e9c8abf-8bfd-496b-a0f1-1cff7a4b140b" returned: 0 in 0.301s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-fcde8df5-0b6e-4085-a6ff-663c27849270 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fcde8df5-0b6e-4085-a6ff-663c27849270 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-86c18eb8-9125-403f-b4dd-ff1adcbe574b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.718s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-86c18eb8-9125-403f-b4dd-ff1adcbe574b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1222910104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42467876-2a4e-47b6-9b13-ed0eaee46db3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4d103646faa484ebc45312e15c257f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:13Z,use_quota=True,user_id='ea8c813a083c4a98bed9b6738efe9609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-86c18eb8-9125-403f-b4dd-ff1adcbe574b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Creating volume 42467876-2a4e-47b6-9b13-ed0eaee46db3 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-86c18eb8-9125-403f-b4dd-ff1adcbe574b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-86c18eb8-9125-403f-b4dd-ff1adcbe574b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-86c18eb8-9125-403f-b4dd-ff1adcbe574b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-86c18eb8-9125-403f-b4dd-ff1adcbe574b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-86c18eb8-9125-403f-b4dd-ff1adcbe574b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-86c18eb8-9125-403f-b4dd-ff1adcbe574b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:54:17 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-86c18eb8-9125-403f-b4dd-ff1adcbe574b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-86c18eb8-9125-403f-b4dd-ff1adcbe574b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-42467876-2a4e-47b6-9b13-ed0eaee46db3 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fcde8df5-0b6e-4085-a6ff-663c27849270 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e168f237-43ec-4dd3-8856-c5db9164bd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e9c8abf-8bfd-496b-a0f1-1cff7a4b140b', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:17 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-42467876-2a4e-47b6-9b13-ed0eaee46db3 1073741824 Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fcde8df5-0b6e-4085-a6ff-663c27849270 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b4b218d-62af-4480-a79a-adbe61871b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:17 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:17 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-fcde8df5-0b6e-4085-a6ff-663c27849270 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Volume volume-5e9c8abf-8bfd-496b-a0f1-1cff7a4b140b (5e9c8abf-8bfd-496b-a0f1-1cff7a4b140b): created successfully Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fcde8df5-0b6e-4085-a6ff-663c27849270 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b4b218d-62af-4480-a79a-adbe61871b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:17 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-fcde8df5-0b6e-4085-a6ff-663c27849270 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Flow 'volume_create_manager' (ce616f76-4259-47a3-b0aa-dee9595635d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:17 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-fcde8df5-0b6e-4085-a6ff-663c27849270 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Created volume successfully. Jul 28 10:54:18 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-961e89f2-4af9-4fe7-98e4-b632595d23b8 tempest-CreateVolumesFromImageTest-411654455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af080b45-b825-4e29-a380-97efa2b8b832" returned: 0 in 0.402s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-961e89f2-4af9-4fe7-98e4-b632595d23b8 tempest-CreateVolumesFromImageTest-411654455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af080b45-b825-4e29-a380-97efa2b8b832 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:18 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af080b45-b825-4e29-a380-97efa2b8b832 Jul 28 10:54:18 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:18 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-86c18eb8-9125-403f-b4dd-ff1adcbe574b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-42467876-2a4e-47b6-9b13-ed0eaee46db3 1073741824" returned: 0 in 0.426s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:18 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-961e89f2-4af9-4fe7-98e4-b632595d23b8 tempest-CreateVolumesFromImageTest-411654455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af080b45-b825-4e29-a380-97efa2b8b832" returned: 0 in 0.256s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:18 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-961e89f2-4af9-4fe7-98e4-b632595d23b8 tempest-CreateVolumesFromImageTest-411654455 None] Lock "cinder-quobyte-af080b45-b825-4e29-a380-97efa2b8b832" released by "delete_volume" :: held 0.703s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-86c18eb8-9125-403f-b4dd-ff1adcbe574b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-42467876-2a4e-47b6-9b13-ed0eaee46db3 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:18 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-42467876-2a4e-47b6-9b13-ed0eaee46db3 Jul 28 10:54:18 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:18 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-961e89f2-4af9-4fe7-98e4-b632595d23b8 tempest-CreateVolumesFromImageTest-411654455 None] Created reservations ['8cd0f81a-822a-436b-a3f1-1b593a316e61', '37727258-ce8d-4630-9e0e-bfa21bf070ee', 'c6c231d1-3f95-4ab8-845a-e0a8d58ffeab', 'cb70e382-3a25-4a9f-839d-a98a55e5a86d'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:54:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-961e89f2-4af9-4fe7-98e4-b632595d23b8 tempest-CreateVolumesFromImageTest-411654455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-961e89f2-4af9-4fe7-98e4-b632595d23b8 tempest-CreateVolumesFromImageTest-411654455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:18 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-961e89f2-4af9-4fe7-98e4-b632595d23b8 tempest-CreateVolumesFromImageTest-411654455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:18 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-961e89f2-4af9-4fe7-98e4-b632595d23b8 tempest-CreateVolumesFromImageTest-411654455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-961e89f2-4af9-4fe7-98e4-b632595d23b8 tempest-CreateVolumesFromImageTest-411654455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-961e89f2-4af9-4fe7-98e4-b632595d23b8 tempest-CreateVolumesFromImageTest-411654455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:18 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:54:18 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:18 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-86c18eb8-9125-403f-b4dd-ff1adcbe574b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-42467876-2a4e-47b6-9b13-ed0eaee46db3" returned: 0 in 0.254s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:18 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-86c18eb8-9125-403f-b4dd-ff1adcbe574b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:54:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-86c18eb8-9125-403f-b4dd-ff1adcbe574b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ee50e36a-a709-4f8c-85ef-eef69c0bb999 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.135s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:18 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-ee50e36a-a709-4f8c-85ef-eef69c0bb999 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1610759032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10351eba-31dd-434a-bbfe-6e9bef70878a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4d103646faa484ebc45312e15c257f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:13Z,use_quota=True,user_id='ea8c813a083c4a98bed9b6738efe9609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:54:18 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-ee50e36a-a709-4f8c-85ef-eef69c0bb999 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Creating volume 10351eba-31dd-434a-bbfe-6e9bef70878a {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:54:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ee50e36a-a709-4f8c-85ef-eef69c0bb999 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ee50e36a-a709-4f8c-85ef-eef69c0bb999 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:18 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-ee50e36a-a709-4f8c-85ef-eef69c0bb999 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:18 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-ee50e36a-a709-4f8c-85ef-eef69c0bb999 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ee50e36a-a709-4f8c-85ef-eef69c0bb999 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:18 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-ee50e36a-a709-4f8c-85ef-eef69c0bb999 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:54:18 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-ee50e36a-a709-4f8c-85ef-eef69c0bb999 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:54:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ee50e36a-a709-4f8c-85ef-eef69c0bb999 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-10351eba-31dd-434a-bbfe-6e9bef70878a 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:18 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-86c18eb8-9125-403f-b4dd-ff1adcbe574b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f3b7b29-cbf7-4f93-b28b-7eed079e888f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42467876-2a4e-47b6-9b13-ed0eaee46db3', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:18 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-10351eba-31dd-434a-bbfe-6e9bef70878a 1073741824 Jul 28 10:54:18 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:18 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-86c18eb8-9125-403f-b4dd-ff1adcbe574b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f8ab987-e4b8-48bd-a74f-6d85d78170bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:18 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-86c18eb8-9125-403f-b4dd-ff1adcbe574b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Volume volume-42467876-2a4e-47b6-9b13-ed0eaee46db3 (42467876-2a4e-47b6-9b13-ed0eaee46db3): created successfully Jul 28 10:54:18 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-86c18eb8-9125-403f-b4dd-ff1adcbe574b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f8ab987-e4b8-48bd-a74f-6d85d78170bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:18 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-86c18eb8-9125-403f-b4dd-ff1adcbe574b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Flow 'volume_create_manager' (c62bef85-f064-4504-acc8-7f2774ee1fcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:18 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-c349a726-7774-45d9-a7bc-f78711a40176 tempest-CreateVolumesFromImageTest-411654455 None] Acquiring lock "cinder-c88d6afb-472e-4fa3-ba6c-ed579c065445-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:18 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-86c18eb8-9125-403f-b4dd-ff1adcbe574b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Created volume successfully. Jul 28 10:54:18 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-c349a726-7774-45d9-a7bc-f78711a40176 tempest-CreateVolumesFromImageTest-411654455 None] Lock "cinder-c88d6afb-472e-4fa3-ba6c-ed579c065445-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:18 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-c349a726-7774-45d9-a7bc-f78711a40176 tempest-CreateVolumesFromImageTest-411654455 None] Acquiring lock "cinder-quobyte-c88d6afb-472e-4fa3-ba6c-ed579c065445" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:18 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-c349a726-7774-45d9-a7bc-f78711a40176 tempest-CreateVolumesFromImageTest-411654455 None] Lock "cinder-quobyte-c88d6afb-472e-4fa3-ba6c-ed579c065445" acquired by "delete_volume" :: waited 0.017s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:18 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-961e89f2-4af9-4fe7-98e4-b632595d23b8 tempest-CreateVolumesFromImageTest-411654455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.383s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:18 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-961e89f2-4af9-4fe7-98e4-b632595d23b8 tempest-CreateVolumesFromImageTest-411654455 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:54:18 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-961e89f2-4af9-4fe7-98e4-b632595d23b8 tempest-CreateVolumesFromImageTest-411654455 None] Deleted volume successfully. Jul 28 10:54:18 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2eec2a-c4cb-4fa0-b677-9605b1e6033a]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c349a726-7774-45d9-a7bc-f78711a40176 tempest-CreateVolumesFromImageTest-411654455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c88d6afb-472e-4fa3-ba6c-ed579c065445 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:18 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-961e89f2-4af9-4fe7-98e4-b632595d23b8 tempest-CreateVolumesFromImageTest-411654455 None] Lock "cinder-af080b45-b825-4e29-a380-97efa2b8b832-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:19 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c88d6afb-472e-4fa3-ba6c-ed579c065445 Jul 28 10:54:19 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:19 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ee50e36a-a709-4f8c-85ef-eef69c0bb999 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-10351eba-31dd-434a-bbfe-6e9bef70878a 1073741824" returned: 0 in 0.504s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ee50e36a-a709-4f8c-85ef-eef69c0bb999 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-10351eba-31dd-434a-bbfe-6e9bef70878a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:19 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-10351eba-31dd-434a-bbfe-6e9bef70878a Jul 28 10:54:19 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:19 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c349a726-7774-45d9-a7bc-f78711a40176 tempest-CreateVolumesFromImageTest-411654455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c88d6afb-472e-4fa3-ba6c-ed579c065445" returned: 0 in 0.377s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c349a726-7774-45d9-a7bc-f78711a40176 tempest-CreateVolumesFromImageTest-411654455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c88d6afb-472e-4fa3-ba6c-ed579c065445 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:19 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c88d6afb-472e-4fa3-ba6c-ed579c065445 Jul 28 10:54:19 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:19 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ee50e36a-a709-4f8c-85ef-eef69c0bb999 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-10351eba-31dd-434a-bbfe-6e9bef70878a" returned: 0 in 0.280s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:19 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-ee50e36a-a709-4f8c-85ef-eef69c0bb999 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:54:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ee50e36a-a709-4f8c-85ef-eef69c0bb999 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-87579101-e1e7-46d2-be90-279b4ceacf55 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.637s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ee50e36a-a709-4f8c-85ef-eef69c0bb999 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee45e2a5-89fb-4670-8d81-b5e80f83e21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10351eba-31dd-434a-bbfe-6e9bef70878a', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ee50e36a-a709-4f8c-85ef-eef69c0bb999 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23457b3d-7396-44ff-9fa2-b6763588b5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:19 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-87579101-e1e7-46d2-be90-279b4ceacf55 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Creating offline snapshot 3c32f852-bffb-4be3-8c98-023fbc751e0d of volume e203f27c-6e03-4139-afa9-7c4ee02da213 {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:54:19 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-ee50e36a-a709-4f8c-85ef-eef69c0bb999 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Volume volume-10351eba-31dd-434a-bbfe-6e9bef70878a (10351eba-31dd-434a-bbfe-6e9bef70878a): created successfully Jul 28 10:54:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ee50e36a-a709-4f8c-85ef-eef69c0bb999 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23457b3d-7396-44ff-9fa2-b6763588b5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ee50e36a-a709-4f8c-85ef-eef69c0bb999 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Flow 'volume_create_manager' (e2db07ae-3db6-4184-9a8e-761c6f6f9076) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:19 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15d3ff3-b9a1-425a-80ca-cd461a2b6056]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-87579101-e1e7-46d2-be90-279b4ceacf55 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:19 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c349a726-7774-45d9-a7bc-f78711a40176 tempest-CreateVolumesFromImageTest-411654455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c88d6afb-472e-4fa3-ba6c-ed579c065445" returned: 0 in 0.272s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:19 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-ee50e36a-a709-4f8c-85ef-eef69c0bb999 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Created volume successfully. Jul 28 10:54:19 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-c349a726-7774-45d9-a7bc-f78711a40176 tempest-CreateVolumesFromImageTest-411654455 None] Lock "cinder-quobyte-c88d6afb-472e-4fa3-ba6c-ed579c065445" released by "delete_volume" :: held 0.732s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:19 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-c349a726-7774-45d9-a7bc-f78711a40176 tempest-CreateVolumesFromImageTest-411654455 None] Created reservations ['8a32bec3-5fa1-4d56-b5e6-448a2b72568a', '9d5aed92-ad1c-457c-b177-271762d19710', '368fd6a1-9576-49cd-b992-30ef457a2529', '890abb10-f0fa-43bf-a4d9-67096e254bde'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:54:19 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213 Jul 28 10:54:19 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c349a726-7774-45d9-a7bc-f78711a40176 tempest-CreateVolumesFromImageTest-411654455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c349a726-7774-45d9-a7bc-f78711a40176 tempest-CreateVolumesFromImageTest-411654455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:19 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c349a726-7774-45d9-a7bc-f78711a40176 tempest-CreateVolumesFromImageTest-411654455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:19 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c349a726-7774-45d9-a7bc-f78711a40176 tempest-CreateVolumesFromImageTest-411654455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c349a726-7774-45d9-a7bc-f78711a40176 tempest-CreateVolumesFromImageTest-411654455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c349a726-7774-45d9-a7bc-f78711a40176 tempest-CreateVolumesFromImageTest-411654455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:19 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:54:19 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:19 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-87579101-e1e7-46d2-be90-279b4ceacf55 tempest-CreateVolumesFromSnapshotTest-1608055624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213" returned: 0 in 0.395s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-87579101-e1e7-46d2-be90-279b4ceacf55 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213.3c32f852-bffb-4be3-8c98-023fbc751e0d 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:19 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:19 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213.3c32f852-bffb-4be3-8c98-023fbc751e0d 1G Jul 28 10:54:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c349a726-7774-45d9-a7bc-f78711a40176 tempest-CreateVolumesFromImageTest-411654455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.267s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:19 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-c349a726-7774-45d9-a7bc-f78711a40176 tempest-CreateVolumesFromImageTest-411654455 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:54:19 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:19 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-c349a726-7774-45d9-a7bc-f78711a40176 tempest-CreateVolumesFromImageTest-411654455 None] Deleted volume successfully. Jul 28 10:54:19 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-c3dbc676-4a80-4aae-9c01-32c28ca0c40d tempest-CreateVolumesFromImageTest-411654455 None] Acquiring lock "cinder-4807645b-747c-40ad-907d-ca65149adcdb-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:19 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-c3dbc676-4a80-4aae-9c01-32c28ca0c40d tempest-CreateVolumesFromImageTest-411654455 None] Lock "cinder-4807645b-747c-40ad-907d-ca65149adcdb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:19 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-c349a726-7774-45d9-a7bc-f78711a40176 tempest-CreateVolumesFromImageTest-411654455 None] Lock "cinder-c88d6afb-472e-4fa3-ba6c-ed579c065445-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:20 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-c3dbc676-4a80-4aae-9c01-32c28ca0c40d tempest-CreateVolumesFromImageTest-411654455 None] Acquiring lock "cinder-quobyte-4807645b-747c-40ad-907d-ca65149adcdb" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:20 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-c3dbc676-4a80-4aae-9c01-32c28ca0c40d tempest-CreateVolumesFromImageTest-411654455 None] Lock "cinder-quobyte-4807645b-747c-40ad-907d-ca65149adcdb" acquired by "delete_volume" :: waited 0.034s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:20 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9b5483-2d92-4487-8609-a9596f489cae]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c3dbc676-4a80-4aae-9c01-32c28ca0c40d tempest-CreateVolumesFromImageTest-411654455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4807645b-747c-40ad-907d-ca65149adcdb {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:20 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-eeb01c58-acd0-4df0-8cb6-7a69119332b0 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Acquiring lock "cinder-10351eba-31dd-434a-bbfe-6e9bef70878a-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:20 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-eeb01c58-acd0-4df0-8cb6-7a69119332b0 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "cinder-10351eba-31dd-434a-bbfe-6e9bef70878a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:20 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-eeb01c58-acd0-4df0-8cb6-7a69119332b0 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Acquiring lock "cinder-quobyte-10351eba-31dd-434a-bbfe-6e9bef70878a" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:20 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-eeb01c58-acd0-4df0-8cb6-7a69119332b0 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "cinder-quobyte-10351eba-31dd-434a-bbfe-6e9bef70878a" acquired by "delete_volume" :: waited 0.018s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:20 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4807645b-747c-40ad-907d-ca65149adcdb Jul 28 10:54:20 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:20 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6cc615-2a33-4f16-86e1-ca807c2c72a1]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-eeb01c58-acd0-4df0-8cb6-7a69119332b0 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-10351eba-31dd-434a-bbfe-6e9bef70878a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:20 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-87579101-e1e7-46d2-be90-279b4ceacf55 tempest-CreateVolumesFromSnapshotTest-1608055624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213.3c32f852-bffb-4be3-8c98-023fbc751e0d 1G" returned: 0 in 0.477s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-87579101-e1e7-46d2-be90-279b4ceacf55 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e203f27c-6e03-4139-afa9-7c4ee02da213 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213.3c32f852-bffb-4be3-8c98-023fbc751e0d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:20 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-10351eba-31dd-434a-bbfe-6e9bef70878a Jul 28 10:54:20 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:20 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e203f27c-6e03-4139-afa9-7c4ee02da213 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213.3c32f852-bffb-4be3-8c98-023fbc751e0d Jul 28 10:54:20 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:20 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c3dbc676-4a80-4aae-9c01-32c28ca0c40d tempest-CreateVolumesFromImageTest-411654455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4807645b-747c-40ad-907d-ca65149adcdb" returned: 0 in 0.409s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c3dbc676-4a80-4aae-9c01-32c28ca0c40d tempest-CreateVolumesFromImageTest-411654455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4807645b-747c-40ad-907d-ca65149adcdb {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:20 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4807645b-747c-40ad-907d-ca65149adcdb Jul 28 10:54:20 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:20 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-eeb01c58-acd0-4df0-8cb6-7a69119332b0 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-10351eba-31dd-434a-bbfe-6e9bef70878a" returned: 0 in 0.385s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-eeb01c58-acd0-4df0-8cb6-7a69119332b0 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-10351eba-31dd-434a-bbfe-6e9bef70878a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:20 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-10351eba-31dd-434a-bbfe-6e9bef70878a Jul 28 10:54:20 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:20 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-87579101-e1e7-46d2-be90-279b4ceacf55 tempest-CreateVolumesFromSnapshotTest-1608055624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e203f27c-6e03-4139-afa9-7c4ee02da213 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213.3c32f852-bffb-4be3-8c98-023fbc751e0d" returned: 0 in 0.358s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:20 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-87579101-e1e7-46d2-be90-279b4ceacf55 tempest-CreateVolumesFromSnapshotTest-1608055624 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213.3c32f852-bffb-4be3-8c98-023fbc751e0d is being set with open permissions: ugo+rw Jul 28 10:54:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-87579101-e1e7-46d2-be90-279b4ceacf55 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213.3c32f852-bffb-4be3-8c98-023fbc751e0d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:20 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c3dbc676-4a80-4aae-9c01-32c28ca0c40d tempest-CreateVolumesFromImageTest-411654455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4807645b-747c-40ad-907d-ca65149adcdb" returned: 0 in 0.256s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:20 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213.3c32f852-bffb-4be3-8c98-023fbc751e0d Jul 28 10:54:20 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:20 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-c3dbc676-4a80-4aae-9c01-32c28ca0c40d tempest-CreateVolumesFromImageTest-411654455 None] Lock "cinder-quobyte-4807645b-747c-40ad-907d-ca65149adcdb" released by "delete_volume" :: held 0.720s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:20 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-c3dbc676-4a80-4aae-9c01-32c28ca0c40d tempest-CreateVolumesFromImageTest-411654455 None] Created reservations ['7d5331a9-6e6f-4576-9451-5018d17948ce', '0c23896e-8973-4ac1-9623-80973f919079', '076738b2-fccc-425c-a513-ffa0dd19efae', 'f7809707-3d40-469a-8bd5-930f3ad795ed'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:54:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c3dbc676-4a80-4aae-9c01-32c28ca0c40d tempest-CreateVolumesFromImageTest-411654455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c3dbc676-4a80-4aae-9c01-32c28ca0c40d tempest-CreateVolumesFromImageTest-411654455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:20 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c3dbc676-4a80-4aae-9c01-32c28ca0c40d tempest-CreateVolumesFromImageTest-411654455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:20 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c3dbc676-4a80-4aae-9c01-32c28ca0c40d tempest-CreateVolumesFromImageTest-411654455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c3dbc676-4a80-4aae-9c01-32c28ca0c40d tempest-CreateVolumesFromImageTest-411654455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c3dbc676-4a80-4aae-9c01-32c28ca0c40d tempest-CreateVolumesFromImageTest-411654455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:20 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-eeb01c58-acd0-4df0-8cb6-7a69119332b0 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-10351eba-31dd-434a-bbfe-6e9bef70878a" returned: 0 in 0.293s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:20 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:54:20 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:20 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-eeb01c58-acd0-4df0-8cb6-7a69119332b0 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "cinder-quobyte-10351eba-31dd-434a-bbfe-6e9bef70878a" released by "delete_volume" :: held 0.734s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:21 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-87579101-e1e7-46d2-be90-279b4ceacf55 tempest-CreateVolumesFromSnapshotTest-1608055624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213.3c32f852-bffb-4be3-8c98-023fbc751e0d" returned: 0 in 0.283s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-eeb01c58-acd0-4df0-8cb6-7a69119332b0 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Created reservations ['b2668ab4-8cb6-4ff9-90e5-380b6a6f737f', '4e95736b-9f37-40fe-b34a-0638b1cce96c', 'd0fd8296-acc5-402f-9ee0-9e28d606ea6f', '1593faf8-d049-4db0-b47d-879742dd08e9'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-87579101-e1e7-46d2-be90-279b4ceacf55 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-eeb01c58-acd0-4df0-8cb6-7a69119332b0 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-eeb01c58-acd0-4df0-8cb6-7a69119332b0 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-eeb01c58-acd0-4df0-8cb6-7a69119332b0 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:21 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213.info Jul 28 10:54:21 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-eeb01c58-acd0-4df0-8cb6-7a69119332b0 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-eeb01c58-acd0-4df0-8cb6-7a69119332b0 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-eeb01c58-acd0-4df0-8cb6-7a69119332b0 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-d1a6d6c0-8e7d-494c-afa1-4580ead71720 tempest-CreateVolumesFromImageTest-411654455 None] Acquiring lock "cinder-14053f10-9789-419d-835a-733e92c156c1-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-d1a6d6c0-8e7d-494c-afa1-4580ead71720 tempest-CreateVolumesFromImageTest-411654455 None] Lock "cinder-14053f10-9789-419d-835a-733e92c156c1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:21 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:54:21 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:21 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c3dbc676-4a80-4aae-9c01-32c28ca0c40d tempest-CreateVolumesFromImageTest-411654455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.347s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-c3dbc676-4a80-4aae-9c01-32c28ca0c40d tempest-CreateVolumesFromImageTest-411654455 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:54:21 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-c3dbc676-4a80-4aae-9c01-32c28ca0c40d tempest-CreateVolumesFromImageTest-411654455 None] Deleted volume successfully. Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-c3dbc676-4a80-4aae-9c01-32c28ca0c40d tempest-CreateVolumesFromImageTest-411654455 None] Lock "cinder-4807645b-747c-40ad-907d-ca65149adcdb-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-32f7d483-8dad-481f-8fe5-3fee29102987 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Acquiring lock "cinder-42467876-2a4e-47b6-9b13-ed0eaee46db3-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-d1a6d6c0-8e7d-494c-afa1-4580ead71720 tempest-CreateVolumesFromImageTest-411654455 None] Acquiring lock "cinder-quobyte-14053f10-9789-419d-835a-733e92c156c1" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-32f7d483-8dad-481f-8fe5-3fee29102987 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "cinder-42467876-2a4e-47b6-9b13-ed0eaee46db3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-d1a6d6c0-8e7d-494c-afa1-4580ead71720 tempest-CreateVolumesFromImageTest-411654455 None] Lock "cinder-quobyte-14053f10-9789-419d-835a-733e92c156c1" acquired by "delete_volume" :: waited 0.034s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb18b4ec-011b-4c4b-8331-f3b4d87c5c04]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d1a6d6c0-8e7d-494c-afa1-4580ead71720 tempest-CreateVolumesFromImageTest-411654455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-14053f10-9789-419d-835a-733e92c156c1 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-32f7d483-8dad-481f-8fe5-3fee29102987 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Acquiring lock "cinder-quobyte-42467876-2a4e-47b6-9b13-ed0eaee46db3" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-32f7d483-8dad-481f-8fe5-3fee29102987 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "cinder-quobyte-42467876-2a4e-47b6-9b13-ed0eaee46db3" acquired by "delete_volume" :: waited 0.017s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7aaec7-d28f-4b6e-a736-383d4290214d]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-32f7d483-8dad-481f-8fe5-3fee29102987 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-42467876-2a4e-47b6-9b13-ed0eaee46db3 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:21 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-87579101-e1e7-46d2-be90-279b4ceacf55 tempest-CreateVolumesFromSnapshotTest-1608055624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213.info" returned: 0 in 0.455s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:21 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-87579101-e1e7-46d2-be90-279b4ceacf55 tempest-CreateVolumesFromSnapshotTest-1608055624 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213.info is being set with open permissions: ugo+rw Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-87579101-e1e7-46d2-be90-279b4ceacf55 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:21 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-14053f10-9789-419d-835a-733e92c156c1 Jul 28 10:54:21 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:21 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213.info Jul 28 10:54:21 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:21 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-eeb01c58-acd0-4df0-8cb6-7a69119332b0 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.425s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-eeb01c58-acd0-4df0-8cb6-7a69119332b0 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:54:21 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-eeb01c58-acd0-4df0-8cb6-7a69119332b0 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Deleted volume successfully. Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-eeb01c58-acd0-4df0-8cb6-7a69119332b0 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "cinder-10351eba-31dd-434a-bbfe-6e9bef70878a-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:21 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-42467876-2a4e-47b6-9b13-ed0eaee46db3 Jul 28 10:54:21 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:21 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-87579101-e1e7-46d2-be90-279b4ceacf55 tempest-CreateVolumesFromSnapshotTest-1608055624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213.info" returned: 0 in 0.275s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-87579101-e1e7-46d2-be90-279b4ceacf55 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.421s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.124s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11ec1cd8-8067-4d63-8e77-673ad56a0d91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d5a9ed8b964c7a8fb5fb12bdfd8c48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:14Z,use_quota=True,user_id='3460bf80ce304f13bf37b4abbad7b9a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20d73260-8b54-4954-aad7-faa2dcfd892d),volume_type_id=20d73260-8b54-4954-aad7-faa2dcfd892d)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Creating volume 11ec1cd8-8067-4d63-8e77-673ad56a0d91 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:54:21 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-11ec1cd8-8067-4d63-8e77-673ad56a0d91 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:21 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d1a6d6c0-8e7d-494c-afa1-4580ead71720 tempest-CreateVolumesFromImageTest-411654455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-14053f10-9789-419d-835a-733e92c156c1" returned: 0 in 0.439s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d1a6d6c0-8e7d-494c-afa1-4580ead71720 tempest-CreateVolumesFromImageTest-411654455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-14053f10-9789-419d-835a-733e92c156c1 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:21 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-11ec1cd8-8067-4d63-8e77-673ad56a0d91 1073741824 Jul 28 10:54:21 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:21 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-14053f10-9789-419d-835a-733e92c156c1 Jul 28 10:54:21 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:21 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-87579101-e1e7-46d2-be90-279b4ceacf55 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Create snapshot completed successfully Jul 28 10:54:21 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-32f7d483-8dad-481f-8fe5-3fee29102987 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-42467876-2a4e-47b6-9b13-ed0eaee46db3" returned: 0 in 0.446s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-32f7d483-8dad-481f-8fe5-3fee29102987 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-42467876-2a4e-47b6-9b13-ed0eaee46db3 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:22 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-42467876-2a4e-47b6-9b13-ed0eaee46db3 Jul 28 10:54:22 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:22 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d1a6d6c0-8e7d-494c-afa1-4580ead71720 tempest-CreateVolumesFromImageTest-411654455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-14053f10-9789-419d-835a-733e92c156c1" returned: 0 in 0.280s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:22 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-d1a6d6c0-8e7d-494c-afa1-4580ead71720 tempest-CreateVolumesFromImageTest-411654455 None] Lock "cinder-quobyte-14053f10-9789-419d-835a-733e92c156c1" released by "delete_volume" :: held 0.782s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:22 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-d1a6d6c0-8e7d-494c-afa1-4580ead71720 tempest-CreateVolumesFromImageTest-411654455 None] Created reservations ['a2e39be0-f7be-48fa-9fcd-15be1b841050', 'd8a961dd-f512-4e27-9dc1-e4f41fce6b68', '70eba2c7-f3e1-42bc-973e-c31a409055a1', 'd403ac2b-042f-4385-af56-76e8dc3c6b97'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:54:22 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-32f7d483-8dad-481f-8fe5-3fee29102987 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-42467876-2a4e-47b6-9b13-ed0eaee46db3" returned: 0 in 0.278s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:22 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-32f7d483-8dad-481f-8fe5-3fee29102987 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "cinder-quobyte-42467876-2a4e-47b6-9b13-ed0eaee46db3" released by "delete_volume" :: held 0.777s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d1a6d6c0-8e7d-494c-afa1-4580ead71720 tempest-CreateVolumesFromImageTest-411654455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d1a6d6c0-8e7d-494c-afa1-4580ead71720 tempest-CreateVolumesFromImageTest-411654455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:22 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-d1a6d6c0-8e7d-494c-afa1-4580ead71720 tempest-CreateVolumesFromImageTest-411654455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:22 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-d1a6d6c0-8e7d-494c-afa1-4580ead71720 tempest-CreateVolumesFromImageTest-411654455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d1a6d6c0-8e7d-494c-afa1-4580ead71720 tempest-CreateVolumesFromImageTest-411654455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d1a6d6c0-8e7d-494c-afa1-4580ead71720 tempest-CreateVolumesFromImageTest-411654455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:22 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-11ec1cd8-8067-4d63-8e77-673ad56a0d91 1073741824" returned: 0 in 0.492s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:22 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:54:22 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:22 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-32f7d483-8dad-481f-8fe5-3fee29102987 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Created reservations ['278e1b5d-6746-452c-aca4-86dc94115d26', 'ef27782b-e2e3-4632-98d7-3b2434678827', '85487ba6-db9f-4889-96b7-5a2e5042243c', 'ae4cb6a0-446e-4403-b19a-eb9d54959796'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:54:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-11ec1cd8-8067-4d63-8e77-673ad56a0d91 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:22 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-11ec1cd8-8067-4d63-8e77-673ad56a0d91 Jul 28 10:54:22 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-32f7d483-8dad-481f-8fe5-3fee29102987 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-32f7d483-8dad-481f-8fe5-3fee29102987 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:22 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-32f7d483-8dad-481f-8fe5-3fee29102987 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:22 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-32f7d483-8dad-481f-8fe5-3fee29102987 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-32f7d483-8dad-481f-8fe5-3fee29102987 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-32f7d483-8dad-481f-8fe5-3fee29102987 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:22 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:54:22 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:22 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0c52b69c-12ea-426a-b173-b1662e01a5f4 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Acquiring lock "cinder-5e9c8abf-8bfd-496b-a0f1-1cff7a4b140b-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:22 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d1a6d6c0-8e7d-494c-afa1-4580ead71720 tempest-CreateVolumesFromImageTest-411654455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.297s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:22 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-d1a6d6c0-8e7d-494c-afa1-4580ead71720 tempest-CreateVolumesFromImageTest-411654455 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:54:22 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-d1a6d6c0-8e7d-494c-afa1-4580ead71720 tempest-CreateVolumesFromImageTest-411654455 None] Deleted volume successfully. Jul 28 10:54:22 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0c52b69c-12ea-426a-b173-b1662e01a5f4 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "cinder-5e9c8abf-8bfd-496b-a0f1-1cff7a4b140b-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:22 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-d1a6d6c0-8e7d-494c-afa1-4580ead71720 tempest-CreateVolumesFromImageTest-411654455 None] Lock "cinder-14053f10-9789-419d-835a-733e92c156c1-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:22 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0c52b69c-12ea-426a-b173-b1662e01a5f4 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Acquiring lock "cinder-quobyte-5e9c8abf-8bfd-496b-a0f1-1cff7a4b140b" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:22 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0c52b69c-12ea-426a-b173-b1662e01a5f4 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "cinder-quobyte-5e9c8abf-8bfd-496b-a0f1-1cff7a4b140b" acquired by "delete_volume" :: waited 0.024s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:22 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[23805a87-2595-4ad0-bce9-0f15df4933d7]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0c52b69c-12ea-426a-b173-b1662e01a5f4 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5e9c8abf-8bfd-496b-a0f1-1cff7a4b140b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:22 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-11ec1cd8-8067-4d63-8e77-673ad56a0d91" returned: 0 in 0.436s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:22 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:54:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:22 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-32f7d483-8dad-481f-8fe5-3fee29102987 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.386s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:22 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-32f7d483-8dad-481f-8fe5-3fee29102987 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:54:22 devstack cinder-volume[88413]: DEBUG cinder.volume.volume_utils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Attempting download of 4eb74110-af34-4442-917a-8c540943c044 ((None, [{'url': 'file:///opt/stack/data/glance/images/4eb74110-af34-4442-917a-8c540943c044', 'metadata': {}}])) to volume 11ec1cd8-8067-4d63-8e77-673ad56a0d91. {{(pid=88413) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 28 10:54:22 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-32f7d483-8dad-481f-8fe5-3fee29102987 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Deleted volume successfully. Jul 28 10:54:22 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-32f7d483-8dad-481f-8fe5-3fee29102987 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "cinder-42467876-2a4e-47b6-9b13-ed0eaee46db3-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:22 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5e9c8abf-8bfd-496b-a0f1-1cff7a4b140b Jul 28 10:54:22 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:22 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd05eb2-82fb-4a6a-af30-bd4ba9b52269]: (4, 'raw') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4eb74110-af34-4442-917a-8c540943c044_lope0bzn {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:23 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4eb74110-af34-4442-917a-8c540943c044_lope0bzn Jul 28 10:54:23 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:23 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0c52b69c-12ea-426a-b173-b1662e01a5f4 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5e9c8abf-8bfd-496b-a0f1-1cff7a4b140b" returned: 0 in 0.475s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0c52b69c-12ea-426a-b173-b1662e01a5f4 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5e9c8abf-8bfd-496b-a0f1-1cff7a4b140b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:23 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5e9c8abf-8bfd-496b-a0f1-1cff7a4b140b Jul 28 10:54:23 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:23 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4eb74110-af34-4442-917a-8c540943c044_lope0bzn" returned: 0 in 0.489s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4eb74110-af34-4442-917a-8c540943c044_lope0bzn {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:23 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0c52b69c-12ea-426a-b173-b1662e01a5f4 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5e9c8abf-8bfd-496b-a0f1-1cff7a4b140b" returned: 0 in 0.336s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:23 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0c52b69c-12ea-426a-b173-b1662e01a5f4 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "cinder-quobyte-5e9c8abf-8bfd-496b-a0f1-1cff7a4b140b" released by "delete_volume" :: held 0.883s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:23 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-240b2151-f494-4f20-828b-c2c3d4e323ce tempest-CreateVolumesFromSnapshotTest-1608055624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:54:23 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4eb74110-af34-4442-917a-8c540943c044_lope0bzn Jul 28 10:54:23 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:23 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-240b2151-f494-4f20-828b-c2c3d4e323ce tempest-CreateVolumesFromSnapshotTest-1608055624 None] Flow 'volume_create_manager' (948b8fc7-b720-45bf-8056-7fcae45503b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:23 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-240b2151-f494-4f20-828b-c2c3d4e323ce tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb45a59-7b2f-45cc-ac10-54c6a75a5f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:23 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-240b2151-f494-4f20-828b-c2c3d4e323ce tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb45a59-7b2f-45cc-ac10-54c6a75a5f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-821498908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=842edb5c-e259-4909-9357-a32ad0afe841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeab7e9f807d4eefa059c324c03cb1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:24Z,use_quota=True,user_id='3cfd23eb40324b52814523ccf3da9db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:23 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-240b2151-f494-4f20-828b-c2c3d4e323ce tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37912055-17a9-4c50-9bd7-fecf7c8236c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:23 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-240b2151-f494-4f20-828b-c2c3d4e323ce tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37912055-17a9-4c50-9bd7-fecf7c8236c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:23 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-240b2151-f494-4f20-828b-c2c3d4e323ce tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0c7ab5a-df21-44af-8a86-1b4315bd3dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:23 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-240b2151-f494-4f20-828b-c2c3d4e323ce tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0c7ab5a-df21-44af-8a86-1b4315bd3dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '842edb5c-e259-4909-9357-a32ad0afe841', 'volume_name': 'volume-842edb5c-e259-4909-9357-a32ad0afe841', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:23 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-240b2151-f494-4f20-828b-c2c3d4e323ce tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06815364-851c-4f63-a295-00634535e4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:23 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-240b2151-f494-4f20-828b-c2c3d4e323ce tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06815364-851c-4f63-a295-00634535e4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:23 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-240b2151-f494-4f20-828b-c2c3d4e323ce tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5e9f21-58c0-4495-95df-db52f40b630f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:23 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-240b2151-f494-4f20-828b-c2c3d4e323ce tempest-CreateVolumesFromSnapshotTest-1608055624 None] Volume 842edb5c-e259-4909-9357-a32ad0afe841: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-842edb5c-e259-4909-9357-a32ad0afe841', 'volume_size': 1} Jul 28 10:54:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-240b2151-f494-4f20-828b-c2c3d4e323ce tempest-CreateVolumesFromSnapshotTest-1608055624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-240b2151-f494-4f20-828b-c2c3d4e323ce tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:23 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-240b2151-f494-4f20-828b-c2c3d4e323ce tempest-CreateVolumesFromSnapshotTest-1608055624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-821498908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=842edb5c-e259-4909-9357-a32ad0afe841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeab7e9f807d4eefa059c324c03cb1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:24Z,use_quota=True,user_id='3cfd23eb40324b52814523ccf3da9db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:54:23 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-240b2151-f494-4f20-828b-c2c3d4e323ce tempest-CreateVolumesFromSnapshotTest-1608055624 None] Creating volume 842edb5c-e259-4909-9357-a32ad0afe841 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:54:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-240b2151-f494-4f20-828b-c2c3d4e323ce tempest-CreateVolumesFromSnapshotTest-1608055624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-240b2151-f494-4f20-828b-c2c3d4e323ce tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:23 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-240b2151-f494-4f20-828b-c2c3d4e323ce tempest-CreateVolumesFromSnapshotTest-1608055624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:23 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-240b2151-f494-4f20-828b-c2c3d4e323ce tempest-CreateVolumesFromSnapshotTest-1608055624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-240b2151-f494-4f20-828b-c2c3d4e323ce tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:23 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-240b2151-f494-4f20-828b-c2c3d4e323ce tempest-CreateVolumesFromSnapshotTest-1608055624 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:54:23 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-240b2151-f494-4f20-828b-c2c3d4e323ce tempest-CreateVolumesFromSnapshotTest-1608055624 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:54:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-240b2151-f494-4f20-828b-c2c3d4e323ce tempest-CreateVolumesFromSnapshotTest-1608055624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-842edb5c-e259-4909-9357-a32ad0afe841 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:23 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-842edb5c-e259-4909-9357-a32ad0afe841 1073741824 Jul 28 10:54:23 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:23 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-0c52b69c-12ea-426a-b173-b1662e01a5f4 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Created reservations ['2eea148f-8722-48db-9b68-c414a60bdb7f', '76e18bbc-0ca7-44b9-abb9-3f6478655958', 'c11db740-dca1-4345-b73f-4eb1fe9e638c', '9ed19a1f-948d-46ba-b634-a3ee67d72159'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:54:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0c52b69c-12ea-426a-b173-b1662e01a5f4 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0c52b69c-12ea-426a-b173-b1662e01a5f4 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:24 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0c52b69c-12ea-426a-b173-b1662e01a5f4 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:24 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0c52b69c-12ea-426a-b173-b1662e01a5f4 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0c52b69c-12ea-426a-b173-b1662e01a5f4 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0c52b69c-12ea-426a-b173-b1662e01a5f4 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:24 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:24 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:54:24 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4eb74110-af34-4442-917a-8c540943c044_lope0bzn" returned: 1 in 0.712s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4eb74110-af34-4442-917a-8c540943c044_lope0bzn' failed. Not Retrying. {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 10:54:24 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5581ed5-42a9-4665-888a-721df5306a6d]: (4, 'raw') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4eb74110-af34-4442-917a-8c540943c044_yt_lu88mdevstack@QuobyteHD {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:24 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f65d61c-e16e-41b8-b3e9-c3934cdd857b tempest-CreateVolumesFromSnapshotTest-1608055624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:54:24 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0f65d61c-e16e-41b8-b3e9-c3934cdd857b tempest-CreateVolumesFromSnapshotTest-1608055624 None] Flow 'volume_create_manager' (3ec988b0-1b46-4f7b-8e63-2a1f50f407c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:24 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0f65d61c-e16e-41b8-b3e9-c3934cdd857b tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f08fb52-4c4e-454f-8379-2be3aa50e85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:24 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4eb74110-af34-4442-917a-8c540943c044_yt_lu88mdevstack@QuobyteHD Jul 28 10:54:24 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:24 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0f65d61c-e16e-41b8-b3e9-c3934cdd857b tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f08fb52-4c4e-454f-8379-2be3aa50e85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1877353159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de19a742-eeb4-42be-b97f-ca9b46d1bec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeab7e9f807d4eefa059c324c03cb1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:24Z,use_quota=True,user_id='3cfd23eb40324b52814523ccf3da9db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:24 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0f65d61c-e16e-41b8-b3e9-c3934cdd857b tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7452ed1b-81f6-46cd-b567-0a441e0987af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:24 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0f65d61c-e16e-41b8-b3e9-c3934cdd857b tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7452ed1b-81f6-46cd-b567-0a441e0987af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:24 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0f65d61c-e16e-41b8-b3e9-c3934cdd857b tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99505123-bc72-4528-990f-7f0cac06ebe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:24 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0f65d61c-e16e-41b8-b3e9-c3934cdd857b tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99505123-bc72-4528-990f-7f0cac06ebe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de19a742-eeb4-42be-b97f-ca9b46d1bec9', 'volume_name': 'volume-de19a742-eeb4-42be-b97f-ca9b46d1bec9', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:24 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0f65d61c-e16e-41b8-b3e9-c3934cdd857b tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a6b2f1b-ccd7-4ec0-85e7-079b85b3204b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:24 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0f65d61c-e16e-41b8-b3e9-c3934cdd857b tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a6b2f1b-ccd7-4ec0-85e7-079b85b3204b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:24 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0f65d61c-e16e-41b8-b3e9-c3934cdd857b tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d9fab7-c2d3-4af3-a413-75bb918a37b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:24 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-0f65d61c-e16e-41b8-b3e9-c3934cdd857b tempest-CreateVolumesFromSnapshotTest-1608055624 None] Volume de19a742-eeb4-42be-b97f-ca9b46d1bec9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de19a742-eeb4-42be-b97f-ca9b46d1bec9', 'volume_size': 1} Jul 28 10:54:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0f65d61c-e16e-41b8-b3e9-c3934cdd857b tempest-CreateVolumesFromSnapshotTest-1608055624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:24 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0c52b69c-12ea-426a-b173-b1662e01a5f4 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.506s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:24 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-0c52b69c-12ea-426a-b173-b1662e01a5f4 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:54:24 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-0c52b69c-12ea-426a-b173-b1662e01a5f4 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Deleted volume successfully. Jul 28 10:54:24 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-0c52b69c-12ea-426a-b173-b1662e01a5f4 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "cinder-5e9c8abf-8bfd-496b-a0f1-1cff7a4b140b-delete_volume" released by "delete_volume" :: held 1.981s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:24 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-240b2151-f494-4f20-828b-c2c3d4e323ce tempest-CreateVolumesFromSnapshotTest-1608055624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-842edb5c-e259-4909-9357-a32ad0afe841 1073741824" returned: 0 in 0.867s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-240b2151-f494-4f20-828b-c2c3d4e323ce tempest-CreateVolumesFromSnapshotTest-1608055624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-842edb5c-e259-4909-9357-a32ad0afe841 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:24 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-842edb5c-e259-4909-9357-a32ad0afe841 Jul 28 10:54:24 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:24 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4eb74110-af34-4442-917a-8c540943c044_yt_lu88mdevstack@QuobyteHD" returned: 0 in 0.631s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4eb74110-af34-4442-917a-8c540943c044_yt_lu88mdevstack@QuobyteHD {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:24 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4eb74110-af34-4442-917a-8c540943c044_yt_lu88mdevstack@QuobyteHD Jul 28 10:54:24 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff3b1e32-210a-406f-bc3e-41008595dd6e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ff3b1e32-210a-406f-bc3e-41008595dd6e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Flow 'volume_create_manager' (a071165b-e8f0-4148-991e-a6976bc90b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ff3b1e32-210a-406f-bc3e-41008595dd6e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f66f3b4-21f7-4efa-aba8-868dff63769d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-26cd8f96-718b-4132-afa4-a19a62b2566b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Acquiring lock "cinder-bb44e871-c899-4e07-a6e4-4405795f7bcd-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ff3b1e32-210a-406f-bc3e-41008595dd6e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f66f3b4-21f7-4efa-aba8-868dff63769d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-237902902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa12a981-1676-48fc-98a5-0015a6eb0c50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeab7e9f807d4eefa059c324c03cb1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:25Z,use_quota=True,user_id='3cfd23eb40324b52814523ccf3da9db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ff3b1e32-210a-406f-bc3e-41008595dd6e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ec0677-e14a-42a3-be57-cec29e06bdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ff3b1e32-210a-406f-bc3e-41008595dd6e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ec0677-e14a-42a3-be57-cec29e06bdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ff3b1e32-210a-406f-bc3e-41008595dd6e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7402fb9e-f6fd-4b45-9596-46fb8669dabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ff3b1e32-210a-406f-bc3e-41008595dd6e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7402fb9e-f6fd-4b45-9596-46fb8669dabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa12a981-1676-48fc-98a5-0015a6eb0c50', 'volume_name': 'volume-aa12a981-1676-48fc-98a5-0015a6eb0c50', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ff3b1e32-210a-406f-bc3e-41008595dd6e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a942927-a1a0-47fd-bf29-c4fb089de174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ff3b1e32-210a-406f-bc3e-41008595dd6e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a942927-a1a0-47fd-bf29-c4fb089de174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ff3b1e32-210a-406f-bc3e-41008595dd6e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b64f108-edf7-4f5e-9c8b-0c5cd571de43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:25 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-ff3b1e32-210a-406f-bc3e-41008595dd6e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Volume aa12a981-1676-48fc-98a5-0015a6eb0c50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa12a981-1676-48fc-98a5-0015a6eb0c50', 'volume_size': 1} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ff3b1e32-210a-406f-bc3e-41008595dd6e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:25 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-26cd8f96-718b-4132-afa4-a19a62b2566b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "cinder-bb44e871-c899-4e07-a6e4-4405795f7bcd-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-240b2151-f494-4f20-828b-c2c3d4e323ce tempest-CreateVolumesFromSnapshotTest-1608055624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-842edb5c-e259-4909-9357-a32ad0afe841" returned: 0 in 0.401s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-240b2151-f494-4f20-828b-c2c3d4e323ce tempest-CreateVolumesFromSnapshotTest-1608055624 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-240b2151-f494-4f20-828b-c2c3d4e323ce tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.337s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0f65d61c-e16e-41b8-b3e9-c3934cdd857b tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.548s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0f65d61c-e16e-41b8-b3e9-c3934cdd857b tempest-CreateVolumesFromSnapshotTest-1608055624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1877353159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de19a742-eeb4-42be-b97f-ca9b46d1bec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeab7e9f807d4eefa059c324c03cb1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:24Z,use_quota=True,user_id='3cfd23eb40324b52814523ccf3da9db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-0f65d61c-e16e-41b8-b3e9-c3934cdd857b tempest-CreateVolumesFromSnapshotTest-1608055624 None] Creating volume de19a742-eeb4-42be-b97f-ca9b46d1bec9 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0f65d61c-e16e-41b8-b3e9-c3934cdd857b tempest-CreateVolumesFromSnapshotTest-1608055624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0f65d61c-e16e-41b8-b3e9-c3934cdd857b tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0f65d61c-e16e-41b8-b3e9-c3934cdd857b tempest-CreateVolumesFromSnapshotTest-1608055624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0f65d61c-e16e-41b8-b3e9-c3934cdd857b tempest-CreateVolumesFromSnapshotTest-1608055624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0f65d61c-e16e-41b8-b3e9-c3934cdd857b tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0f65d61c-e16e-41b8-b3e9-c3934cdd857b tempest-CreateVolumesFromSnapshotTest-1608055624 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:54:25 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-0f65d61c-e16e-41b8-b3e9-c3934cdd857b tempest-CreateVolumesFromSnapshotTest-1608055624 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0f65d61c-e16e-41b8-b3e9-c3934cdd857b tempest-CreateVolumesFromSnapshotTest-1608055624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-de19a742-eeb4-42be-b97f-ca9b46d1bec9 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-240b2151-f494-4f20-828b-c2c3d4e323ce tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5e9f21-58c0-4495-95df-db52f40b630f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-842edb5c-e259-4909-9357-a32ad0afe841', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-240b2151-f494-4f20-828b-c2c3d4e323ce tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfbaa554-0b5a-47b4-acd2-1b91cdf47b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:25 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-de19a742-eeb4-42be-b97f-ca9b46d1bec9 1073741824 Jul 28 10:54:25 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:25 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-240b2151-f494-4f20-828b-c2c3d4e323ce tempest-CreateVolumesFromSnapshotTest-1608055624 None] Volume volume-842edb5c-e259-4909-9357-a32ad0afe841 (842edb5c-e259-4909-9357-a32ad0afe841): created successfully Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-240b2151-f494-4f20-828b-c2c3d4e323ce tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfbaa554-0b5a-47b4-acd2-1b91cdf47b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-240b2151-f494-4f20-828b-c2c3d4e323ce tempest-CreateVolumesFromSnapshotTest-1608055624 None] Flow 'volume_create_manager' (948b8fc7-b720-45bf-8056-7fcae45503b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-26cd8f96-718b-4132-afa4-a19a62b2566b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Acquiring lock "cinder-quobyte-bb44e871-c899-4e07-a6e4-4405795f7bcd" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:25 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-240b2151-f494-4f20-828b-c2c3d4e323ce tempest-CreateVolumesFromSnapshotTest-1608055624 None] Created volume successfully. Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-26cd8f96-718b-4132-afa4-a19a62b2566b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "cinder-quobyte-bb44e871-c899-4e07-a6e4-4405795f7bcd" acquired by "delete_volume" :: waited 0.030s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bbe4ee-55c3-488a-b906-d74271b13fb9]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-26cd8f96-718b-4132-afa4-a19a62b2566b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-bb44e871-c899-4e07-a6e4-4405795f7bcd {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:25 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-bb44e871-c899-4e07-a6e4-4405795f7bcd Jul 28 10:54:25 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:25 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4eb74110-af34-4442-917a-8c540943c044_yt_lu88mdevstack@QuobyteHD" returned: 1 in 0.697s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4eb74110-af34-4442-917a-8c540943c044_yt_lu88mdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] 4eb74110-af34-4442-917a-8c540943c044 was raw, converting to qcow2 {{(pid=88413) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4eb74110-af34-4442-917a-8c540943c044_yt_lu88mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-11ec1cd8-8067-4d63-8e77-673ad56a0d91 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:25 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4eb74110-af34-4442-917a-8c540943c044_yt_lu88mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-11ec1cd8-8067-4d63-8e77-673ad56a0d91 Jul 28 10:54:25 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-56da97c3-7f1a-4ede-a988-0dae28dc6abc tempest-CreateVolumesFromSnapshotTest-1608055624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-56da97c3-7f1a-4ede-a988-0dae28dc6abc tempest-CreateVolumesFromSnapshotTest-1608055624 None] Flow 'volume_create_manager' (7123cda0-4924-4df8-8c88-4ab24d20e22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-56da97c3-7f1a-4ede-a988-0dae28dc6abc tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a00fc8c5-dbe1-4e07-a4c0-024d8f65df2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:25 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-56da97c3-7f1a-4ede-a988-0dae28dc6abc tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a00fc8c5-dbe1-4e07-a4c0-024d8f65df2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-545948481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e838fe5-5477-49f9-9117-406ef5d8c74b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeab7e9f807d4eefa059c324c03cb1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:26Z,use_quota=True,user_id='3cfd23eb40324b52814523ccf3da9db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-56da97c3-7f1a-4ede-a988-0dae28dc6abc tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092a657d-8b84-4fd7-9127-7aa63dc62100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-56da97c3-7f1a-4ede-a988-0dae28dc6abc tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092a657d-8b84-4fd7-9127-7aa63dc62100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-56da97c3-7f1a-4ede-a988-0dae28dc6abc tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2562e1bf-6a8e-49c8-8cae-04935f107321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-56da97c3-7f1a-4ede-a988-0dae28dc6abc tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2562e1bf-6a8e-49c8-8cae-04935f107321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e838fe5-5477-49f9-9117-406ef5d8c74b', 'volume_name': 'volume-5e838fe5-5477-49f9-9117-406ef5d8c74b', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-56da97c3-7f1a-4ede-a988-0dae28dc6abc tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c5cd6bd-e082-46b6-baf3-23db2e0c12e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-56da97c3-7f1a-4ede-a988-0dae28dc6abc tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c5cd6bd-e082-46b6-baf3-23db2e0c12e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-56da97c3-7f1a-4ede-a988-0dae28dc6abc tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e501e518-ee07-4bb2-ac22-1685e78efa11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:25 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-56da97c3-7f1a-4ede-a988-0dae28dc6abc tempest-CreateVolumesFromSnapshotTest-1608055624 None] Volume 5e838fe5-5477-49f9-9117-406ef5d8c74b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e838fe5-5477-49f9-9117-406ef5d8c74b', 'volume_size': 1} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-56da97c3-7f1a-4ede-a988-0dae28dc6abc tempest-CreateVolumesFromSnapshotTest-1608055624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-26cd8f96-718b-4132-afa4-a19a62b2566b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-bb44e871-c899-4e07-a6e4-4405795f7bcd" returned: 0 in 0.513s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-26cd8f96-718b-4132-afa4-a19a62b2566b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-bb44e871-c899-4e07-a6e4-4405795f7bcd {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:25 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-bb44e871-c899-4e07-a6e4-4405795f7bcd Jul 28 10:54:25 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:25 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0f65d61c-e16e-41b8-b3e9-c3934cdd857b tempest-CreateVolumesFromSnapshotTest-1608055624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-de19a742-eeb4-42be-b97f-ca9b46d1bec9 1073741824" returned: 0 in 0.819s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0f65d61c-e16e-41b8-b3e9-c3934cdd857b tempest-CreateVolumesFromSnapshotTest-1608055624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-de19a742-eeb4-42be-b97f-ca9b46d1bec9 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:26 devstack sudo[107087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-de19a742-eeb4-42be-b97f-ca9b46d1bec9 Jul 28 10:54:26 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d997afa-24f8-4058-a349-69d7f37ee2ee tempest-CreateVolumesFromSnapshotTest-1608055624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3d997afa-24f8-4058-a349-69d7f37ee2ee tempest-CreateVolumesFromSnapshotTest-1608055624 None] Flow 'volume_create_manager' (e87c4577-a9a2-4f26-b4bc-e998f35ceada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3d997afa-24f8-4058-a349-69d7f37ee2ee tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12829c58-97ff-47d4-963b-9cb530a3ab59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3d997afa-24f8-4058-a349-69d7f37ee2ee tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12829c58-97ff-47d4-963b-9cb530a3ab59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-713187785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9707333-292c-4e25-9a8f-2c9eb2e6a9a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeab7e9f807d4eefa059c324c03cb1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:26Z,use_quota=True,user_id='3cfd23eb40324b52814523ccf3da9db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3d997afa-24f8-4058-a349-69d7f37ee2ee tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87741f98-58c7-4105-9f6e-a53555e4e2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3d997afa-24f8-4058-a349-69d7f37ee2ee tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87741f98-58c7-4105-9f6e-a53555e4e2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3d997afa-24f8-4058-a349-69d7f37ee2ee tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ef71aba-15b7-4475-8b67-07a1f53ec281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:26 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3d997afa-24f8-4058-a349-69d7f37ee2ee tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ef71aba-15b7-4475-8b67-07a1f53ec281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9707333-292c-4e25-9a8f-2c9eb2e6a9a3', 'volume_name': 'volume-c9707333-292c-4e25-9a8f-2c9eb2e6a9a3', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3d997afa-24f8-4058-a349-69d7f37ee2ee tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b3a6483-7a8f-4845-a687-4edd3af46811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3d997afa-24f8-4058-a349-69d7f37ee2ee tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b3a6483-7a8f-4845-a687-4edd3af46811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3d997afa-24f8-4058-a349-69d7f37ee2ee tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3159c8b3-c80b-4f55-bb03-ebf681dc6367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:26 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-3d997afa-24f8-4058-a349-69d7f37ee2ee tempest-CreateVolumesFromSnapshotTest-1608055624 None] Volume c9707333-292c-4e25-9a8f-2c9eb2e6a9a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9707333-292c-4e25-9a8f-2c9eb2e6a9a3', 'volume_size': 1} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3d997afa-24f8-4058-a349-69d7f37ee2ee tempest-CreateVolumesFromSnapshotTest-1608055624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-26cd8f96-718b-4132-afa4-a19a62b2566b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-bb44e871-c899-4e07-a6e4-4405795f7bcd" returned: 0 in 0.490s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-26cd8f96-718b-4132-afa4-a19a62b2566b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "cinder-quobyte-bb44e871-c899-4e07-a6e4-4405795f7bcd" released by "delete_volume" :: held 1.074s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:26 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4eb74110-af34-4442-917a-8c540943c044_yt_lu88mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-11ec1cd8-8067-4d63-8e77-673ad56a0d91" returned: 0 in 0.835s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4eb74110-af34-4442-917a-8c540943c044_yt_lu88mdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-11ec1cd8-8067-4d63-8e77-673ad56a0d91 {{(pid=88413) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 10:54:26 devstack cinder-volume[88413]: INFO cinder.image.image_utils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Converted 0.00 MB image at 0.00 MB/s Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-11ec1cd8-8067-4d63-8e77-673ad56a0d91 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:26 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-11ec1cd8-8067-4d63-8e77-673ad56a0d91 1G Jul 28 10:54:26 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-26cd8f96-718b-4132-afa4-a19a62b2566b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Created reservations ['e276f9c8-268e-4813-8c4a-828edf3ee4da', 'bf62e61b-27ba-474a-8ef7-55e944b70407', '4259cf98-ff0c-41ab-913c-5ed7aaa6e6b5', 'ec506593-1a61-40bf-9cb2-0adea4e4b74c'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:54:26 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0f65d61c-e16e-41b8-b3e9-c3934cdd857b tempest-CreateVolumesFromSnapshotTest-1608055624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-de19a742-eeb4-42be-b97f-ca9b46d1bec9" returned: 0 in 0.447s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0f65d61c-e16e-41b8-b3e9-c3934cdd857b tempest-CreateVolumesFromSnapshotTest-1608055624 None] <== create_volume: return (1329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0f65d61c-e16e-41b8-b3e9-c3934cdd857b tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ff3b1e32-210a-406f-bc3e-41008595dd6e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.346s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-ff3b1e32-210a-406f-bc3e-41008595dd6e tempest-CreateVolumesFromSnapshotTest-1608055624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-237902902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa12a981-1676-48fc-98a5-0015a6eb0c50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeab7e9f807d4eefa059c324c03cb1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:25Z,use_quota=True,user_id='3cfd23eb40324b52814523ccf3da9db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-ff3b1e32-210a-406f-bc3e-41008595dd6e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Creating volume aa12a981-1676-48fc-98a5-0015a6eb0c50 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ff3b1e32-210a-406f-bc3e-41008595dd6e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ff3b1e32-210a-406f-bc3e-41008595dd6e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-ff3b1e32-210a-406f-bc3e-41008595dd6e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-ff3b1e32-210a-406f-bc3e-41008595dd6e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ff3b1e32-210a-406f-bc3e-41008595dd6e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-ff3b1e32-210a-406f-bc3e-41008595dd6e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:54:26 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-ff3b1e32-210a-406f-bc3e-41008595dd6e tempest-CreateVolumesFromSnapshotTest-1608055624 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ff3b1e32-210a-406f-bc3e-41008595dd6e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aa12a981-1676-48fc-98a5-0015a6eb0c50 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0f65d61c-e16e-41b8-b3e9-c3934cdd857b tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d9fab7-c2d3-4af3-a413-75bb918a37b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de19a742-eeb4-42be-b97f-ca9b46d1bec9', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:26 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aa12a981-1676-48fc-98a5-0015a6eb0c50 1073741824 Jul 28 10:54:26 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0f65d61c-e16e-41b8-b3e9-c3934cdd857b tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb8808ad-bef0-4cc2-9e5b-934f35d0df99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-26cd8f96-718b-4132-afa4-a19a62b2566b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-26cd8f96-718b-4132-afa4-a19a62b2566b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-26cd8f96-718b-4132-afa4-a19a62b2566b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-26cd8f96-718b-4132-afa4-a19a62b2566b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-26cd8f96-718b-4132-afa4-a19a62b2566b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-26cd8f96-718b-4132-afa4-a19a62b2566b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:26 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-0f65d61c-e16e-41b8-b3e9-c3934cdd857b tempest-CreateVolumesFromSnapshotTest-1608055624 None] Volume volume-de19a742-eeb4-42be-b97f-ca9b46d1bec9 (de19a742-eeb4-42be-b97f-ca9b46d1bec9): created successfully Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0f65d61c-e16e-41b8-b3e9-c3934cdd857b tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb8808ad-bef0-4cc2-9e5b-934f35d0df99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0f65d61c-e16e-41b8-b3e9-c3934cdd857b tempest-CreateVolumesFromSnapshotTest-1608055624 None] Flow 'volume_create_manager' (3ec988b0-1b46-4f7b-8e63-2a1f50f407c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:26 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:54:26 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:26 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-0f65d61c-e16e-41b8-b3e9-c3934cdd857b tempest-CreateVolumesFromSnapshotTest-1608055624 None] Created volume successfully. Jul 28 10:54:26 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-11ec1cd8-8067-4d63-8e77-673ad56a0d91 1G" returned: 0 in 0.456s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG cinder.volume.volume_utils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Downloaded image 4eb74110-af34-4442-917a-8c540943c044 ((None, [{'url': 'file:///opt/stack/data/glance/images/4eb74110-af34-4442-917a-8c540943c044', 'metadata': {}}])) to volume 11ec1cd8-8067-4d63-8e77-673ad56a0d91 successfully. {{(pid=88413) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Temporary image 4eb74110-af34-4442-917a-8c540943c044 for user 3460bf80ce304f13bf37b4abbad7b9a0 is deleted. {{(pid=88413) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG cinder.volume.volume_utils [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Marking volume 11ec1cd8-8067-4d63-8e77-673ad56a0d91 as bootable. {{(pid=88413) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Copying metadata from image 4eb74110-af34-4442-917a-8c540943c044 to 11ec1cd8-8067-4d63-8e77-673ad56a0d91. {{(pid=88413) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Creating volume glance metadata for volume 11ec1cd8-8067-4d63-8e77-673ad56a0d91 backed by image 4eb74110-af34-4442-917a-8c540943c044 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '4eb74110-af34-4442-917a-8c540943c044', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'cf6a5daed94ece64b355bd30b24d901b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88413) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 28 10:54:26 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-26cd8f96-718b-4132-afa4-a19a62b2566b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.317s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-26cd8f96-718b-4132-afa4-a19a62b2566b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:54:26 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-26cd8f96-718b-4132-afa4-a19a62b2566b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Deleted volume successfully. Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-26cd8f96-718b-4132-afa4-a19a62b2566b tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "cinder-bb44e871-c899-4e07-a6e4-4405795f7bcd-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7fc4dfe-867f-4cfa-a504-bc87a2a48759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11ec1cd8-8067-4d63-8e77-673ad56a0d91', 'volume_size': 1, 'image_id': '4eb74110-af34-4442-917a-8c540943c044', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4eb74110-af34-4442-917a-8c540943c044', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cf6a5daed94ece64b355bd30b24d901b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '12d5a9ed8b964c7a8fb5fb12bdfd8c48', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a96c40f4b23f32d2c7b8adefb43f70708a23e2af54bcfa4a1d710bf332b7345582e2acbea08784fa8ab55bc44e57728f7ef220af90b473558456f1f5948f8d55', 'id': '4eb74110-af34-4442-917a-8c540943c044', 'created_at': datetime.datetime(2026, 7, 28, 8, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 8, 54, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4eb74110-af34-4442-917a-8c540943c044/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a6c20ea-e227-4a88-aea2-7c0c3fb581ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:26 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Volume volume-11ec1cd8-8067-4d63-8e77-673ad56a0d91 (11ec1cd8-8067-4d63-8e77-673ad56a0d91): created successfully Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a6c20ea-e227-4a88-aea2-7c0c3fb581ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:26 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Flow 'volume_create_manager' (156d80f5-b85e-401d-9562-96b1aa603abf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:27 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-cbcb6178-b672-4b19-9d85-2d021b50517d tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Created volume successfully. Jul 28 10:54:27 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ff3b1e32-210a-406f-bc3e-41008595dd6e tempest-CreateVolumesFromSnapshotTest-1608055624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aa12a981-1676-48fc-98a5-0015a6eb0c50 1073741824" returned: 0 in 0.518s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ff3b1e32-210a-406f-bc3e-41008595dd6e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aa12a981-1676-48fc-98a5-0015a6eb0c50 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:27 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aa12a981-1676-48fc-98a5-0015a6eb0c50 Jul 28 10:54:27 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:27 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ff3b1e32-210a-406f-bc3e-41008595dd6e tempest-CreateVolumesFromSnapshotTest-1608055624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aa12a981-1676-48fc-98a5-0015a6eb0c50" returned: 0 in 0.273s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-ff3b1e32-210a-406f-bc3e-41008595dd6e tempest-CreateVolumesFromSnapshotTest-1608055624 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:54:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ff3b1e32-210a-406f-bc3e-41008595dd6e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-56da97c3-7f1a-4ede-a988-0dae28dc6abc tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.484s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-56da97c3-7f1a-4ede-a988-0dae28dc6abc tempest-CreateVolumesFromSnapshotTest-1608055624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-545948481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e838fe5-5477-49f9-9117-406ef5d8c74b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeab7e9f807d4eefa059c324c03cb1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:26Z,use_quota=True,user_id='3cfd23eb40324b52814523ccf3da9db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:54:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-56da97c3-7f1a-4ede-a988-0dae28dc6abc tempest-CreateVolumesFromSnapshotTest-1608055624 None] Creating volume 5e838fe5-5477-49f9-9117-406ef5d8c74b {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:54:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-56da97c3-7f1a-4ede-a988-0dae28dc6abc tempest-CreateVolumesFromSnapshotTest-1608055624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-56da97c3-7f1a-4ede-a988-0dae28dc6abc tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-56da97c3-7f1a-4ede-a988-0dae28dc6abc tempest-CreateVolumesFromSnapshotTest-1608055624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-56da97c3-7f1a-4ede-a988-0dae28dc6abc tempest-CreateVolumesFromSnapshotTest-1608055624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-56da97c3-7f1a-4ede-a988-0dae28dc6abc tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-56da97c3-7f1a-4ede-a988-0dae28dc6abc tempest-CreateVolumesFromSnapshotTest-1608055624 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:54:27 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-56da97c3-7f1a-4ede-a988-0dae28dc6abc tempest-CreateVolumesFromSnapshotTest-1608055624 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:54:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-56da97c3-7f1a-4ede-a988-0dae28dc6abc tempest-CreateVolumesFromSnapshotTest-1608055624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5e838fe5-5477-49f9-9117-406ef5d8c74b 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ff3b1e32-210a-406f-bc3e-41008595dd6e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b64f108-edf7-4f5e-9c8b-0c5cd571de43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa12a981-1676-48fc-98a5-0015a6eb0c50', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:27 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5e838fe5-5477-49f9-9117-406ef5d8c74b 1073741824 Jul 28 10:54:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ff3b1e32-210a-406f-bc3e-41008595dd6e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abc9e0cc-413c-4bc5-abd8-b5b96f6afdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:27 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:27 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7f76284d-a7e2-4d34-a4e7-2d106a4e44b2 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Acquiring lock "cinder-435470fe-0a56-477d-9b0a-4891ed004529-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:27 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-ff3b1e32-210a-406f-bc3e-41008595dd6e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Volume volume-aa12a981-1676-48fc-98a5-0015a6eb0c50 (aa12a981-1676-48fc-98a5-0015a6eb0c50): created successfully Jul 28 10:54:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ff3b1e32-210a-406f-bc3e-41008595dd6e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abc9e0cc-413c-4bc5-abd8-b5b96f6afdfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ff3b1e32-210a-406f-bc3e-41008595dd6e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Flow 'volume_create_manager' (a071165b-e8f0-4148-991e-a6976bc90b21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:27 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7f76284d-a7e2-4d34-a4e7-2d106a4e44b2 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "cinder-435470fe-0a56-477d-9b0a-4891ed004529-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:27 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-ff3b1e32-210a-406f-bc3e-41008595dd6e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Created volume successfully. Jul 28 10:54:27 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7f76284d-a7e2-4d34-a4e7-2d106a4e44b2 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Acquiring lock "cinder-quobyte-435470fe-0a56-477d-9b0a-4891ed004529" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:27 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7f76284d-a7e2-4d34-a4e7-2d106a4e44b2 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "cinder-quobyte-435470fe-0a56-477d-9b0a-4891ed004529" acquired by "delete_volume" :: waited 0.015s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:27 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[713ed1bf-8845-4c6c-abcb-4eb204ae2d0b]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7f76284d-a7e2-4d34-a4e7-2d106a4e44b2 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-435470fe-0a56-477d-9b0a-4891ed004529 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:27 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-435470fe-0a56-477d-9b0a-4891ed004529 Jul 28 10:54:27 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:27 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fc8e0c74-34fc-4b31-8499-71c679fe37ec tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Acquiring lock "cinder-11ec1cd8-8067-4d63-8e77-673ad56a0d91-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:27 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fc8e0c74-34fc-4b31-8499-71c679fe37ec tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Lock "cinder-11ec1cd8-8067-4d63-8e77-673ad56a0d91-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:27 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fc8e0c74-34fc-4b31-8499-71c679fe37ec tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Acquiring lock "cinder-quobyte-11ec1cd8-8067-4d63-8e77-673ad56a0d91" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:27 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fc8e0c74-34fc-4b31-8499-71c679fe37ec tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Lock "cinder-quobyte-11ec1cd8-8067-4d63-8e77-673ad56a0d91" acquired by "delete_volume" :: waited 0.017s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:27 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-56da97c3-7f1a-4ede-a988-0dae28dc6abc tempest-CreateVolumesFromSnapshotTest-1608055624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5e838fe5-5477-49f9-9117-406ef5d8c74b 1073741824" returned: 0 in 0.579s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:27 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[780983d5-c48d-4c83-9be0-5165ac51373b]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fc8e0c74-34fc-4b31-8499-71c679fe37ec tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-11ec1cd8-8067-4d63-8e77-673ad56a0d91 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:27 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-56da97c3-7f1a-4ede-a988-0dae28dc6abc tempest-CreateVolumesFromSnapshotTest-1608055624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5e838fe5-5477-49f9-9117-406ef5d8c74b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7f76284d-a7e2-4d34-a4e7-2d106a4e44b2 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-435470fe-0a56-477d-9b0a-4891ed004529" returned: 0 in 0.477s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7f76284d-a7e2-4d34-a4e7-2d106a4e44b2 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-435470fe-0a56-477d-9b0a-4891ed004529 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:28 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5e838fe5-5477-49f9-9117-406ef5d8c74b Jul 28 10:54:28 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:28 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-435470fe-0a56-477d-9b0a-4891ed004529 Jul 28 10:54:28 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:28 devstack sudo[107123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-11ec1cd8-8067-4d63-8e77-673ad56a0d91 Jul 28 10:54:28 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:28 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-56da97c3-7f1a-4ede-a988-0dae28dc6abc tempest-CreateVolumesFromSnapshotTest-1608055624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5e838fe5-5477-49f9-9117-406ef5d8c74b" returned: 0 in 0.278s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-56da97c3-7f1a-4ede-a988-0dae28dc6abc tempest-CreateVolumesFromSnapshotTest-1608055624 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-56da97c3-7f1a-4ede-a988-0dae28dc6abc tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3d997afa-24f8-4058-a349-69d7f37ee2ee tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.933s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3d997afa-24f8-4058-a349-69d7f37ee2ee tempest-CreateVolumesFromSnapshotTest-1608055624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-713187785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9707333-292c-4e25-9a8f-2c9eb2e6a9a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeab7e9f807d4eefa059c324c03cb1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:26Z,use_quota=True,user_id='3cfd23eb40324b52814523ccf3da9db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-3d997afa-24f8-4058-a349-69d7f37ee2ee tempest-CreateVolumesFromSnapshotTest-1608055624 None] Creating volume c9707333-292c-4e25-9a8f-2c9eb2e6a9a3 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3d997afa-24f8-4058-a349-69d7f37ee2ee tempest-CreateVolumesFromSnapshotTest-1608055624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3d997afa-24f8-4058-a349-69d7f37ee2ee tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3d997afa-24f8-4058-a349-69d7f37ee2ee tempest-CreateVolumesFromSnapshotTest-1608055624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3d997afa-24f8-4058-a349-69d7f37ee2ee tempest-CreateVolumesFromSnapshotTest-1608055624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3d997afa-24f8-4058-a349-69d7f37ee2ee tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3d997afa-24f8-4058-a349-69d7f37ee2ee tempest-CreateVolumesFromSnapshotTest-1608055624 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:54:28 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-3d997afa-24f8-4058-a349-69d7f37ee2ee tempest-CreateVolumesFromSnapshotTest-1608055624 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3d997afa-24f8-4058-a349-69d7f37ee2ee tempest-CreateVolumesFromSnapshotTest-1608055624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c9707333-292c-4e25-9a8f-2c9eb2e6a9a3 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:28 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-56da97c3-7f1a-4ede-a988-0dae28dc6abc tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e501e518-ee07-4bb2-ac22-1685e78efa11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e838fe5-5477-49f9-9117-406ef5d8c74b', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-56da97c3-7f1a-4ede-a988-0dae28dc6abc tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (547d7438-a096-489a-bc66-e8c9b9a90bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7f76284d-a7e2-4d34-a4e7-2d106a4e44b2 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-435470fe-0a56-477d-9b0a-4891ed004529" returned: 0 in 0.336s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:28 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c9707333-292c-4e25-9a8f-2c9eb2e6a9a3 1073741824 Jul 28 10:54:28 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:28 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fc8e0c74-34fc-4b31-8499-71c679fe37ec tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-11ec1cd8-8067-4d63-8e77-673ad56a0d91" returned: 0 in 0.422s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fc8e0c74-34fc-4b31-8499-71c679fe37ec tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-11ec1cd8-8067-4d63-8e77-673ad56a0d91 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7f76284d-a7e2-4d34-a4e7-2d106a4e44b2 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "cinder-quobyte-435470fe-0a56-477d-9b0a-4891ed004529" released by "delete_volume" :: held 0.898s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:28 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-11ec1cd8-8067-4d63-8e77-673ad56a0d91 Jul 28 10:54:28 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:28 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-56da97c3-7f1a-4ede-a988-0dae28dc6abc tempest-CreateVolumesFromSnapshotTest-1608055624 None] Volume volume-5e838fe5-5477-49f9-9117-406ef5d8c74b (5e838fe5-5477-49f9-9117-406ef5d8c74b): created successfully Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-56da97c3-7f1a-4ede-a988-0dae28dc6abc tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (547d7438-a096-489a-bc66-e8c9b9a90bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-56da97c3-7f1a-4ede-a988-0dae28dc6abc tempest-CreateVolumesFromSnapshotTest-1608055624 None] Flow 'volume_create_manager' (7123cda0-4924-4df8-8c88-4ab24d20e22d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:28 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-56da97c3-7f1a-4ede-a988-0dae28dc6abc tempest-CreateVolumesFromSnapshotTest-1608055624 None] Created volume successfully. Jul 28 10:54:28 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:54:28 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-7f76284d-a7e2-4d34-a4e7-2d106a4e44b2 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Created reservations ['8bd02bcf-3c5c-4b78-9a43-c9379c766782', 'af1ce9d4-c1af-4824-b7d9-85435c5972e6', '44cfa135-06fe-42dd-bb7f-d1cf54ae3473', '4c88716a-2c06-4f6e-beb8-9378b1322365'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7f76284d-a7e2-4d34-a4e7-2d106a4e44b2 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7f76284d-a7e2-4d34-a4e7-2d106a4e44b2 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7f76284d-a7e2-4d34-a4e7-2d106a4e44b2 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7f76284d-a7e2-4d34-a4e7-2d106a4e44b2 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7f76284d-a7e2-4d34-a4e7-2d106a4e44b2 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7f76284d-a7e2-4d34-a4e7-2d106a4e44b2 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:28 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:54:28 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:28 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fc8e0c74-34fc-4b31-8499-71c679fe37ec tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-11ec1cd8-8067-4d63-8e77-673ad56a0d91" returned: 0 in 0.450s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fc8e0c74-34fc-4b31-8499-71c679fe37ec tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Lock "cinder-quobyte-11ec1cd8-8067-4d63-8e77-673ad56a0d91" released by "delete_volume" :: held 0.927s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:28 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-fc8e0c74-34fc-4b31-8499-71c679fe37ec tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Created reservations ['223d5b19-fdcf-4752-817e-789a6cf56403', 'b6c12ee1-2c02-409a-97ac-52a3a70c9e45', '5442dac8-39cf-4f66-a1cc-f6b6f00e4368', '50d13132-61fb-4526-983f-5d5f76262d3b'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.469s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager._thread_info {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread count: 29 {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread info: [<_MainThread(MainThread, started 137939890385024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 10:54:28 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3d997afa-24f8-4058-a349-69d7f37ee2ee tempest-CreateVolumesFromSnapshotTest-1608055624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c9707333-292c-4e25-9a8f-2c9eb2e6a9a3 1073741824" returned: 0 in 0.714s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:29 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7f76284d-a7e2-4d34-a4e7-2d106a4e44b2 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.343s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:29 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-7f76284d-a7e2-4d34-a4e7-2d106a4e44b2 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:54:29 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-7f76284d-a7e2-4d34-a4e7-2d106a4e44b2 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Deleted volume successfully. Jul 28 10:54:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fc8e0c74-34fc-4b31-8499-71c679fe37ec tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fc8e0c74-34fc-4b31-8499-71c679fe37ec tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:29 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-fc8e0c74-34fc-4b31-8499-71c679fe37ec tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:29 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-fc8e0c74-34fc-4b31-8499-71c679fe37ec tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fc8e0c74-34fc-4b31-8499-71c679fe37ec tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fc8e0c74-34fc-4b31-8499-71c679fe37ec tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:29 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7f76284d-a7e2-4d34-a4e7-2d106a4e44b2 tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "cinder-435470fe-0a56-477d-9b0a-4891ed004529-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3d997afa-24f8-4058-a349-69d7f37ee2ee tempest-CreateVolumesFromSnapshotTest-1608055624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c9707333-292c-4e25-9a8f-2c9eb2e6a9a3 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:29 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:54:29 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:29 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c9707333-292c-4e25-9a8f-2c9eb2e6a9a3 Jul 28 10:54:29 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:29 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:29 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fc8e0c74-34fc-4b31-8499-71c679fe37ec tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.306s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:29 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-fc8e0c74-34fc-4b31-8499-71c679fe37ec tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:54:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3d997afa-24f8-4058-a349-69d7f37ee2ee tempest-CreateVolumesFromSnapshotTest-1608055624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c9707333-292c-4e25-9a8f-2c9eb2e6a9a3" returned: 0 in 0.294s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:29 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3d997afa-24f8-4058-a349-69d7f37ee2ee tempest-CreateVolumesFromSnapshotTest-1608055624 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:54:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3d997afa-24f8-4058-a349-69d7f37ee2ee tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:29 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-fc8e0c74-34fc-4b31-8499-71c679fe37ec tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Deleted volume successfully. Jul 28 10:54:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3d997afa-24f8-4058-a349-69d7f37ee2ee tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3159c8b3-c80b-4f55-bb03-ebf681dc6367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9707333-292c-4e25-9a8f-2c9eb2e6a9a3', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3d997afa-24f8-4058-a349-69d7f37ee2ee tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (792f24ab-14dd-43e8-a5b0-5cde2f482987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:29 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-3d997afa-24f8-4058-a349-69d7f37ee2ee tempest-CreateVolumesFromSnapshotTest-1608055624 None] Volume volume-c9707333-292c-4e25-9a8f-2c9eb2e6a9a3 (c9707333-292c-4e25-9a8f-2c9eb2e6a9a3): created successfully Jul 28 10:54:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3d997afa-24f8-4058-a349-69d7f37ee2ee tempest-CreateVolumesFromSnapshotTest-1608055624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (792f24ab-14dd-43e8-a5b0-5cde2f482987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3d997afa-24f8-4058-a349-69d7f37ee2ee tempest-CreateVolumesFromSnapshotTest-1608055624 None] Flow 'volume_create_manager' (e87c4577-a9a2-4f26-b4bc-e998f35ceada) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:29 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fc8e0c74-34fc-4b31-8499-71c679fe37ec tempest-VolumeAndVolumeTypeFromImageTest-742998718 None] Lock "cinder-11ec1cd8-8067-4d63-8e77-673ad56a0d91-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:29 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-3d997afa-24f8-4058-a349-69d7f37ee2ee tempest-CreateVolumesFromSnapshotTest-1608055624 None] Created volume successfully. Jul 28 10:54:29 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-21163e76-6167-4d81-bc1b-8998286407ec tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Acquiring lock "cinder-0755b410-165a-41d9-9b79-9aa57932ff25-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:29 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-21163e76-6167-4d81-bc1b-8998286407ec tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "cinder-0755b410-165a-41d9-9b79-9aa57932ff25-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:29 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-21163e76-6167-4d81-bc1b-8998286407ec tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Acquiring lock "cinder-quobyte-0755b410-165a-41d9-9b79-9aa57932ff25" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:29 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-21163e76-6167-4d81-bc1b-8998286407ec tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "cinder-quobyte-0755b410-165a-41d9-9b79-9aa57932ff25" acquired by "delete_volume" :: waited 0.044s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:29 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf6b55d-3650-4188-a929-040a5c430097]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-21163e76-6167-4d81-bc1b-8998286407ec tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0755b410-165a-41d9-9b79-9aa57932ff25 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:29 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-51a1a4c9-20a1-4fcb-809f-1df96538bf2e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Acquiring lock "cinder-c9707333-292c-4e25-9a8f-2c9eb2e6a9a3-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:29 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-51a1a4c9-20a1-4fcb-809f-1df96538bf2e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "cinder-c9707333-292c-4e25-9a8f-2c9eb2e6a9a3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:29 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-51a1a4c9-20a1-4fcb-809f-1df96538bf2e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Acquiring lock "cinder-quobyte-c9707333-292c-4e25-9a8f-2c9eb2e6a9a3" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:29 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-51a1a4c9-20a1-4fcb-809f-1df96538bf2e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "cinder-quobyte-c9707333-292c-4e25-9a8f-2c9eb2e6a9a3" acquired by "delete_volume" :: waited 0.017s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:29 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca392af-60ff-4c83-9be0-9d9c4eb632ba]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-51a1a4c9-20a1-4fcb-809f-1df96538bf2e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c9707333-292c-4e25-9a8f-2c9eb2e6a9a3 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:29 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0755b410-165a-41d9-9b79-9aa57932ff25 Jul 28 10:54:29 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:30 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c9707333-292c-4e25-9a8f-2c9eb2e6a9a3 Jul 28 10:54:30 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:30 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-21163e76-6167-4d81-bc1b-8998286407ec tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0755b410-165a-41d9-9b79-9aa57932ff25" returned: 0 in 0.444s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-21163e76-6167-4d81-bc1b-8998286407ec tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0755b410-165a-41d9-9b79-9aa57932ff25 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:30 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0755b410-165a-41d9-9b79-9aa57932ff25 Jul 28 10:54:30 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:30 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-51a1a4c9-20a1-4fcb-809f-1df96538bf2e tempest-CreateVolumesFromSnapshotTest-1608055624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c9707333-292c-4e25-9a8f-2c9eb2e6a9a3" returned: 0 in 0.501s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-51a1a4c9-20a1-4fcb-809f-1df96538bf2e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c9707333-292c-4e25-9a8f-2c9eb2e6a9a3 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:30 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c9707333-292c-4e25-9a8f-2c9eb2e6a9a3 Jul 28 10:54:30 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:30 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-21163e76-6167-4d81-bc1b-8998286407ec tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0755b410-165a-41d9-9b79-9aa57932ff25" returned: 0 in 0.401s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:30 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-21163e76-6167-4d81-bc1b-8998286407ec tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "cinder-quobyte-0755b410-165a-41d9-9b79-9aa57932ff25" released by "delete_volume" :: held 0.909s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:30 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-21163e76-6167-4d81-bc1b-8998286407ec tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Created reservations ['91bc7b19-f23b-4425-9e06-5fb08647dee2', 'def33a47-6058-4631-a022-4ae6b59cbebc', '9e824828-c32b-4a2f-92a5-24701ff71870', 'c19dc190-8427-4e6f-8042-e715902d88c1'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:54:30 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-51a1a4c9-20a1-4fcb-809f-1df96538bf2e tempest-CreateVolumesFromSnapshotTest-1608055624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c9707333-292c-4e25-9a8f-2c9eb2e6a9a3" returned: 0 in 0.329s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:30 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-51a1a4c9-20a1-4fcb-809f-1df96538bf2e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "cinder-quobyte-c9707333-292c-4e25-9a8f-2c9eb2e6a9a3" released by "delete_volume" :: held 0.885s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-21163e76-6167-4d81-bc1b-8998286407ec tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-21163e76-6167-4d81-bc1b-8998286407ec tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:30 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-21163e76-6167-4d81-bc1b-8998286407ec tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:30 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-21163e76-6167-4d81-bc1b-8998286407ec tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-21163e76-6167-4d81-bc1b-8998286407ec tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-21163e76-6167-4d81-bc1b-8998286407ec tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:30 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:54:30 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:30 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-51a1a4c9-20a1-4fcb-809f-1df96538bf2e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Created reservations ['b8c3b668-2dcb-4d5d-88ad-6481b2bb1348', '4ff4c251-6100-4f69-b21a-d72bac080145', '772e7b15-57a3-45e7-8be7-5feceac55bd9', '58df9f8c-8e55-4296-a263-dba158fde0c7'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:54:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-51a1a4c9-20a1-4fcb-809f-1df96538bf2e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-51a1a4c9-20a1-4fcb-809f-1df96538bf2e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:31 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-51a1a4c9-20a1-4fcb-809f-1df96538bf2e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:31 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-51a1a4c9-20a1-4fcb-809f-1df96538bf2e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-51a1a4c9-20a1-4fcb-809f-1df96538bf2e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-51a1a4c9-20a1-4fcb-809f-1df96538bf2e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:31 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:54:31 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:31 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b12f51a2-2698-4dd7-83d1-982efd55bec8 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Acquiring lock "cinder-5e838fe5-5477-49f9-9117-406ef5d8c74b-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:31 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b12f51a2-2698-4dd7-83d1-982efd55bec8 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "cinder-5e838fe5-5477-49f9-9117-406ef5d8c74b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:31 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b12f51a2-2698-4dd7-83d1-982efd55bec8 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Acquiring lock "cinder-quobyte-5e838fe5-5477-49f9-9117-406ef5d8c74b" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:31 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b12f51a2-2698-4dd7-83d1-982efd55bec8 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "cinder-quobyte-5e838fe5-5477-49f9-9117-406ef5d8c74b" acquired by "delete_volume" :: waited 0.015s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:31 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3be802-eb6a-414d-aa1f-7ec99b42944f]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b12f51a2-2698-4dd7-83d1-982efd55bec8 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5e838fe5-5477-49f9-9117-406ef5d8c74b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:31 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-21163e76-6167-4d81-bc1b-8998286407ec tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.453s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:31 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-21163e76-6167-4d81-bc1b-8998286407ec tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:54:31 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-21163e76-6167-4d81-bc1b-8998286407ec tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Deleted volume successfully. Jul 28 10:54:31 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5e838fe5-5477-49f9-9117-406ef5d8c74b Jul 28 10:54:31 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:31 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-21163e76-6167-4d81-bc1b-8998286407ec tempest-CreateVolumesFromSourceVolumeTest-2145691616 None] Lock "cinder-0755b410-165a-41d9-9b79-9aa57932ff25-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:31 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-51a1a4c9-20a1-4fcb-809f-1df96538bf2e tempest-CreateVolumesFromSnapshotTest-1608055624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.447s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:31 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-51a1a4c9-20a1-4fcb-809f-1df96538bf2e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:54:31 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-51a1a4c9-20a1-4fcb-809f-1df96538bf2e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Deleted volume successfully. Jul 28 10:54:31 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-51a1a4c9-20a1-4fcb-809f-1df96538bf2e tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "cinder-c9707333-292c-4e25-9a8f-2c9eb2e6a9a3-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:31 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b12f51a2-2698-4dd7-83d1-982efd55bec8 tempest-CreateVolumesFromSnapshotTest-1608055624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5e838fe5-5477-49f9-9117-406ef5d8c74b" returned: 0 in 0.475s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b12f51a2-2698-4dd7-83d1-982efd55bec8 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5e838fe5-5477-49f9-9117-406ef5d8c74b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:31 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5e838fe5-5477-49f9-9117-406ef5d8c74b Jul 28 10:54:31 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:32 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b12f51a2-2698-4dd7-83d1-982efd55bec8 tempest-CreateVolumesFromSnapshotTest-1608055624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-5e838fe5-5477-49f9-9117-406ef5d8c74b" returned: 0 in 0.290s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:32 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b12f51a2-2698-4dd7-83d1-982efd55bec8 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "cinder-quobyte-5e838fe5-5477-49f9-9117-406ef5d8c74b" released by "delete_volume" :: held 0.831s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:32 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-b12f51a2-2698-4dd7-83d1-982efd55bec8 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Created reservations ['ed99bfd2-1238-4239-b8a6-82d4f570b059', 'e3136870-9d74-4af3-a5e8-b23c5e8a36f2', '4b20cd1c-23c8-4a3c-bc23-00448a59a2f9', 'ea8e8e5a-a153-4ae8-b666-3af010c14e06'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:54:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b12f51a2-2698-4dd7-83d1-982efd55bec8 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b12f51a2-2698-4dd7-83d1-982efd55bec8 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:32 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b12f51a2-2698-4dd7-83d1-982efd55bec8 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:32 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b12f51a2-2698-4dd7-83d1-982efd55bec8 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b12f51a2-2698-4dd7-83d1-982efd55bec8 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b12f51a2-2698-4dd7-83d1-982efd55bec8 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:32 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:54:32 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:32 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-60b3d242-9240-4dfc-a0c2-3f270dd7b00a tempest-CreateVolumesFromSnapshotTest-1608055624 None] Acquiring lock "cinder-aa12a981-1676-48fc-98a5-0015a6eb0c50-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:32 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-60b3d242-9240-4dfc-a0c2-3f270dd7b00a tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "cinder-aa12a981-1676-48fc-98a5-0015a6eb0c50-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:32 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-60b3d242-9240-4dfc-a0c2-3f270dd7b00a tempest-CreateVolumesFromSnapshotTest-1608055624 None] Acquiring lock "cinder-quobyte-aa12a981-1676-48fc-98a5-0015a6eb0c50" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:32 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b12f51a2-2698-4dd7-83d1-982efd55bec8 tempest-CreateVolumesFromSnapshotTest-1608055624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.363s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:32 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-b12f51a2-2698-4dd7-83d1-982efd55bec8 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:54:32 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-b12f51a2-2698-4dd7-83d1-982efd55bec8 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Deleted volume successfully. Jul 28 10:54:32 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-60b3d242-9240-4dfc-a0c2-3f270dd7b00a tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "cinder-quobyte-aa12a981-1676-48fc-98a5-0015a6eb0c50" acquired by "delete_volume" :: waited 0.027s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:32 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b12f51a2-2698-4dd7-83d1-982efd55bec8 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "cinder-5e838fe5-5477-49f9-9117-406ef5d8c74b-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:32 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ac2e73-cee7-4a70-b7b0-9c96cb4c24ee]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-60b3d242-9240-4dfc-a0c2-3f270dd7b00a tempest-CreateVolumesFromSnapshotTest-1608055624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aa12a981-1676-48fc-98a5-0015a6eb0c50 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:32 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aa12a981-1676-48fc-98a5-0015a6eb0c50 Jul 28 10:54:32 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:33 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-60b3d242-9240-4dfc-a0c2-3f270dd7b00a tempest-CreateVolumesFromSnapshotTest-1608055624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aa12a981-1676-48fc-98a5-0015a6eb0c50" returned: 0 in 0.425s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-60b3d242-9240-4dfc-a0c2-3f270dd7b00a tempest-CreateVolumesFromSnapshotTest-1608055624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aa12a981-1676-48fc-98a5-0015a6eb0c50 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:33 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aa12a981-1676-48fc-98a5-0015a6eb0c50 Jul 28 10:54:33 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:33 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-60b3d242-9240-4dfc-a0c2-3f270dd7b00a tempest-CreateVolumesFromSnapshotTest-1608055624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-aa12a981-1676-48fc-98a5-0015a6eb0c50" returned: 0 in 0.404s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:33 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-60b3d242-9240-4dfc-a0c2-3f270dd7b00a tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "cinder-quobyte-aa12a981-1676-48fc-98a5-0015a6eb0c50" released by "delete_volume" :: held 0.891s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:33 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-60b3d242-9240-4dfc-a0c2-3f270dd7b00a tempest-CreateVolumesFromSnapshotTest-1608055624 None] Created reservations ['59f97930-5418-4aec-bd2a-7dbe283ab5bf', '9863b798-dc61-41e3-90ff-5847dbbd8b80', '570ee8d4-a608-4f04-9be5-a25110159de0', '79cd32ce-f718-49e4-9f90-8cd1a8d097fe'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:54:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-60b3d242-9240-4dfc-a0c2-3f270dd7b00a tempest-CreateVolumesFromSnapshotTest-1608055624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-60b3d242-9240-4dfc-a0c2-3f270dd7b00a tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:33 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-60b3d242-9240-4dfc-a0c2-3f270dd7b00a tempest-CreateVolumesFromSnapshotTest-1608055624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:33 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-60b3d242-9240-4dfc-a0c2-3f270dd7b00a tempest-CreateVolumesFromSnapshotTest-1608055624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-60b3d242-9240-4dfc-a0c2-3f270dd7b00a tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-60b3d242-9240-4dfc-a0c2-3f270dd7b00a tempest-CreateVolumesFromSnapshotTest-1608055624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:33 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:54:33 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:33 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8fd1df10-76a8-478d-ae36-a989eaba6279 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Acquiring lock "cinder-de19a742-eeb4-42be-b97f-ca9b46d1bec9-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:33 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8fd1df10-76a8-478d-ae36-a989eaba6279 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "cinder-de19a742-eeb4-42be-b97f-ca9b46d1bec9-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:33 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8fd1df10-76a8-478d-ae36-a989eaba6279 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Acquiring lock "cinder-quobyte-de19a742-eeb4-42be-b97f-ca9b46d1bec9" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:33 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8fd1df10-76a8-478d-ae36-a989eaba6279 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "cinder-quobyte-de19a742-eeb4-42be-b97f-ca9b46d1bec9" acquired by "delete_volume" :: waited 0.028s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:33 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1e9470-44d2-4148-af62-e78e4c6b07eb]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8fd1df10-76a8-478d-ae36-a989eaba6279 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-de19a742-eeb4-42be-b97f-ca9b46d1bec9 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:33 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-60b3d242-9240-4dfc-a0c2-3f270dd7b00a tempest-CreateVolumesFromSnapshotTest-1608055624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.416s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:33 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-60b3d242-9240-4dfc-a0c2-3f270dd7b00a tempest-CreateVolumesFromSnapshotTest-1608055624 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:54:34 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-60b3d242-9240-4dfc-a0c2-3f270dd7b00a tempest-CreateVolumesFromSnapshotTest-1608055624 None] Deleted volume successfully. Jul 28 10:54:34 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-de19a742-eeb4-42be-b97f-ca9b46d1bec9 Jul 28 10:54:34 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:34 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-60b3d242-9240-4dfc-a0c2-3f270dd7b00a tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "cinder-aa12a981-1676-48fc-98a5-0015a6eb0c50-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:34 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8fd1df10-76a8-478d-ae36-a989eaba6279 tempest-CreateVolumesFromSnapshotTest-1608055624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-de19a742-eeb4-42be-b97f-ca9b46d1bec9" returned: 0 in 0.455s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8fd1df10-76a8-478d-ae36-a989eaba6279 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-de19a742-eeb4-42be-b97f-ca9b46d1bec9 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:34 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-de19a742-eeb4-42be-b97f-ca9b46d1bec9 Jul 28 10:54:34 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:34 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8fd1df10-76a8-478d-ae36-a989eaba6279 tempest-CreateVolumesFromSnapshotTest-1608055624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-de19a742-eeb4-42be-b97f-ca9b46d1bec9" returned: 0 in 0.325s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:34 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8fd1df10-76a8-478d-ae36-a989eaba6279 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "cinder-quobyte-de19a742-eeb4-42be-b97f-ca9b46d1bec9" released by "delete_volume" :: held 0.852s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:34 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-8fd1df10-76a8-478d-ae36-a989eaba6279 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Created reservations ['7b947feb-2d27-410e-b039-9ee9b08cfa17', '00cb622b-61fb-4acf-adb8-6d4a1894aabc', '4f070c0f-f9fd-47d7-bb3b-e99cabccae3f', '1a31deeb-d965-4d6f-bfac-a8bd666bae86'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:54:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8fd1df10-76a8-478d-ae36-a989eaba6279 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8fd1df10-76a8-478d-ae36-a989eaba6279 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:34 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8fd1df10-76a8-478d-ae36-a989eaba6279 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:34 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8fd1df10-76a8-478d-ae36-a989eaba6279 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8fd1df10-76a8-478d-ae36-a989eaba6279 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8fd1df10-76a8-478d-ae36-a989eaba6279 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:34 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:54:34 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:35 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7c37c46e-c248-4735-8475-d7473d9d7756 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Acquiring lock "cinder-842edb5c-e259-4909-9357-a32ad0afe841-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:35 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7c37c46e-c248-4735-8475-d7473d9d7756 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "cinder-842edb5c-e259-4909-9357-a32ad0afe841-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:35 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7c37c46e-c248-4735-8475-d7473d9d7756 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Acquiring lock "cinder-quobyte-842edb5c-e259-4909-9357-a32ad0afe841" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:35 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7c37c46e-c248-4735-8475-d7473d9d7756 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "cinder-quobyte-842edb5c-e259-4909-9357-a32ad0afe841" acquired by "delete_volume" :: waited 0.037s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:35 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5db4c28-3394-4190-b54c-ac8f3d2a596a]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7c37c46e-c248-4735-8475-d7473d9d7756 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-842edb5c-e259-4909-9357-a32ad0afe841 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:35 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8fd1df10-76a8-478d-ae36-a989eaba6279 tempest-CreateVolumesFromSnapshotTest-1608055624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.367s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:35 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-8fd1df10-76a8-478d-ae36-a989eaba6279 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:54:35 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-8fd1df10-76a8-478d-ae36-a989eaba6279 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Deleted volume successfully. Jul 28 10:54:35 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8fd1df10-76a8-478d-ae36-a989eaba6279 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "cinder-de19a742-eeb4-42be-b97f-ca9b46d1bec9-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:35 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-842edb5c-e259-4909-9357-a32ad0afe841 Jul 28 10:54:35 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:35 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7c37c46e-c248-4735-8475-d7473d9d7756 tempest-CreateVolumesFromSnapshotTest-1608055624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-842edb5c-e259-4909-9357-a32ad0afe841" returned: 0 in 0.470s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7c37c46e-c248-4735-8475-d7473d9d7756 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-842edb5c-e259-4909-9357-a32ad0afe841 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:35 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-842edb5c-e259-4909-9357-a32ad0afe841 Jul 28 10:54:35 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:35 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7c37c46e-c248-4735-8475-d7473d9d7756 tempest-CreateVolumesFromSnapshotTest-1608055624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-842edb5c-e259-4909-9357-a32ad0afe841" returned: 0 in 0.256s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:35 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7c37c46e-c248-4735-8475-d7473d9d7756 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "cinder-quobyte-842edb5c-e259-4909-9357-a32ad0afe841" released by "delete_volume" :: held 0.790s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:35 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-7c37c46e-c248-4735-8475-d7473d9d7756 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Created reservations ['b0f41a10-61f4-428c-bf26-e1b6b43eab2f', '5b911ca8-accf-4253-a91e-0d474a0af82f', '329cf396-0446-4960-bc21-18696275dc20', 'ddd4ba67-939c-4b29-8ea9-44105ae47c40'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7c37c46e-c248-4735-8475-d7473d9d7756 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7c37c46e-c248-4735-8475-d7473d9d7756 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7c37c46e-c248-4735-8475-d7473d9d7756 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7c37c46e-c248-4735-8475-d7473d9d7756 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7c37c46e-c248-4735-8475-d7473d9d7756 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7c37c46e-c248-4735-8475-d7473d9d7756 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:36 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:54:36 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9a09f1a0-93cc-4d10-8242-05d0cd848e28 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Acquiring lock "cinder-3c32f852-bffb-4be3-8c98-023fbc751e0d-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9a09f1a0-93cc-4d10-8242-05d0cd848e28 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "cinder-3c32f852-bffb-4be3-8c98-023fbc751e0d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9a09f1a0-93cc-4d10-8242-05d0cd848e28 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Acquiring lock "cinder-quobyte-e203f27c-6e03-4139-afa9-7c4ee02da213" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9a09f1a0-93cc-4d10-8242-05d0cd848e28 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "cinder-quobyte-e203f27c-6e03-4139-afa9-7c4ee02da213" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9a09f1a0-93cc-4d10-8242-05d0cd848e28 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Acquiring lock "cinder-quobyte-3c32f852-bffb-4be3-8c98-023fbc751e0d" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9a09f1a0-93cc-4d10-8242-05d0cd848e28 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "cinder-quobyte-3c32f852-bffb-4be3-8c98-023fbc751e0d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-9a09f1a0-93cc-4d10-8242-05d0cd848e28 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Deleting offline snapshot 3c32f852-bffb-4be3-8c98-023fbc751e0d of volume e203f27c-6e03-4139-afa9-7c4ee02da213 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-9a09f1a0-93cc-4d10-8242-05d0cd848e28 tempest-CreateVolumesFromSnapshotTest-1608055624 None] snapshot_file for this snap is: volume-e203f27c-6e03-4139-afa9-7c4ee02da213.3c32f852-bffb-4be3-8c98-023fbc751e0d {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba3e3ef-ee7a-4c62-b010-51fb41641308]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9a09f1a0-93cc-4d10-8242-05d0cd848e28 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213.3c32f852-bffb-4be3-8c98-023fbc751e0d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-93cd88cf-8f73-4365-a0a7-a95c8077ad9d tempest-VolumeDependencyTests-1299839671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:54:36 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-93cd88cf-8f73-4365-a0a7-a95c8077ad9d tempest-VolumeDependencyTests-1299839671 None] Flow 'volume_create_manager' (6dac7745-790b-478a-b2e3-659cfd987393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-93cd88cf-8f73-4365-a0a7-a95c8077ad9d tempest-VolumeDependencyTests-1299839671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bbc1a54-b8d5-47f3-b0aa-2c68dd77f0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:36 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213.3c32f852-bffb-4be3-8c98-023fbc751e0d Jul 28 10:54:36 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7c37c46e-c248-4735-8475-d7473d9d7756 tempest-CreateVolumesFromSnapshotTest-1608055624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.369s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-7c37c46e-c248-4735-8475-d7473d9d7756 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:54:36 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-7c37c46e-c248-4735-8475-d7473d9d7756 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Deleted volume successfully. Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-93cd88cf-8f73-4365-a0a7-a95c8077ad9d tempest-VolumeDependencyTests-1299839671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bbc1a54-b8d5-47f3-b0aa-2c68dd77f0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-450414682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045509ed-cc81-4691-9a72-45674353d210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0596b3437bca46e885410b38f4bedc12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:36Z,use_quota=True,user_id='382a8d47709446e3aad75ba1cdcdab70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-93cd88cf-8f73-4365-a0a7-a95c8077ad9d tempest-VolumeDependencyTests-1299839671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f9655a7-6c97-41d7-8a3b-fda5029d86bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-93cd88cf-8f73-4365-a0a7-a95c8077ad9d tempest-VolumeDependencyTests-1299839671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f9655a7-6c97-41d7-8a3b-fda5029d86bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-93cd88cf-8f73-4365-a0a7-a95c8077ad9d tempest-VolumeDependencyTests-1299839671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad6d9eb-c7ee-4995-9649-bb02effa5ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-93cd88cf-8f73-4365-a0a7-a95c8077ad9d tempest-VolumeDependencyTests-1299839671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad6d9eb-c7ee-4995-9649-bb02effa5ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '045509ed-cc81-4691-9a72-45674353d210', 'volume_name': 'volume-045509ed-cc81-4691-9a72-45674353d210', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-93cd88cf-8f73-4365-a0a7-a95c8077ad9d tempest-VolumeDependencyTests-1299839671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (791ec80b-a53f-4c3c-8bdb-3da329121282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-93cd88cf-8f73-4365-a0a7-a95c8077ad9d tempest-VolumeDependencyTests-1299839671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (791ec80b-a53f-4c3c-8bdb-3da329121282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-93cd88cf-8f73-4365-a0a7-a95c8077ad9d tempest-VolumeDependencyTests-1299839671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24e46dfb-9a6d-48f5-ab42-1a30d120af70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:36 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-93cd88cf-8f73-4365-a0a7-a95c8077ad9d tempest-VolumeDependencyTests-1299839671 None] Volume 045509ed-cc81-4691-9a72-45674353d210: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-045509ed-cc81-4691-9a72-45674353d210', 'volume_size': 1} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-93cd88cf-8f73-4365-a0a7-a95c8077ad9d tempest-VolumeDependencyTests-1299839671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-93cd88cf-8f73-4365-a0a7-a95c8077ad9d tempest-VolumeDependencyTests-1299839671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-93cd88cf-8f73-4365-a0a7-a95c8077ad9d tempest-VolumeDependencyTests-1299839671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-450414682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045509ed-cc81-4691-9a72-45674353d210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0596b3437bca46e885410b38f4bedc12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:36Z,use_quota=True,user_id='382a8d47709446e3aad75ba1cdcdab70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-93cd88cf-8f73-4365-a0a7-a95c8077ad9d tempest-VolumeDependencyTests-1299839671 None] Creating volume 045509ed-cc81-4691-9a72-45674353d210 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-93cd88cf-8f73-4365-a0a7-a95c8077ad9d tempest-VolumeDependencyTests-1299839671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-93cd88cf-8f73-4365-a0a7-a95c8077ad9d tempest-VolumeDependencyTests-1299839671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-93cd88cf-8f73-4365-a0a7-a95c8077ad9d tempest-VolumeDependencyTests-1299839671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-93cd88cf-8f73-4365-a0a7-a95c8077ad9d tempest-VolumeDependencyTests-1299839671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-93cd88cf-8f73-4365-a0a7-a95c8077ad9d tempest-VolumeDependencyTests-1299839671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-93cd88cf-8f73-4365-a0a7-a95c8077ad9d tempest-VolumeDependencyTests-1299839671 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:54:36 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-93cd88cf-8f73-4365-a0a7-a95c8077ad9d tempest-VolumeDependencyTests-1299839671 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-93cd88cf-8f73-4365-a0a7-a95c8077ad9d tempest-VolumeDependencyTests-1299839671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cc658d5-bc62-4604-aad0-c433172427c7 tempest-CinderUnicodeTest-858828730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:54:36 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210 1073741824 Jul 28 10:54:36 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0cc658d5-bc62-4604-aad0-c433172427c7 tempest-CinderUnicodeTest-858828730 None] Flow 'volume_create_manager' (3eb63492-72a2-4776-b99d-5d074c3e2417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0cc658d5-bc62-4604-aad0-c433172427c7 tempest-CinderUnicodeTest-858828730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (119b2e2e-e800-4104-a74d-232690fc5273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7c37c46e-c248-4735-8475-d7473d9d7756 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "cinder-842edb5c-e259-4909-9357-a32ad0afe841-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0cc658d5-bc62-4604-aad0-c433172427c7 tempest-CinderUnicodeTest-858828730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (119b2e2e-e800-4104-a74d-232690fc5273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f14a06af-3b3a-4a6d-8376-447089320fb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c5a1a39141a4fd59fc9260e83aa492e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:36Z,use_quota=True,user_id='25633d62fe574c799dc0901529067f94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0cc658d5-bc62-4604-aad0-c433172427c7 tempest-CinderUnicodeTest-858828730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6bdf391-0a4f-4e0e-bb84-a0672f3dd142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0cc658d5-bc62-4604-aad0-c433172427c7 tempest-CinderUnicodeTest-858828730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6bdf391-0a4f-4e0e-bb84-a0672f3dd142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0cc658d5-bc62-4604-aad0-c433172427c7 tempest-CinderUnicodeTest-858828730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e89f9b-b996-4cdc-b253-f0cf4bcbefea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0cc658d5-bc62-4604-aad0-c433172427c7 tempest-CinderUnicodeTest-858828730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e89f9b-b996-4cdc-b253-f0cf4bcbefea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f14a06af-3b3a-4a6d-8376-447089320fb1', 'volume_name': 'volume-f14a06af-3b3a-4a6d-8376-447089320fb1', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0cc658d5-bc62-4604-aad0-c433172427c7 tempest-CinderUnicodeTest-858828730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7509d51-ce67-47f1-86a7-967fb729e7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0cc658d5-bc62-4604-aad0-c433172427c7 tempest-CinderUnicodeTest-858828730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7509d51-ce67-47f1-86a7-967fb729e7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0cc658d5-bc62-4604-aad0-c433172427c7 tempest-CinderUnicodeTest-858828730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f02d04e4-f0af-47b9-aa71-d9d78dddf0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:36 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-0cc658d5-bc62-4604-aad0-c433172427c7 tempest-CinderUnicodeTest-858828730 None] Volume f14a06af-3b3a-4a6d-8376-447089320fb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f14a06af-3b3a-4a6d-8376-447089320fb1', 'volume_size': 1} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0cc658d5-bc62-4604-aad0-c433172427c7 tempest-CinderUnicodeTest-858828730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:36 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9a09f1a0-93cc-4d10-8242-05d0cd848e28 tempest-CreateVolumesFromSnapshotTest-1608055624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213.3c32f852-bffb-4be3-8c98-023fbc751e0d" returned: 0 in 0.421s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-9a09f1a0-93cc-4d10-8242-05d0cd848e28 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e203f27c-6e03-4139-afa9-7c4ee02da213(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1d1c2a-569a-410d-9001-7b0cecd8d3e6]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9a09f1a0-93cc-4d10-8242-05d0cd848e28 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:36 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213 Jul 28 10:54:36 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:37 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-93cd88cf-8f73-4365-a0a7-a95c8077ad9d tempest-VolumeDependencyTests-1299839671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210 1073741824" returned: 0 in 0.513s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-93cd88cf-8f73-4365-a0a7-a95c8077ad9d tempest-VolumeDependencyTests-1299839671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:37 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210 Jul 28 10:54:37 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:37 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9a09f1a0-93cc-4d10-8242-05d0cd848e28 tempest-CreateVolumesFromSnapshotTest-1608055624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213" returned: 0 in 0.431s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9a09f1a0-93cc-4d10-8242-05d0cd848e28 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213.3c32f852-bffb-4be3-8c98-023fbc751e0d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:37 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213.3c32f852-bffb-4be3-8c98-023fbc751e0d Jul 28 10:54:37 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:37 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-93cd88cf-8f73-4365-a0a7-a95c8077ad9d tempest-VolumeDependencyTests-1299839671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210" returned: 0 in 0.342s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:37 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-93cd88cf-8f73-4365-a0a7-a95c8077ad9d tempest-VolumeDependencyTests-1299839671 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:54:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-93cd88cf-8f73-4365-a0a7-a95c8077ad9d tempest-VolumeDependencyTests-1299839671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0cc658d5-bc62-4604-aad0-c433172427c7 tempest-CinderUnicodeTest-858828730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.784s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:37 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0cc658d5-bc62-4604-aad0-c433172427c7 tempest-CinderUnicodeTest-858828730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f14a06af-3b3a-4a6d-8376-447089320fb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c5a1a39141a4fd59fc9260e83aa492e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:36Z,use_quota=True,user_id='25633d62fe574c799dc0901529067f94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:54:37 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-0cc658d5-bc62-4604-aad0-c433172427c7 tempest-CinderUnicodeTest-858828730 None] Creating volume f14a06af-3b3a-4a6d-8376-447089320fb1 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:54:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0cc658d5-bc62-4604-aad0-c433172427c7 tempest-CinderUnicodeTest-858828730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0cc658d5-bc62-4604-aad0-c433172427c7 tempest-CinderUnicodeTest-858828730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:37 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0cc658d5-bc62-4604-aad0-c433172427c7 tempest-CinderUnicodeTest-858828730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:37 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0cc658d5-bc62-4604-aad0-c433172427c7 tempest-CinderUnicodeTest-858828730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0cc658d5-bc62-4604-aad0-c433172427c7 tempest-CinderUnicodeTest-858828730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:37 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0cc658d5-bc62-4604-aad0-c433172427c7 tempest-CinderUnicodeTest-858828730 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:54:37 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-0cc658d5-bc62-4604-aad0-c433172427c7 tempest-CinderUnicodeTest-858828730 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:54:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0cc658d5-bc62-4604-aad0-c433172427c7 tempest-CinderUnicodeTest-858828730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f14a06af-3b3a-4a6d-8376-447089320fb1 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:37 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-93cd88cf-8f73-4365-a0a7-a95c8077ad9d tempest-VolumeDependencyTests-1299839671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24e46dfb-9a6d-48f5-ab42-1a30d120af70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-045509ed-cc81-4691-9a72-45674353d210', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:37 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-93cd88cf-8f73-4365-a0a7-a95c8077ad9d tempest-VolumeDependencyTests-1299839671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3353d25b-880f-48f7-a9cb-65215f98c78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:37 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f14a06af-3b3a-4a6d-8376-447089320fb1 1073741824 Jul 28 10:54:37 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:37 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-93cd88cf-8f73-4365-a0a7-a95c8077ad9d tempest-VolumeDependencyTests-1299839671 None] Volume volume-045509ed-cc81-4691-9a72-45674353d210 (045509ed-cc81-4691-9a72-45674353d210): created successfully Jul 28 10:54:37 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-93cd88cf-8f73-4365-a0a7-a95c8077ad9d tempest-VolumeDependencyTests-1299839671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3353d25b-880f-48f7-a9cb-65215f98c78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:37 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-93cd88cf-8f73-4365-a0a7-a95c8077ad9d tempest-VolumeDependencyTests-1299839671 None] Flow 'volume_create_manager' (6dac7745-790b-478a-b2e3-659cfd987393) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:37 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-93cd88cf-8f73-4365-a0a7-a95c8077ad9d tempest-VolumeDependencyTests-1299839671 None] Created volume successfully. Jul 28 10:54:37 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9a09f1a0-93cc-4d10-8242-05d0cd848e28 tempest-CreateVolumesFromSnapshotTest-1608055624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213.3c32f852-bffb-4be3-8c98-023fbc751e0d" returned: 0 in 0.373s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9a09f1a0-93cc-4d10-8242-05d0cd848e28 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213.3c32f852-bffb-4be3-8c98-023fbc751e0d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:37 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213.3c32f852-bffb-4be3-8c98-023fbc751e0d Jul 28 10:54:37 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:37 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9a09f1a0-93cc-4d10-8242-05d0cd848e28 tempest-CreateVolumesFromSnapshotTest-1608055624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213.3c32f852-bffb-4be3-8c98-023fbc751e0d" returned: 0 in 0.263s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:37 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9a09f1a0-93cc-4d10-8242-05d0cd848e28 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "cinder-quobyte-3c32f852-bffb-4be3-8c98-023fbc751e0d" released by "_delete_snapshot" :: held 1.614s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:37 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:37 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9a09f1a0-93cc-4d10-8242-05d0cd848e28 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "cinder-quobyte-e203f27c-6e03-4139-afa9-7c4ee02da213" released by "delete_snapshot" :: held 1.640s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0cc658d5-bc62-4604-aad0-c433172427c7 tempest-CinderUnicodeTest-858828730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f14a06af-3b3a-4a6d-8376-447089320fb1 1073741824" returned: 0 in 0.441s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0cc658d5-bc62-4604-aad0-c433172427c7 tempest-CinderUnicodeTest-858828730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f14a06af-3b3a-4a6d-8376-447089320fb1 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:37 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f14a06af-3b3a-4a6d-8376-447089320fb1 Jul 28 10:54:37 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:37 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-9a09f1a0-93cc-4d10-8242-05d0cd848e28 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Created reservations ['b30fe62d-1a67-4c15-9843-91ab9ff13a2c', '8db965a6-983b-4fa7-a711-f33b07639486', 'a10cd099-4d1a-4a40-9b4a-438b4efa69a2', 'db7cf2f7-0728-4166-8b4c-c644cb031db8'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:54:38 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-9a09f1a0-93cc-4d10-8242-05d0cd848e28 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Delete snapshot completed successfully. Jul 28 10:54:38 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9a09f1a0-93cc-4d10-8242-05d0cd848e28 tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "cinder-3c32f852-bffb-4be3-8c98-023fbc751e0d-delete_snapshot" released by "delete_snapshot" :: held 1.791s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:38 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0cc658d5-bc62-4604-aad0-c433172427c7 tempest-CinderUnicodeTest-858828730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f14a06af-3b3a-4a6d-8376-447089320fb1" returned: 0 in 0.240s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:38 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0cc658d5-bc62-4604-aad0-c433172427c7 tempest-CinderUnicodeTest-858828730 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:54:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0cc658d5-bc62-4604-aad0-c433172427c7 tempest-CinderUnicodeTest-858828730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0cc658d5-bc62-4604-aad0-c433172427c7 tempest-CinderUnicodeTest-858828730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f02d04e4-f0af-47b9-aa71-d9d78dddf0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f14a06af-3b3a-4a6d-8376-447089320fb1', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0cc658d5-bc62-4604-aad0-c433172427c7 tempest-CinderUnicodeTest-858828730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0138c67-3b1e-43fc-9740-bc8d4564bd7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:38 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-0cc658d5-bc62-4604-aad0-c433172427c7 tempest-CinderUnicodeTest-858828730 None] Volume volume-f14a06af-3b3a-4a6d-8376-447089320fb1 (f14a06af-3b3a-4a6d-8376-447089320fb1): created successfully Jul 28 10:54:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0cc658d5-bc62-4604-aad0-c433172427c7 tempest-CinderUnicodeTest-858828730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0138c67-3b1e-43fc-9740-bc8d4564bd7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0cc658d5-bc62-4604-aad0-c433172427c7 tempest-CinderUnicodeTest-858828730 None] Flow 'volume_create_manager' (3eb63492-72a2-4776-b99d-5d074c3e2417) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:38 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-0cc658d5-bc62-4604-aad0-c433172427c7 tempest-CinderUnicodeTest-858828730 None] Created volume successfully. Jul 28 10:54:38 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ae64c74d-04ba-4a9a-ac67-ee5e24b03c2a tempest-CreateVolumesFromSnapshotTest-1608055624 None] Acquiring lock "cinder-e203f27c-6e03-4139-afa9-7c4ee02da213-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:38 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ae64c74d-04ba-4a9a-ac67-ee5e24b03c2a tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "cinder-e203f27c-6e03-4139-afa9-7c4ee02da213-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:38 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ae64c74d-04ba-4a9a-ac67-ee5e24b03c2a tempest-CreateVolumesFromSnapshotTest-1608055624 None] Acquiring lock "cinder-quobyte-e203f27c-6e03-4139-afa9-7c4ee02da213" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:38 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ae64c74d-04ba-4a9a-ac67-ee5e24b03c2a tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "cinder-quobyte-e203f27c-6e03-4139-afa9-7c4ee02da213" acquired by "delete_volume" :: waited 0.027s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3f1bec1e-2d15-43f4-9265-f2af42e214e0 tempest-VolumeDependencyTests-1299839671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3f1bec1e-2d15-43f4-9265-f2af42e214e0 tempest-VolumeDependencyTests-1299839671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:38 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac40c69e-f85f-484a-b76a-fe7851d8bc88]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ae64c74d-04ba-4a9a-ac67-ee5e24b03c2a tempest-CreateVolumesFromSnapshotTest-1608055624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:38 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-3f1bec1e-2d15-43f4-9265-f2af42e214e0 tempest-VolumeDependencyTests-1299839671 None] Creating offline snapshot f12a4457-7deb-4733-9be5-3a931bfa2fd4 of volume 045509ed-cc81-4691-9a72-45674353d210 {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:54:38 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[108af0c8-4a3c-46ac-bf0a-26e6d8c0c99a]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3f1bec1e-2d15-43f4-9265-f2af42e214e0 tempest-VolumeDependencyTests-1299839671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:38 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213 Jul 28 10:54:38 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:38 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210 Jul 28 10:54:38 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:39 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ae64c74d-04ba-4a9a-ac67-ee5e24b03c2a tempest-CreateVolumesFromSnapshotTest-1608055624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213" returned: 0 in 0.482s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ae64c74d-04ba-4a9a-ac67-ee5e24b03c2a tempest-CreateVolumesFromSnapshotTest-1608055624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:39 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213 Jul 28 10:54:39 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:39 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0c7d698-667f-4337-be9d-26aea72d16c3 tempest-CinderUnicodeTest-858828730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:54:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c0c7d698-667f-4337-be9d-26aea72d16c3 tempest-CinderUnicodeTest-858828730 None] Flow 'volume_create_manager' (57aa3374-0271-4a7b-a918-4c0495c008ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c0c7d698-667f-4337-be9d-26aea72d16c3 tempest-CinderUnicodeTest-858828730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (891e1d08-04fd-4b0a-b328-1ca3cc81998a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c0c7d698-667f-4337-be9d-26aea72d16c3 tempest-CinderUnicodeTest-858828730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (891e1d08-04fd-4b0a-b328-1ca3cc81998a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2115505653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85ea7e47-fe5e-4029-9086-c722939cbcd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c5a1a39141a4fd59fc9260e83aa492e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:39Z,use_quota=True,user_id='25633d62fe574c799dc0901529067f94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c0c7d698-667f-4337-be9d-26aea72d16c3 tempest-CinderUnicodeTest-858828730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (791a56b4-14ea-490f-b53d-7569ddb41cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c0c7d698-667f-4337-be9d-26aea72d16c3 tempest-CinderUnicodeTest-858828730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (791a56b4-14ea-490f-b53d-7569ddb41cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c0c7d698-667f-4337-be9d-26aea72d16c3 tempest-CinderUnicodeTest-858828730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94b6846-e72b-4d59-8ae2-68be7963ac3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c0c7d698-667f-4337-be9d-26aea72d16c3 tempest-CinderUnicodeTest-858828730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94b6846-e72b-4d59-8ae2-68be7963ac3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85ea7e47-fe5e-4029-9086-c722939cbcd0', 'volume_name': 'volume-85ea7e47-fe5e-4029-9086-c722939cbcd0', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c0c7d698-667f-4337-be9d-26aea72d16c3 tempest-CinderUnicodeTest-858828730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b121889d-6c9c-4a8d-9154-ec40376dda4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c0c7d698-667f-4337-be9d-26aea72d16c3 tempest-CinderUnicodeTest-858828730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b121889d-6c9c-4a8d-9154-ec40376dda4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:39 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:39 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c0c7d698-667f-4337-be9d-26aea72d16c3 tempest-CinderUnicodeTest-858828730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13e83b22-e411-4dba-8972-05a735cb8b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:39 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-c0c7d698-667f-4337-be9d-26aea72d16c3 tempest-CinderUnicodeTest-858828730 None] Volume 85ea7e47-fe5e-4029-9086-c722939cbcd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85ea7e47-fe5e-4029-9086-c722939cbcd0', 'volume_size': 1} Jul 28 10:54:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c0c7d698-667f-4337-be9d-26aea72d16c3 tempest-CinderUnicodeTest-858828730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3f1bec1e-2d15-43f4-9265-f2af42e214e0 tempest-VolumeDependencyTests-1299839671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210" returned: 0 in 0.544s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3f1bec1e-2d15-43f4-9265-f2af42e214e0 tempest-VolumeDependencyTests-1299839671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210.f12a4457-7deb-4733-9be5-3a931bfa2fd4 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:39 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210.f12a4457-7deb-4733-9be5-3a931bfa2fd4 1G Jul 28 10:54:39 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:39 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ae64c74d-04ba-4a9a-ac67-ee5e24b03c2a tempest-CreateVolumesFromSnapshotTest-1608055624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-e203f27c-6e03-4139-afa9-7c4ee02da213" returned: 0 in 0.329s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:39 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ae64c74d-04ba-4a9a-ac67-ee5e24b03c2a tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "cinder-quobyte-e203f27c-6e03-4139-afa9-7c4ee02da213" released by "delete_volume" :: held 0.908s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:39 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-ae64c74d-04ba-4a9a-ac67-ee5e24b03c2a tempest-CreateVolumesFromSnapshotTest-1608055624 None] Created reservations ['13e1b0c6-501a-4af6-a47f-286eb7a7cd61', '33044af9-b654-4533-8a67-cc283e096f09', '70701056-f5f0-4f98-b8aa-65932c93d022', 'e0dc26e6-bae1-4718-9a74-e4fe5f88f848'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:54:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ae64c74d-04ba-4a9a-ac67-ee5e24b03c2a tempest-CreateVolumesFromSnapshotTest-1608055624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ae64c74d-04ba-4a9a-ac67-ee5e24b03c2a tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:39 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-ae64c74d-04ba-4a9a-ac67-ee5e24b03c2a tempest-CreateVolumesFromSnapshotTest-1608055624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:39 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-ae64c74d-04ba-4a9a-ac67-ee5e24b03c2a tempest-CreateVolumesFromSnapshotTest-1608055624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ae64c74d-04ba-4a9a-ac67-ee5e24b03c2a tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ae64c74d-04ba-4a9a-ac67-ee5e24b03c2a tempest-CreateVolumesFromSnapshotTest-1608055624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:39 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:54:39 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:39 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3f1bec1e-2d15-43f4-9265-f2af42e214e0 tempest-VolumeDependencyTests-1299839671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210.f12a4457-7deb-4733-9be5-3a931bfa2fd4 1G" returned: 0 in 0.542s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3f1bec1e-2d15-43f4-9265-f2af42e214e0 tempest-VolumeDependencyTests-1299839671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-045509ed-cc81-4691-9a72-45674353d210 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210.f12a4457-7deb-4733-9be5-3a931bfa2fd4 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:39 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-045509ed-cc81-4691-9a72-45674353d210 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210.f12a4457-7deb-4733-9be5-3a931bfa2fd4 Jul 28 10:54:39 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:39 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ae64c74d-04ba-4a9a-ac67-ee5e24b03c2a tempest-CreateVolumesFromSnapshotTest-1608055624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.270s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:39 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-ae64c74d-04ba-4a9a-ac67-ee5e24b03c2a tempest-CreateVolumesFromSnapshotTest-1608055624 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:54:39 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-ae64c74d-04ba-4a9a-ac67-ee5e24b03c2a tempest-CreateVolumesFromSnapshotTest-1608055624 None] Deleted volume successfully. Jul 28 10:54:39 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ae64c74d-04ba-4a9a-ac67-ee5e24b03c2a tempest-CreateVolumesFromSnapshotTest-1608055624 None] Lock "cinder-e203f27c-6e03-4139-afa9-7c4ee02da213-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:40 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3f1bec1e-2d15-43f4-9265-f2af42e214e0 tempest-VolumeDependencyTests-1299839671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-045509ed-cc81-4691-9a72-45674353d210 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210.f12a4457-7deb-4733-9be5-3a931bfa2fd4" returned: 0 in 0.350s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:40 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-3f1bec1e-2d15-43f4-9265-f2af42e214e0 tempest-VolumeDependencyTests-1299839671 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210.f12a4457-7deb-4733-9be5-3a931bfa2fd4 is being set with open permissions: ugo+rw Jul 28 10:54:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3f1bec1e-2d15-43f4-9265-f2af42e214e0 tempest-VolumeDependencyTests-1299839671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210.f12a4457-7deb-4733-9be5-3a931bfa2fd4 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:40 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210.f12a4457-7deb-4733-9be5-3a931bfa2fd4 Jul 28 10:54:40 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:40 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3f1bec1e-2d15-43f4-9265-f2af42e214e0 tempest-VolumeDependencyTests-1299839671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210.f12a4457-7deb-4733-9be5-3a931bfa2fd4" returned: 0 in 0.277s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3f1bec1e-2d15-43f4-9265-f2af42e214e0 tempest-VolumeDependencyTests-1299839671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:40 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210.info Jul 28 10:54:40 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:40 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3f1bec1e-2d15-43f4-9265-f2af42e214e0 tempest-VolumeDependencyTests-1299839671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210.info" returned: 0 in 0.273s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:40 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-3f1bec1e-2d15-43f4-9265-f2af42e214e0 tempest-VolumeDependencyTests-1299839671 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210.info is being set with open permissions: ugo+rw Jul 28 10:54:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3f1bec1e-2d15-43f4-9265-f2af42e214e0 tempest-VolumeDependencyTests-1299839671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:40 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210.info Jul 28 10:54:40 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:40 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3f1bec1e-2d15-43f4-9265-f2af42e214e0 tempest-VolumeDependencyTests-1299839671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210.info" returned: 0 in 0.266s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3f1bec1e-2d15-43f4-9265-f2af42e214e0 tempest-VolumeDependencyTests-1299839671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.387s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c0c7d698-667f-4337-be9d-26aea72d16c3 tempest-CinderUnicodeTest-858828730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.774s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:41 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c0c7d698-667f-4337-be9d-26aea72d16c3 tempest-CinderUnicodeTest-858828730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2115505653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85ea7e47-fe5e-4029-9086-c722939cbcd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c5a1a39141a4fd59fc9260e83aa492e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:39Z,use_quota=True,user_id='25633d62fe574c799dc0901529067f94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:54:41 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-c0c7d698-667f-4337-be9d-26aea72d16c3 tempest-CinderUnicodeTest-858828730 None] Creating volume 85ea7e47-fe5e-4029-9086-c722939cbcd0 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:54:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c0c7d698-667f-4337-be9d-26aea72d16c3 tempest-CinderUnicodeTest-858828730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c0c7d698-667f-4337-be9d-26aea72d16c3 tempest-CinderUnicodeTest-858828730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:41 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c0c7d698-667f-4337-be9d-26aea72d16c3 tempest-CinderUnicodeTest-858828730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:41 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c0c7d698-667f-4337-be9d-26aea72d16c3 tempest-CinderUnicodeTest-858828730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c0c7d698-667f-4337-be9d-26aea72d16c3 tempest-CinderUnicodeTest-858828730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:41 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c0c7d698-667f-4337-be9d-26aea72d16c3 tempest-CinderUnicodeTest-858828730 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:54:41 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-c0c7d698-667f-4337-be9d-26aea72d16c3 tempest-CinderUnicodeTest-858828730 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:54:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c0c7d698-667f-4337-be9d-26aea72d16c3 tempest-CinderUnicodeTest-858828730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:41 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0 1073741824 Jul 28 10:54:41 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:41 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-3f1bec1e-2d15-43f4-9265-f2af42e214e0 tempest-VolumeDependencyTests-1299839671 None] Create snapshot completed successfully Jul 28 10:54:41 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c0c7d698-667f-4337-be9d-26aea72d16c3 tempest-CinderUnicodeTest-858828730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0 1073741824" returned: 0 in 0.551s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c0c7d698-667f-4337-be9d-26aea72d16c3 tempest-CinderUnicodeTest-858828730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:41 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0 Jul 28 10:54:41 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:41 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c0c7d698-667f-4337-be9d-26aea72d16c3 tempest-CinderUnicodeTest-858828730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0" returned: 0 in 0.304s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:41 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c0c7d698-667f-4337-be9d-26aea72d16c3 tempest-CinderUnicodeTest-858828730 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:54:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c0c7d698-667f-4337-be9d-26aea72d16c3 tempest-CinderUnicodeTest-858828730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c0c7d698-667f-4337-be9d-26aea72d16c3 tempest-CinderUnicodeTest-858828730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13e83b22-e411-4dba-8972-05a735cb8b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85ea7e47-fe5e-4029-9086-c722939cbcd0', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c0c7d698-667f-4337-be9d-26aea72d16c3 tempest-CinderUnicodeTest-858828730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c23925fb-a4b2-464e-9058-665425af4d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:41 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-c0c7d698-667f-4337-be9d-26aea72d16c3 tempest-CinderUnicodeTest-858828730 None] Volume volume-85ea7e47-fe5e-4029-9086-c722939cbcd0 (85ea7e47-fe5e-4029-9086-c722939cbcd0): created successfully Jul 28 10:54:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c0c7d698-667f-4337-be9d-26aea72d16c3 tempest-CinderUnicodeTest-858828730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c23925fb-a4b2-464e-9058-665425af4d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:41 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c0c7d698-667f-4337-be9d-26aea72d16c3 tempest-CinderUnicodeTest-858828730 None] Flow 'volume_create_manager' (57aa3374-0271-4a7b-a918-4c0495c008ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:42 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-c0c7d698-667f-4337-be9d-26aea72d16c3 tempest-CinderUnicodeTest-858828730 None] Created volume successfully. Jul 28 10:54:42 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:54:42 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Flow 'volume_create_manager' (1ab2c9eb-ebd8-4662-9a92-e2157667e239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:42 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5def9d7-e452-40c5-8af5-6be8109198c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:42 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5def9d7-e452-40c5-8af5-6be8109198c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-984497433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=446db6e1-95f9-48eb-88e1-eaceb89850db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0596b3437bca46e885410b38f4bedc12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f12a4457-7deb-4733-9be5-3a931bfa2fd4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:42Z,use_quota=True,user_id='382a8d47709446e3aad75ba1cdcdab70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:42 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (292cee37-45ad-4fb5-86cc-f6a696e806ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:42 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (292cee37-45ad-4fb5-86cc-f6a696e806ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:42 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5bee0ff-0610-442d-96b6-904763fbb2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:42 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5bee0ff-0610-442d-96b6-904763fbb2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '446db6e1-95f9-48eb-88e1-eaceb89850db', 'volume_name': 'volume-446db6e1-95f9-48eb-88e1-eaceb89850db', 'volume_size': 1, 'snapshot_id': 'f12a4457-7deb-4733-9be5-3a931bfa2fd4'}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:42 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55a57a26-3f8a-4b84-a4f0-493a9a97baa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:42 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55a57a26-3f8a-4b84-a4f0-493a9a97baa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:42 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e25c87be-28ef-4c13-b280-aff7baa1a2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:42 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Volume 446db6e1-95f9-48eb-88e1-eaceb89850db: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-446db6e1-95f9-48eb-88e1-eaceb89850db', 'volume_size': 1, 'snapshot_id': 'f12a4457-7deb-4733-9be5-3a931bfa2fd4'} Jul 28 10:54:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:42 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Acquiring lock "cinder-quobyte-f12a4457-7deb-4733-9be5-3a931bfa2fd4-446db6e1-95f9-48eb-88e1-eaceb89850db" by "_create_volume_from_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:42 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Lock "cinder-quobyte-f12a4457-7deb-4733-9be5-3a931bfa2fd4-446db6e1-95f9-48eb-88e1-eaceb89850db" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:42 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Creating volume 446db6e1-95f9-48eb-88e1-eaceb89850db from snapshot f12a4457-7deb-4733-9be5-3a931bfa2fd4 {{(pid=88413) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 28 10:54:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:42 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:42 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:42 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:54:42 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Acquiring lock "cinder-quobyte-446db6e1-95f9-48eb-88e1-eaceb89850db" by "_copy_volume_from_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:42 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Lock "cinder-quobyte-446db6e1-95f9-48eb-88e1-eaceb89850db" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:42 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] snapshot: f12a4457-7deb-4733-9be5-3a931bfa2fd4, volume: 446db6e1-95f9-48eb-88e1-eaceb89850db, {{(pid=88413) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 28 10:54:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:42 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:42 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:42 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[de08b038-c8dd-4848-bcb6-703dce50a983]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210.f12a4457-7deb-4733-9be5-3a931bfa2fd4 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ea8e718c-e0e5-43da-a953-391810de9092 tempest-CinderUnicodeTest-858828730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:42 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210.f12a4457-7deb-4733-9be5-3a931bfa2fd4 Jul 28 10:54:42 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:43 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210.f12a4457-7deb-4733-9be5-3a931bfa2fd4" returned: 0 in 0.473s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:43 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-045509ed-cc81-4691-9a72-45674353d210(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:54:43 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210 {{(pid=88413) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 28 10:54:43 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Creating direct copy from snapshot {{(pid=88413) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 28 10:54:43 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cac2b9c-0883-43dc-a471-29e5748078d7]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:43 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210 Jul 28 10:54:43 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:43 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210" returned: 0 in 0.435s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:43 devstack cinder-volume[88413]: DEBUG cinder.utils [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Path /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-446db6e1-95f9-48eb-88e1-eaceb89850db not found in is_blk_device check {{(pid=88413) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 28 10:54:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-446db6e1-95f9-48eb-88e1-eaceb89850db {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:43 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-446db6e1-95f9-48eb-88e1-eaceb89850db Jul 28 10:54:43 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:48 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-446db6e1-95f9-48eb-88e1-eaceb89850db" returned: 0 in 5.108s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:48 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c95a13-f50c-4a95-9e93-130c609becab]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:48 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210 Jul 28 10:54:48 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:49 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210" returned: 0 in 0.566s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:49 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210, size 1024.00 MB, duration 5.11 sec, destination /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-446db6e1-95f9-48eb-88e1-eaceb89850db {{(pid=88413) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 10:54:49 devstack cinder-volume[88413]: INFO cinder.image.image_utils [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Converted 1024.00 MB image at 200.44 MB/s Jul 28 10:54:49 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-446db6e1-95f9-48eb-88e1-eaceb89850db is being set with open permissions: ugo+rw Jul 28 10:54:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-446db6e1-95f9-48eb-88e1-eaceb89850db {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:49 devstack sudo[107381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-446db6e1-95f9-48eb-88e1-eaceb89850db Jul 28 10:54:49 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:49 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-446db6e1-95f9-48eb-88e1-eaceb89850db" returned: 0 in 0.269s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:49 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Lock "cinder-quobyte-446db6e1-95f9-48eb-88e1-eaceb89850db" released by "_copy_volume_from_snapshot" :: held 6.971s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:49 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Lock "cinder-quobyte-f12a4457-7deb-4733-9be5-3a931bfa2fd4-446db6e1-95f9-48eb-88e1-eaceb89850db" released by "_create_volume_from_snapshot" :: held 7.014s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.037s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ea8e718c-e0e5-43da-a953-391810de9092 tempest-CinderUnicodeTest-858828730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.816s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:49 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-ea8e718c-e0e5-43da-a953-391810de9092 tempest-CinderUnicodeTest-858828730 None] Creating offline snapshot 3292ffcc-2620-4323-83cb-b2ee447047e0 of volume 85ea7e47-fe5e-4029-9086-c722939cbcd0 {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:54:49 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e25c87be-28ef-4c13-b280-aff7baa1a2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-446db6e1-95f9-48eb-88e1-eaceb89850db', 'volume_size': 1, 'snapshot_id': 'f12a4457-7deb-4733-9be5-3a931bfa2fd4'}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:49 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef8bf7dc-04ce-4832-b5e5-bc5cd091bc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:49 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5c514c-a78c-42ca-859c-ea784677d4ef]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ea8e718c-e0e5-43da-a953-391810de9092 tempest-CinderUnicodeTest-858828730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:49 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Volume volume-446db6e1-95f9-48eb-88e1-eaceb89850db (446db6e1-95f9-48eb-88e1-eaceb89850db): created successfully Jul 28 10:54:49 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef8bf7dc-04ce-4832-b5e5-bc5cd091bc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:49 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Flow 'volume_create_manager' (1ab2c9eb-ebd8-4662-9a92-e2157667e239) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:49 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-3d78c6b4-0620-441b-9270-a4c4eef79174 tempest-VolumeDependencyTests-1299839671 None] Created volume successfully. Jul 28 10:54:49 devstack sudo[107384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0 Jul 28 10:54:49 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:50 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ea8e718c-e0e5-43da-a953-391810de9092 tempest-CinderUnicodeTest-858828730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0" returned: 0 in 0.415s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ea8e718c-e0e5-43da-a953-391810de9092 tempest-CinderUnicodeTest-858828730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0.3292ffcc-2620-4323-83cb-b2ee447047e0 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:50 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0.3292ffcc-2620-4323-83cb-b2ee447047e0 1G Jul 28 10:54:50 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b34d7320-2b0d-470e-9411-d10056ec3f53 tempest-VolumeDependencyTests-1299839671 None] Acquiring lock "cinder-f12a4457-7deb-4733-9be5-3a931bfa2fd4-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b34d7320-2b0d-470e-9411-d10056ec3f53 tempest-VolumeDependencyTests-1299839671 None] Lock "cinder-f12a4457-7deb-4733-9be5-3a931bfa2fd4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b34d7320-2b0d-470e-9411-d10056ec3f53 tempest-VolumeDependencyTests-1299839671 None] Acquiring lock "cinder-quobyte-045509ed-cc81-4691-9a72-45674353d210" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:50 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:54:50 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Flow 'volume_create_manager' (4ebc7c13-1593-489d-97d9-644b25a37f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:50 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:50 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e1a34d7-d09f-46a5-9276-14ecc3b0b0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ea8e718c-e0e5-43da-a953-391810de9092 tempest-CinderUnicodeTest-858828730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0.3292ffcc-2620-4323-83cb-b2ee447047e0 1G" returned: 0 in 0.560s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ea8e718c-e0e5-43da-a953-391810de9092 tempest-CinderUnicodeTest-858828730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85ea7e47-fe5e-4029-9086-c722939cbcd0 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0.3292ffcc-2620-4323-83cb-b2ee447047e0 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b34d7320-2b0d-470e-9411-d10056ec3f53 tempest-VolumeDependencyTests-1299839671 None] Lock "cinder-quobyte-045509ed-cc81-4691-9a72-45674353d210" acquired by "delete_snapshot" :: waited 0.057s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b34d7320-2b0d-470e-9411-d10056ec3f53 tempest-VolumeDependencyTests-1299839671 None] Acquiring lock "cinder-quobyte-f12a4457-7deb-4733-9be5-3a931bfa2fd4" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:50 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85ea7e47-fe5e-4029-9086-c722939cbcd0 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0.3292ffcc-2620-4323-83cb-b2ee447047e0 Jul 28 10:54:50 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:50 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e1a34d7-d09f-46a5-9276-14ecc3b0b0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95428d34-2951-4a92-ac6b-02c407aabf6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55b3cc8b2afa44658812705e1eb76309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:50Z,use_quota=True,user_id='369902bce17a49879b4440bc258848a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:50 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c2c48c9-1331-4a29-813f-bbaedd390733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:50 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c2c48c9-1331-4a29-813f-bbaedd390733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:50 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28f4d301-d0d1-4956-afa7-5582c0b64848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:50 devstack cinder-volume[88413]: DEBUG cinder.image.glance [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Creating Keystone auth plugin from conf {{(pid=88413) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 28 10:54:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b34d7320-2b0d-470e-9411-d10056ec3f53 tempest-VolumeDependencyTests-1299839671 None] Lock "cinder-quobyte-f12a4457-7deb-4733-9be5-3a931bfa2fd4" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:50 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-b34d7320-2b0d-470e-9411-d10056ec3f53 tempest-VolumeDependencyTests-1299839671 None] Deleting offline snapshot f12a4457-7deb-4733-9be5-3a931bfa2fd4 of volume 045509ed-cc81-4691-9a72-45674353d210 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:54:50 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-b34d7320-2b0d-470e-9411-d10056ec3f53 tempest-VolumeDependencyTests-1299839671 None] snapshot_file for this snap is: volume-045509ed-cc81-4691-9a72-45674353d210.f12a4457-7deb-4733-9be5-3a931bfa2fd4 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:54:50 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3af925-3acc-427a-8dc5-5044d0684580]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b34d7320-2b0d-470e-9411-d10056ec3f53 tempest-VolumeDependencyTests-1299839671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210.f12a4457-7deb-4733-9be5-3a931bfa2fd4 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:50 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210.f12a4457-7deb-4733-9be5-3a931bfa2fd4 Jul 28 10:54:50 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:50 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ea8e718c-e0e5-43da-a953-391810de9092 tempest-CinderUnicodeTest-858828730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85ea7e47-fe5e-4029-9086-c722939cbcd0 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0.3292ffcc-2620-4323-83cb-b2ee447047e0" returned: 0 in 0.370s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:50 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-ea8e718c-e0e5-43da-a953-391810de9092 tempest-CinderUnicodeTest-858828730 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0.3292ffcc-2620-4323-83cb-b2ee447047e0 is being set with open permissions: ugo+rw Jul 28 10:54:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ea8e718c-e0e5-43da-a953-391810de9092 tempest-CinderUnicodeTest-858828730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0.3292ffcc-2620-4323-83cb-b2ee447047e0 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:51 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0.3292ffcc-2620-4323-83cb-b2ee447047e0 Jul 28 10:54:51 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28f4d301-d0d1-4956-afa7-5582c0b64848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '95428d34-2951-4a92-ac6b-02c407aabf6f', 'volume_name': 'volume-95428d34-2951-4a92-ac6b-02c407aabf6f', 'volume_size': 1, 'image_id': 'b8eee502-1932-4ebb-97ce-e77ed7c7e406', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b8eee502-1932-4ebb-97ce-e77ed7c7e406', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9316e195d0672095864a956e5cb68a24', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '55b3cc8b2afa44658812705e1eb76309', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9db8fd59fbf3da9bc09f2b296f7dbfb22007ea2eb16dfcb67e301a1b246eff7e9140ff342e993bbe1dd310664d38a146422d65897d7a05789566f021e388d0ff', 'id': 'b8eee502-1932-4ebb-97ce-e77ed7c7e406', 'created_at': datetime.datetime(2026, 7, 28, 8, 54, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 8, 54, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b8eee502-1932-4ebb-97ce-e77ed7c7e406/file', 'properties': {}}, 'image_service': }' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b670708-4bd5-4250-be41-850dd73bbb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b670708-4bd5-4250-be41-850dd73bbb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f7800a5-de2c-48a1-9c22-45b62fd75413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:51 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Volume 95428d34-2951-4a92-ac6b-02c407aabf6f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-95428d34-2951-4a92-ac6b-02c407aabf6f', 'volume_size': 1, 'image_id': 'b8eee502-1932-4ebb-97ce-e77ed7c7e406', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b8eee502-1932-4ebb-97ce-e77ed7c7e406', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9316e195d0672095864a956e5cb68a24', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '55b3cc8b2afa44658812705e1eb76309', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9db8fd59fbf3da9bc09f2b296f7dbfb22007ea2eb16dfcb67e301a1b246eff7e9140ff342e993bbe1dd310664d38a146422d65897d7a05789566f021e388d0ff', 'id': 'b8eee502-1932-4ebb-97ce-e77ed7c7e406', 'created_at': datetime.datetime(2026, 7, 28, 8, 54, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 8, 54, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b8eee502-1932-4ebb-97ce-e77ed7c7e406/file', 'properties': {}}, 'image_service': } Jul 28 10:54:51 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Trying to clone 95428d34-2951-4a92-ac6b-02c407aabf6f from image b8eee502-1932-4ebb-97ce-e77ed7c7e406 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b8eee502-1932-4ebb-97ce-e77ed7c7e406', 'metadata': {}}]). {{(pid=88413) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 28 10:54:51 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b34d7320-2b0d-470e-9411-d10056ec3f53 tempest-VolumeDependencyTests-1299839671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210.f12a4457-7deb-4733-9be5-3a931bfa2fd4" returned: 0 in 0.464s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:51 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-b34d7320-2b0d-470e-9411-d10056ec3f53 tempest-VolumeDependencyTests-1299839671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-045509ed-cc81-4691-9a72-45674353d210(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:54:51 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b8eee502-1932-4ebb-97ce-e77ed7c7e406_6m3skmpidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88413) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 28 10:54:51 devstack cinder-volume[88413]: INFO cinder.image.image_utils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Image download 0.00 MB at 0.00 MB/s Jul 28 10:54:51 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e0bc18-16c6-432f-a913-1c37fa4b15d3]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b34d7320-2b0d-470e-9411-d10056ec3f53 tempest-VolumeDependencyTests-1299839671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:51 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d4c92f-87b7-43c8-8ef9-26ca4b700541]: (4, 'raw') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8eee502-1932-4ebb-97ce-e77ed7c7e406_6m3skmpidevstack@QuobyteHD {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:51 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ea8e718c-e0e5-43da-a953-391810de9092 tempest-CinderUnicodeTest-858828730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0.3292ffcc-2620-4323-83cb-b2ee447047e0" returned: 0 in 0.366s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:51 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210 Jul 28 10:54:51 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ea8e718c-e0e5-43da-a953-391810de9092 tempest-CinderUnicodeTest-858828730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:51 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0.info Jul 28 10:54:51 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:51 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8eee502-1932-4ebb-97ce-e77ed7c7e406_6m3skmpidevstack@QuobyteHD Jul 28 10:54:51 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:51 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b34d7320-2b0d-470e-9411-d10056ec3f53 tempest-VolumeDependencyTests-1299839671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210" returned: 0 in 0.467s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b34d7320-2b0d-470e-9411-d10056ec3f53 tempest-VolumeDependencyTests-1299839671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210.f12a4457-7deb-4733-9be5-3a931bfa2fd4 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:51 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ea8e718c-e0e5-43da-a953-391810de9092 tempest-CinderUnicodeTest-858828730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0.info" returned: 0 in 0.328s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:51 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-ea8e718c-e0e5-43da-a953-391810de9092 tempest-CinderUnicodeTest-858828730 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0.info is being set with open permissions: ugo+rw Jul 28 10:54:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ea8e718c-e0e5-43da-a953-391810de9092 tempest-CinderUnicodeTest-858828730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:51 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210.f12a4457-7deb-4733-9be5-3a931bfa2fd4 Jul 28 10:54:51 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:51 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0.info Jul 28 10:54:51 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:51 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8eee502-1932-4ebb-97ce-e77ed7c7e406_6m3skmpidevstack@QuobyteHD" returned: 0 in 0.497s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8eee502-1932-4ebb-97ce-e77ed7c7e406_6m3skmpidevstack@QuobyteHD {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:51 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8eee502-1932-4ebb-97ce-e77ed7c7e406_6m3skmpidevstack@QuobyteHD Jul 28 10:54:51 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:52 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ea8e718c-e0e5-43da-a953-391810de9092 tempest-CinderUnicodeTest-858828730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0.info" returned: 0 in 0.287s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ea8e718c-e0e5-43da-a953-391810de9092 tempest-CinderUnicodeTest-858828730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.469s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:52 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-ea8e718c-e0e5-43da-a953-391810de9092 tempest-CinderUnicodeTest-858828730 None] Create snapshot completed successfully Jul 28 10:54:52 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b34d7320-2b0d-470e-9411-d10056ec3f53 tempest-VolumeDependencyTests-1299839671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210.f12a4457-7deb-4733-9be5-3a931bfa2fd4" returned: 0 in 0.428s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b34d7320-2b0d-470e-9411-d10056ec3f53 tempest-VolumeDependencyTests-1299839671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210.f12a4457-7deb-4733-9be5-3a931bfa2fd4 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:52 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:52 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210.f12a4457-7deb-4733-9be5-3a931bfa2fd4 Jul 28 10:54:52 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8eee502-1932-4ebb-97ce-e77ed7c7e406_6m3skmpidevstack@QuobyteHD" returned: 1 in 0.371s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8eee502-1932-4ebb-97ce-e77ed7c7e406_6m3skmpidevstack@QuobyteHD' failed. Not Retrying. {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 10:54:52 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Temporary image b8eee502-1932-4ebb-97ce-e77ed7c7e406 is fetched for user 369902bce17a49879b4440bc258848a3. {{(pid=88413) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 28 10:54:52 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[07735999-869a-491a-b9d0-40ec383f1d80]: (4, 'raw') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8eee502-1932-4ebb-97ce-e77ed7c7e406_6m3skmpidevstack@QuobyteHD {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:52 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8eee502-1932-4ebb-97ce-e77ed7c7e406_6m3skmpidevstack@QuobyteHD Jul 28 10:54:52 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:52 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b34d7320-2b0d-470e-9411-d10056ec3f53 tempest-VolumeDependencyTests-1299839671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210.f12a4457-7deb-4733-9be5-3a931bfa2fd4" returned: 0 in 0.275s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:52 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b34d7320-2b0d-470e-9411-d10056ec3f53 tempest-VolumeDependencyTests-1299839671 None] Lock "cinder-quobyte-f12a4457-7deb-4733-9be5-3a931bfa2fd4" released by "_delete_snapshot" :: held 1.788s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:52 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b34d7320-2b0d-470e-9411-d10056ec3f53 tempest-VolumeDependencyTests-1299839671 None] Lock "cinder-quobyte-045509ed-cc81-4691-9a72-45674353d210" released by "delete_snapshot" :: held 1.859s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:52 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4ff71d3c-e2fe-407b-a136-0f3468959653 tempest-CinderUnicodeTest-858828730 None] Acquiring lock "cinder-3292ffcc-2620-4323-83cb-b2ee447047e0-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:52 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-b34d7320-2b0d-470e-9411-d10056ec3f53 tempest-VolumeDependencyTests-1299839671 None] Created reservations ['f287267e-b486-4fb0-8437-d7026eadd3f7', 'c1f34f3d-b44a-4ab4-8d8b-ee9a8d20c82c', '3f064033-d962-419f-a743-e70d4f2b74b2', '0ab55c51-b47f-4fa9-85d6-322090bc057c'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:54:52 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4ff71d3c-e2fe-407b-a136-0f3468959653 tempest-CinderUnicodeTest-858828730 None] Lock "cinder-3292ffcc-2620-4323-83cb-b2ee447047e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:52 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4ff71d3c-e2fe-407b-a136-0f3468959653 tempest-CinderUnicodeTest-858828730 None] Acquiring lock "cinder-quobyte-85ea7e47-fe5e-4029-9086-c722939cbcd0" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:52 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8eee502-1932-4ebb-97ce-e77ed7c7e406_6m3skmpidevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:52 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4ff71d3c-e2fe-407b-a136-0f3468959653 tempest-CinderUnicodeTest-858828730 None] Lock "cinder-quobyte-85ea7e47-fe5e-4029-9086-c722939cbcd0" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:52 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4ff71d3c-e2fe-407b-a136-0f3468959653 tempest-CinderUnicodeTest-858828730 None] Acquiring lock "cinder-quobyte-3292ffcc-2620-4323-83cb-b2ee447047e0" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8eee502-1932-4ebb-97ce-e77ed7c7e406_6m3skmpidevstack@QuobyteHD {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:52 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4ff71d3c-e2fe-407b-a136-0f3468959653 tempest-CinderUnicodeTest-858828730 None] Lock "cinder-quobyte-3292ffcc-2620-4323-83cb-b2ee447047e0" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:52 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-4ff71d3c-e2fe-407b-a136-0f3468959653 tempest-CinderUnicodeTest-858828730 None] Deleting offline snapshot 3292ffcc-2620-4323-83cb-b2ee447047e0 of volume 85ea7e47-fe5e-4029-9086-c722939cbcd0 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:54:52 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-4ff71d3c-e2fe-407b-a136-0f3468959653 tempest-CinderUnicodeTest-858828730 None] snapshot_file for this snap is: volume-85ea7e47-fe5e-4029-9086-c722939cbcd0.3292ffcc-2620-4323-83cb-b2ee447047e0 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:54:52 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[810012fa-3cc3-48c1-93f6-af251b26d5fb]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4ff71d3c-e2fe-407b-a136-0f3468959653 tempest-CinderUnicodeTest-858828730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0.3292ffcc-2620-4323-83cb-b2ee447047e0 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:52 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-eb9ffa28-ac21-495b-9523-759f21b7cfdd tempest-VolumeDependencyTests-1299839671 None] Acquiring lock "cinder-045509ed-cc81-4691-9a72-45674353d210-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:52 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-b34d7320-2b0d-470e-9411-d10056ec3f53 tempest-VolumeDependencyTests-1299839671 None] Delete snapshot completed successfully. Jul 28 10:54:52 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-eb9ffa28-ac21-495b-9523-759f21b7cfdd tempest-VolumeDependencyTests-1299839671 None] Lock "cinder-045509ed-cc81-4691-9a72-45674353d210-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:52 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8eee502-1932-4ebb-97ce-e77ed7c7e406_6m3skmpidevstack@QuobyteHD Jul 28 10:54:52 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:52 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b34d7320-2b0d-470e-9411-d10056ec3f53 tempest-VolumeDependencyTests-1299839671 None] Lock "cinder-f12a4457-7deb-4733-9be5-3a931bfa2fd4-delete_snapshot" released by "delete_snapshot" :: held 2.245s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:52 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-eb9ffa28-ac21-495b-9523-759f21b7cfdd tempest-VolumeDependencyTests-1299839671 None] Acquiring lock "cinder-quobyte-045509ed-cc81-4691-9a72-45674353d210" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:52 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-eb9ffa28-ac21-495b-9523-759f21b7cfdd tempest-VolumeDependencyTests-1299839671 None] Lock "cinder-quobyte-045509ed-cc81-4691-9a72-45674353d210" acquired by "delete_volume" :: waited 0.019s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:52 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0.3292ffcc-2620-4323-83cb-b2ee447047e0 Jul 28 10:54:52 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:52 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9427265-c88a-409b-ae23-f98350e95397]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-eb9ffa28-ac21-495b-9523-759f21b7cfdd tempest-VolumeDependencyTests-1299839671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:53 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8eee502-1932-4ebb-97ce-e77ed7c7e406_6m3skmpidevstack@QuobyteHD" returned: 1 in 0.450s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8eee502-1932-4ebb-97ce-e77ed7c7e406_6m3skmpidevstack@QuobyteHD' failed. Not Retrying. {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 10:54:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:53 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95428d34-2951-4a92-ac6b-02c407aabf6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55b3cc8b2afa44658812705e1eb76309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:54:50Z,use_quota=True,user_id='369902bce17a49879b4440bc258848a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:54:53 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Creating volume 95428d34-2951-4a92-ac6b-02c407aabf6f {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:54:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:53 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:53 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:53 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:54:53 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:54:53 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210 Jul 28 10:54:53 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-95428d34-2951-4a92-ac6b-02c407aabf6f 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:53 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-95428d34-2951-4a92-ac6b-02c407aabf6f 1073741824 Jul 28 10:54:53 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:53 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4ff71d3c-e2fe-407b-a136-0f3468959653 tempest-CinderUnicodeTest-858828730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0.3292ffcc-2620-4323-83cb-b2ee447047e0" returned: 0 in 0.480s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:53 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-4ff71d3c-e2fe-407b-a136-0f3468959653 tempest-CinderUnicodeTest-858828730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85ea7e47-fe5e-4029-9086-c722939cbcd0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:54:53 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[61563139-eeb8-473a-8539-4a753287135a]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4ff71d3c-e2fe-407b-a136-0f3468959653 tempest-CinderUnicodeTest-858828730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:53 devstack sudo[107457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0 Jul 28 10:54:53 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:53 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-eb9ffa28-ac21-495b-9523-759f21b7cfdd tempest-VolumeDependencyTests-1299839671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210" returned: 0 in 0.455s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-eb9ffa28-ac21-495b-9523-759f21b7cfdd tempest-VolumeDependencyTests-1299839671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:53 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210 Jul 28 10:54:53 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:53 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-95428d34-2951-4a92-ac6b-02c407aabf6f 1073741824" returned: 0 in 0.581s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:53 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-eb9ffa28-ac21-495b-9523-759f21b7cfdd tempest-VolumeDependencyTests-1299839671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-045509ed-cc81-4691-9a72-45674353d210" returned: 0 in 0.303s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:53 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-eb9ffa28-ac21-495b-9523-759f21b7cfdd tempest-VolumeDependencyTests-1299839671 None] Lock "cinder-quobyte-045509ed-cc81-4691-9a72-45674353d210" released by "delete_volume" :: held 0.851s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:53 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4ff71d3c-e2fe-407b-a136-0f3468959653 tempest-CinderUnicodeTest-858828730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0" returned: 0 in 0.509s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4ff71d3c-e2fe-407b-a136-0f3468959653 tempest-CinderUnicodeTest-858828730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0.3292ffcc-2620-4323-83cb-b2ee447047e0 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-95428d34-2951-4a92-ac6b-02c407aabf6f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:53 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0.3292ffcc-2620-4323-83cb-b2ee447047e0 Jul 28 10:54:53 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:53 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-95428d34-2951-4a92-ac6b-02c407aabf6f Jul 28 10:54:53 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:53 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-eb9ffa28-ac21-495b-9523-759f21b7cfdd tempest-VolumeDependencyTests-1299839671 None] Created reservations ['edc2a8f7-cd19-4c62-b764-93575ffa75ab', 'dbecbedb-9f5d-45f7-8fa0-a195fca9ccd1', '0ce190ae-c553-4f5d-9027-786223eb4eb6', '2b9166f0-18a7-4f84-a7b4-eafd94ba9de9'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:54:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-eb9ffa28-ac21-495b-9523-759f21b7cfdd tempest-VolumeDependencyTests-1299839671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-eb9ffa28-ac21-495b-9523-759f21b7cfdd tempest-VolumeDependencyTests-1299839671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:53 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-eb9ffa28-ac21-495b-9523-759f21b7cfdd tempest-VolumeDependencyTests-1299839671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:53 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-eb9ffa28-ac21-495b-9523-759f21b7cfdd tempest-VolumeDependencyTests-1299839671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-eb9ffa28-ac21-495b-9523-759f21b7cfdd tempest-VolumeDependencyTests-1299839671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-eb9ffa28-ac21-495b-9523-759f21b7cfdd tempest-VolumeDependencyTests-1299839671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:53 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:54:53 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:54 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b0294b87-bb7d-436e-a253-51cd1b6c1af7 tempest-VolumeDependencyTests-1299839671 None] Acquiring lock "cinder-446db6e1-95f9-48eb-88e1-eaceb89850db-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:54 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b0294b87-bb7d-436e-a253-51cd1b6c1af7 tempest-VolumeDependencyTests-1299839671 None] Lock "cinder-446db6e1-95f9-48eb-88e1-eaceb89850db-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:54 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b0294b87-bb7d-436e-a253-51cd1b6c1af7 tempest-VolumeDependencyTests-1299839671 None] Acquiring lock "cinder-quobyte-446db6e1-95f9-48eb-88e1-eaceb89850db" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:54 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b0294b87-bb7d-436e-a253-51cd1b6c1af7 tempest-VolumeDependencyTests-1299839671 None] Lock "cinder-quobyte-446db6e1-95f9-48eb-88e1-eaceb89850db" acquired by "delete_volume" :: waited 0.026s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:54 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-95428d34-2951-4a92-ac6b-02c407aabf6f" returned: 0 in 0.378s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:54 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:54:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:54 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e927c7f-8a41-4047-9df7-b79db61912bd]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b0294b87-bb7d-436e-a253-51cd1b6c1af7 tempest-VolumeDependencyTests-1299839671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-446db6e1-95f9-48eb-88e1-eaceb89850db {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:54 devstack cinder-volume[88413]: DEBUG cinder.volume.volume_utils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Attempting download of b8eee502-1932-4ebb-97ce-e77ed7c7e406 ((None, [{'url': 'file:///opt/stack/data/glance/images/b8eee502-1932-4ebb-97ce-e77ed7c7e406', 'metadata': {}}])) to volume 95428d34-2951-4a92-ac6b-02c407aabf6f. {{(pid=88413) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 28 10:54:54 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a6f461-813c-4c08-a7c6-3b8b04814856]: (4, 'raw') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b8eee502-1932-4ebb-97ce-e77ed7c7e406_1kxjf_3s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:54 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4ff71d3c-e2fe-407b-a136-0f3468959653 tempest-CinderUnicodeTest-858828730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0.3292ffcc-2620-4323-83cb-b2ee447047e0" returned: 0 in 0.538s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4ff71d3c-e2fe-407b-a136-0f3468959653 tempest-CinderUnicodeTest-858828730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0.3292ffcc-2620-4323-83cb-b2ee447047e0 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:54 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0.3292ffcc-2620-4323-83cb-b2ee447047e0 Jul 28 10:54:54 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:54 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:54 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-446db6e1-95f9-48eb-88e1-eaceb89850db Jul 28 10:54:54 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-eb9ffa28-ac21-495b-9523-759f21b7cfdd tempest-VolumeDependencyTests-1299839671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.421s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:54 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-eb9ffa28-ac21-495b-9523-759f21b7cfdd tempest-VolumeDependencyTests-1299839671 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:54:54 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-eb9ffa28-ac21-495b-9523-759f21b7cfdd tempest-VolumeDependencyTests-1299839671 None] Deleted volume successfully. Jul 28 10:54:54 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-eb9ffa28-ac21-495b-9523-759f21b7cfdd tempest-VolumeDependencyTests-1299839671 None] Lock "cinder-045509ed-cc81-4691-9a72-45674353d210-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:54 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b8eee502-1932-4ebb-97ce-e77ed7c7e406_1kxjf_3s Jul 28 10:54:54 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:54 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4ff71d3c-e2fe-407b-a136-0f3468959653 tempest-CinderUnicodeTest-858828730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0.3292ffcc-2620-4323-83cb-b2ee447047e0" returned: 0 in 0.285s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:54 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4ff71d3c-e2fe-407b-a136-0f3468959653 tempest-CinderUnicodeTest-858828730 None] Lock "cinder-quobyte-3292ffcc-2620-4323-83cb-b2ee447047e0" released by "_delete_snapshot" :: held 1.962s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:54 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4ff71d3c-e2fe-407b-a136-0f3468959653 tempest-CinderUnicodeTest-858828730 None] Lock "cinder-quobyte-85ea7e47-fe5e-4029-9086-c722939cbcd0" released by "delete_snapshot" :: held 2.024s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:54 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b8eee502-1932-4ebb-97ce-e77ed7c7e406_1kxjf_3s" returned: 0 in 0.445s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8eee502-1932-4ebb-97ce-e77ed7c7e406_1kxjf_3s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:54 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b0294b87-bb7d-436e-a253-51cd1b6c1af7 tempest-VolumeDependencyTests-1299839671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-446db6e1-95f9-48eb-88e1-eaceb89850db" returned: 0 in 0.568s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b0294b87-bb7d-436e-a253-51cd1b6c1af7 tempest-VolumeDependencyTests-1299839671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-446db6e1-95f9-48eb-88e1-eaceb89850db {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:54 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-4ff71d3c-e2fe-407b-a136-0f3468959653 tempest-CinderUnicodeTest-858828730 None] Created reservations ['ee013e64-4e97-4363-9afa-a1ff7f3b8425', 'd3a62f38-1b67-454c-9216-7617ec12d444', 'c00299c8-87d9-47aa-90e4-d30143f1db89', '4eb0bcd9-4765-4493-8349-e54324745bda'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:54:54 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-446db6e1-95f9-48eb-88e1-eaceb89850db Jul 28 10:54:54 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:54 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-4ff71d3c-e2fe-407b-a136-0f3468959653 tempest-CinderUnicodeTest-858828730 None] Delete snapshot completed successfully. Jul 28 10:54:54 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8eee502-1932-4ebb-97ce-e77ed7c7e406_1kxjf_3s Jul 28 10:54:54 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:54 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4ff71d3c-e2fe-407b-a136-0f3468959653 tempest-CinderUnicodeTest-858828730 None] Lock "cinder-3292ffcc-2620-4323-83cb-b2ee447047e0-delete_snapshot" released by "delete_snapshot" :: held 2.274s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:55 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b0294b87-bb7d-436e-a253-51cd1b6c1af7 tempest-VolumeDependencyTests-1299839671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-446db6e1-95f9-48eb-88e1-eaceb89850db" returned: 0 in 0.303s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:55 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b0294b87-bb7d-436e-a253-51cd1b6c1af7 tempest-VolumeDependencyTests-1299839671 None] Lock "cinder-quobyte-446db6e1-95f9-48eb-88e1-eaceb89850db" released by "delete_volume" :: held 0.914s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:55 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8eee502-1932-4ebb-97ce-e77ed7c7e406_1kxjf_3s" returned: 1 in 0.375s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8eee502-1932-4ebb-97ce-e77ed7c7e406_1kxjf_3s' failed. Not Retrying. {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 10:54:55 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ed743b-bb1a-4787-aa73-7cb0663b0fa2]: (4, 'raw') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8eee502-1932-4ebb-97ce-e77ed7c7e406_6m3skmpidevstack@QuobyteHD {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:55 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-b0294b87-bb7d-436e-a253-51cd1b6c1af7 tempest-VolumeDependencyTests-1299839671 None] Created reservations ['5ece3d3c-f62a-4acc-b75c-c4e28860bf96', '40b75b41-0f9e-41b3-ae1f-a4a19a11a63a', '3fe79de7-4b6c-4804-abcd-0633893578da', '423b4ec2-7b9c-42ad-998f-2512c51effdd'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:54:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b0294b87-bb7d-436e-a253-51cd1b6c1af7 tempest-VolumeDependencyTests-1299839671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b0294b87-bb7d-436e-a253-51cd1b6c1af7 tempest-VolumeDependencyTests-1299839671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:55 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b0294b87-bb7d-436e-a253-51cd1b6c1af7 tempest-VolumeDependencyTests-1299839671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:55 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b0294b87-bb7d-436e-a253-51cd1b6c1af7 tempest-VolumeDependencyTests-1299839671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b0294b87-bb7d-436e-a253-51cd1b6c1af7 tempest-VolumeDependencyTests-1299839671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b0294b87-bb7d-436e-a253-51cd1b6c1af7 tempest-VolumeDependencyTests-1299839671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:55 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8eee502-1932-4ebb-97ce-e77ed7c7e406_6m3skmpidevstack@QuobyteHD Jul 28 10:54:55 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:55 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:54:55 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:55 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8eee502-1932-4ebb-97ce-e77ed7c7e406_6m3skmpidevstack@QuobyteHD" returned: 0 in 0.432s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8eee502-1932-4ebb-97ce-e77ed7c7e406_6m3skmpidevstack@QuobyteHD {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:55 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b0294b87-bb7d-436e-a253-51cd1b6c1af7 tempest-VolumeDependencyTests-1299839671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.343s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:55 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-b0294b87-bb7d-436e-a253-51cd1b6c1af7 tempest-VolumeDependencyTests-1299839671 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:54:55 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-b0294b87-bb7d-436e-a253-51cd1b6c1af7 tempest-VolumeDependencyTests-1299839671 None] Deleted volume successfully. Jul 28 10:54:55 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-b0294b87-bb7d-436e-a253-51cd1b6c1af7 tempest-VolumeDependencyTests-1299839671 None] Lock "cinder-446db6e1-95f9-48eb-88e1-eaceb89850db-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:55 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8eee502-1932-4ebb-97ce-e77ed7c7e406_6m3skmpidevstack@QuobyteHD Jul 28 10:54:55 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:55 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-62021675-27e2-4f56-b111-53025c973b68 tempest-CinderUnicodeTest-858828730 None] Acquiring lock "cinder-85ea7e47-fe5e-4029-9086-c722939cbcd0-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:55 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-62021675-27e2-4f56-b111-53025c973b68 tempest-CinderUnicodeTest-858828730 None] Lock "cinder-85ea7e47-fe5e-4029-9086-c722939cbcd0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:55 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-62021675-27e2-4f56-b111-53025c973b68 tempest-CinderUnicodeTest-858828730 None] Acquiring lock "cinder-quobyte-85ea7e47-fe5e-4029-9086-c722939cbcd0" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:55 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-62021675-27e2-4f56-b111-53025c973b68 tempest-CinderUnicodeTest-858828730 None] Lock "cinder-quobyte-85ea7e47-fe5e-4029-9086-c722939cbcd0" acquired by "delete_volume" :: waited 0.021s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:55 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8eee502-1932-4ebb-97ce-e77ed7c7e406_6m3skmpidevstack@QuobyteHD" returned: 1 in 0.483s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8eee502-1932-4ebb-97ce-e77ed7c7e406_6m3skmpidevstack@QuobyteHD' failed. Not Retrying. {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 10:54:56 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] b8eee502-1932-4ebb-97ce-e77ed7c7e406 was raw, converting to qcow2 {{(pid=88413) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 28 10:54:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b8eee502-1932-4ebb-97ce-e77ed7c7e406_6m3skmpidevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-95428d34-2951-4a92-ac6b-02c407aabf6f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:56 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df4c0bf-c3d3-4cac-8a94-a551cd604c7b]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-62021675-27e2-4f56-b111-53025c973b68 tempest-CinderUnicodeTest-858828730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:56 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b8eee502-1932-4ebb-97ce-e77ed7c7e406_6m3skmpidevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-95428d34-2951-4a92-ac6b-02c407aabf6f Jul 28 10:54:56 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:56 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0 Jul 28 10:54:56 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:56 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-62021675-27e2-4f56-b111-53025c973b68 tempest-CinderUnicodeTest-858828730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0" returned: 0 in 0.521s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-62021675-27e2-4f56-b111-53025c973b68 tempest-CinderUnicodeTest-858828730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:56 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0 Jul 28 10:54:56 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:56 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b8eee502-1932-4ebb-97ce-e77ed7c7e406_6m3skmpidevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-95428d34-2951-4a92-ac6b-02c407aabf6f" returned: 0 in 0.692s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:56 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b8eee502-1932-4ebb-97ce-e77ed7c7e406_6m3skmpidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-95428d34-2951-4a92-ac6b-02c407aabf6f {{(pid=88413) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 10:54:56 devstack cinder-volume[88413]: INFO cinder.image.image_utils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Converted 0.00 MB image at 0.00 MB/s Jul 28 10:54:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-95428d34-2951-4a92-ac6b-02c407aabf6f 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:56 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-95428d34-2951-4a92-ac6b-02c407aabf6f 1G Jul 28 10:54:56 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:56 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-62021675-27e2-4f56-b111-53025c973b68 tempest-CinderUnicodeTest-858828730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-85ea7e47-fe5e-4029-9086-c722939cbcd0" returned: 0 in 0.365s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:56 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-62021675-27e2-4f56-b111-53025c973b68 tempest-CinderUnicodeTest-858828730 None] Lock "cinder-quobyte-85ea7e47-fe5e-4029-9086-c722939cbcd0" released by "delete_volume" :: held 0.981s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:57 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-62021675-27e2-4f56-b111-53025c973b68 tempest-CinderUnicodeTest-858828730 None] Created reservations ['185a7881-aad0-4413-958d-2b513127672d', 'd7a88b7a-f752-4016-8059-8edb6a5bf254', '3924d96c-6827-4287-b06c-ee42d72a3bfc', 'bbb35fc1-cbad-4a43-b70d-dfdb073cb517'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:54:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-62021675-27e2-4f56-b111-53025c973b68 tempest-CinderUnicodeTest-858828730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-62021675-27e2-4f56-b111-53025c973b68 tempest-CinderUnicodeTest-858828730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:57 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-62021675-27e2-4f56-b111-53025c973b68 tempest-CinderUnicodeTest-858828730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:57 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-62021675-27e2-4f56-b111-53025c973b68 tempest-CinderUnicodeTest-858828730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-62021675-27e2-4f56-b111-53025c973b68 tempest-CinderUnicodeTest-858828730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-62021675-27e2-4f56-b111-53025c973b68 tempest-CinderUnicodeTest-858828730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:57 devstack sudo[107538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:54:57 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:57 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-95428d34-2951-4a92-ac6b-02c407aabf6f 1G" returned: 0 in 0.508s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:57 devstack cinder-volume[88413]: DEBUG cinder.volume.volume_utils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Downloaded image b8eee502-1932-4ebb-97ce-e77ed7c7e406 ((None, [{'url': 'file:///opt/stack/data/glance/images/b8eee502-1932-4ebb-97ce-e77ed7c7e406', 'metadata': {}}])) to volume 95428d34-2951-4a92-ac6b-02c407aabf6f successfully. {{(pid=88413) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 28 10:54:57 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Temporary image b8eee502-1932-4ebb-97ce-e77ed7c7e406 for user 369902bce17a49879b4440bc258848a3 is deleted. {{(pid=88413) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 28 10:54:57 devstack cinder-volume[88413]: DEBUG cinder.volume.volume_utils [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Marking volume 95428d34-2951-4a92-ac6b-02c407aabf6f as bootable. {{(pid=88413) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 28 10:54:57 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Copying metadata from image b8eee502-1932-4ebb-97ce-e77ed7c7e406 to 95428d34-2951-4a92-ac6b-02c407aabf6f. {{(pid=88413) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 28 10:54:57 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Creating volume glance metadata for volume 95428d34-2951-4a92-ac6b-02c407aabf6f backed by image b8eee502-1932-4ebb-97ce-e77ed7c7e406 with: {'image_id': 'b8eee502-1932-4ebb-97ce-e77ed7c7e406', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '9316e195d0672095864a956e5cb68a24', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88413) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 28 10:54:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f7800a5-de2c-48a1-9c22-45b62fd75413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95428d34-2951-4a92-ac6b-02c407aabf6f', 'volume_size': 1, 'image_id': 'b8eee502-1932-4ebb-97ce-e77ed7c7e406', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b8eee502-1932-4ebb-97ce-e77ed7c7e406', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9316e195d0672095864a956e5cb68a24', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '55b3cc8b2afa44658812705e1eb76309', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9db8fd59fbf3da9bc09f2b296f7dbfb22007ea2eb16dfcb67e301a1b246eff7e9140ff342e993bbe1dd310664d38a146422d65897d7a05789566f021e388d0ff', 'id': 'b8eee502-1932-4ebb-97ce-e77ed7c7e406', 'created_at': datetime.datetime(2026, 7, 28, 8, 54, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 8, 54, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b8eee502-1932-4ebb-97ce-e77ed7c7e406/file', 'properties': {}}, 'image_service': }' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e857e722-d013-4a7f-a301-e2cd433091ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:54:57 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Volume volume-95428d34-2951-4a92-ac6b-02c407aabf6f (95428d34-2951-4a92-ac6b-02c407aabf6f): created successfully Jul 28 10:54:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e857e722-d013-4a7f-a301-e2cd433091ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:54:57 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Flow 'volume_create_manager' (4ebc7c13-1593-489d-97d9-644b25a37f88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:54:57 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-8a01b6ff-ea33-4003-a9ac-ab934b9cf3d8 tempest-VolumeImageDependencyTests-1234265227 None] Created volume successfully. Jul 28 10:54:57 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-62021675-27e2-4f56-b111-53025c973b68 tempest-CinderUnicodeTest-858828730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.330s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:57 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-62021675-27e2-4f56-b111-53025c973b68 tempest-CinderUnicodeTest-858828730 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:54:57 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-62021675-27e2-4f56-b111-53025c973b68 tempest-CinderUnicodeTest-858828730 None] Deleted volume successfully. Jul 28 10:54:57 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-62021675-27e2-4f56-b111-53025c973b68 tempest-CinderUnicodeTest-858828730 None] Lock "cinder-85ea7e47-fe5e-4029-9086-c722939cbcd0-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:58 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-361496af-6a93-41cf-8be4-f6a0d9a097ec tempest-CinderUnicodeTest-858828730 None] Acquiring lock "cinder-f14a06af-3b3a-4a6d-8376-447089320fb1-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:58 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-361496af-6a93-41cf-8be4-f6a0d9a097ec tempest-CinderUnicodeTest-858828730 None] Lock "cinder-f14a06af-3b3a-4a6d-8376-447089320fb1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:58 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-cf44f7f9-2ef6-487b-9cd3-1e217300af40 tempest-VolumeImageDependencyTests-1234265227 None] Acquiring lock "cinder-95428d34-2951-4a92-ac6b-02c407aabf6f-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:58 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-cf44f7f9-2ef6-487b-9cd3-1e217300af40 tempest-VolumeImageDependencyTests-1234265227 None] Lock "cinder-95428d34-2951-4a92-ac6b-02c407aabf6f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:58 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-361496af-6a93-41cf-8be4-f6a0d9a097ec tempest-CinderUnicodeTest-858828730 None] Acquiring lock "cinder-quobyte-f14a06af-3b3a-4a6d-8376-447089320fb1" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:58 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-361496af-6a93-41cf-8be4-f6a0d9a097ec tempest-CinderUnicodeTest-858828730 None] Lock "cinder-quobyte-f14a06af-3b3a-4a6d-8376-447089320fb1" acquired by "delete_volume" :: waited 0.042s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:58 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[97aa7b77-16d8-46c5-83c7-5481a361afef]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-361496af-6a93-41cf-8be4-f6a0d9a097ec tempest-CinderUnicodeTest-858828730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f14a06af-3b3a-4a6d-8376-447089320fb1 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:58 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-cf44f7f9-2ef6-487b-9cd3-1e217300af40 tempest-VolumeImageDependencyTests-1234265227 None] Acquiring lock "cinder-quobyte-95428d34-2951-4a92-ac6b-02c407aabf6f" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:54:58 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-cf44f7f9-2ef6-487b-9cd3-1e217300af40 tempest-VolumeImageDependencyTests-1234265227 None] Lock "cinder-quobyte-95428d34-2951-4a92-ac6b-02c407aabf6f" acquired by "delete_volume" :: waited 0.031s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:54:58 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[853a1597-b001-41a1-a508-238f84f5e0d6]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:54:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cf44f7f9-2ef6-487b-9cd3-1e217300af40 tempest-VolumeImageDependencyTests-1234265227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-95428d34-2951-4a92-ac6b-02c407aabf6f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:58 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f14a06af-3b3a-4a6d-8376-447089320fb1 Jul 28 10:54:58 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:58 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-95428d34-2951-4a92-ac6b-02c407aabf6f Jul 28 10:54:58 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:58 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-361496af-6a93-41cf-8be4-f6a0d9a097ec tempest-CinderUnicodeTest-858828730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f14a06af-3b3a-4a6d-8376-447089320fb1" returned: 0 in 0.436s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-361496af-6a93-41cf-8be4-f6a0d9a097ec tempest-CinderUnicodeTest-858828730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f14a06af-3b3a-4a6d-8376-447089320fb1 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:58 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f14a06af-3b3a-4a6d-8376-447089320fb1 Jul 28 10:54:58 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:58 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cf44f7f9-2ef6-487b-9cd3-1e217300af40 tempest-VolumeImageDependencyTests-1234265227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-95428d34-2951-4a92-ac6b-02c407aabf6f" returned: 0 in 0.489s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cf44f7f9-2ef6-487b-9cd3-1e217300af40 tempest-VolumeImageDependencyTests-1234265227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-95428d34-2951-4a92-ac6b-02c407aabf6f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:58 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-95428d34-2951-4a92-ac6b-02c407aabf6f Jul 28 10:54:58 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:59 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-361496af-6a93-41cf-8be4-f6a0d9a097ec tempest-CinderUnicodeTest-858828730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f14a06af-3b3a-4a6d-8376-447089320fb1" returned: 0 in 0.322s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:59 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-361496af-6a93-41cf-8be4-f6a0d9a097ec tempest-CinderUnicodeTest-858828730 None] Lock "cinder-quobyte-f14a06af-3b3a-4a6d-8376-447089320fb1" released by "delete_volume" :: held 0.809s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:59 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-361496af-6a93-41cf-8be4-f6a0d9a097ec tempest-CinderUnicodeTest-858828730 None] Created reservations ['2553ddbd-8ce5-469c-b35f-11d0a858d8ea', 'c52115af-6ffa-4625-b439-a80c8aa2681f', '35342879-5cc6-4a22-9805-8a7f6e9765d6', '807778bb-a6a0-429b-b2f3-4b30fbbb4ec7'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:54:59 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cf44f7f9-2ef6-487b-9cd3-1e217300af40 tempest-VolumeImageDependencyTests-1234265227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-95428d34-2951-4a92-ac6b-02c407aabf6f" returned: 0 in 0.327s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:59 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-cf44f7f9-2ef6-487b-9cd3-1e217300af40 tempest-VolumeImageDependencyTests-1234265227 None] Lock "cinder-quobyte-95428d34-2951-4a92-ac6b-02c407aabf6f" released by "delete_volume" :: held 0.884s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-361496af-6a93-41cf-8be4-f6a0d9a097ec tempest-CinderUnicodeTest-858828730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-361496af-6a93-41cf-8be4-f6a0d9a097ec tempest-CinderUnicodeTest-858828730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:59 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-361496af-6a93-41cf-8be4-f6a0d9a097ec tempest-CinderUnicodeTest-858828730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:59 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-361496af-6a93-41cf-8be4-f6a0d9a097ec tempest-CinderUnicodeTest-858828730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-361496af-6a93-41cf-8be4-f6a0d9a097ec tempest-CinderUnicodeTest-858828730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-361496af-6a93-41cf-8be4-f6a0d9a097ec tempest-CinderUnicodeTest-858828730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:59 devstack sudo[107560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:54:59 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:59 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-cf44f7f9-2ef6-487b-9cd3-1e217300af40 tempest-VolumeImageDependencyTests-1234265227 None] Created reservations ['0cdb63c2-d5eb-47d2-998d-7890289da903', '299de0d0-c8d9-43c7-a67e-71eb87ef5e37', '8abf1aab-20ee-4512-bf46-79d0042c446b', '0782d11b-c84f-4bdd-840c-5e13e765951a'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:54:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-cf44f7f9-2ef6-487b-9cd3-1e217300af40 tempest-VolumeImageDependencyTests-1234265227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:54:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-cf44f7f9-2ef6-487b-9cd3-1e217300af40 tempest-VolumeImageDependencyTests-1234265227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:54:59 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-cf44f7f9-2ef6-487b-9cd3-1e217300af40 tempest-VolumeImageDependencyTests-1234265227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:54:59 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-cf44f7f9-2ef6-487b-9cd3-1e217300af40 tempest-VolumeImageDependencyTests-1234265227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:54:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-cf44f7f9-2ef6-487b-9cd3-1e217300af40 tempest-VolumeImageDependencyTests-1234265227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:54:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cf44f7f9-2ef6-487b-9cd3-1e217300af40 tempest-VolumeImageDependencyTests-1234265227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:54:59 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:54:59 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:54:59 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-361496af-6a93-41cf-8be4-f6a0d9a097ec tempest-CinderUnicodeTest-858828730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.380s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:59 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-361496af-6a93-41cf-8be4-f6a0d9a097ec tempest-CinderUnicodeTest-858828730 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:54:59 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-361496af-6a93-41cf-8be4-f6a0d9a097ec tempest-CinderUnicodeTest-858828730 None] Deleted volume successfully. Jul 28 10:54:59 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-361496af-6a93-41cf-8be4-f6a0d9a097ec tempest-CinderUnicodeTest-858828730 None] Lock "cinder-f14a06af-3b3a-4a6d-8376-447089320fb1-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:54:59 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Jul 28 10:54:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cf44f7f9-2ef6-487b-9cd3-1e217300af40 tempest-VolumeImageDependencyTests-1234265227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.348s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:54:59 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-cf44f7f9-2ef6-487b-9cd3-1e217300af40 tempest-VolumeImageDependencyTests-1234265227 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:54:59 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-cf44f7f9-2ef6-487b-9cd3-1e217300af40 tempest-VolumeImageDependencyTests-1234265227 None] Deleted volume successfully. Jul 28 10:54:59 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-cf44f7f9-2ef6-487b-9cd3-1e217300af40 tempest-VolumeImageDependencyTests-1234265227 None] Lock "cinder-95428d34-2951-4a92-ac6b-02c407aabf6f-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:03 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-4a60ea13-5d65-4483-8242-08ed381cad55 tempest-ProjectAdminTests-951829322 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577056884766, 'free_capacity_gb': 1775.7577056884766, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88413) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 28 10:55:07 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=203,cinder:UPDATE=280,cinder:INSERT=69,cinder:DELETE=20 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:55:07 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=198,cinder:UPDATE=273,cinder:DELETE=29,cinder:INSERT=79 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:55:07 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-36e704de-fa9f-4151-9921-e457caa8ff85 tempest-ProjectMemberTests-1781514586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:55:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-36e704de-fa9f-4151-9921-e457caa8ff85 tempest-ProjectMemberTests-1781514586 None] Flow 'volume_create_manager' (346871a9-f3bc-40d1-8efd-ea0c81288a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:55:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-36e704de-fa9f-4151-9921-e457caa8ff85 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b5a279b-9546-44dc-9aa9-aa9523f22562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-36e704de-fa9f-4151-9921-e457caa8ff85 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b5a279b-9546-44dc-9aa9-aa9523f22562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-547861821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d804f2d1-0347-4881-b7c7-27e4e5d3b21e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61e1f2c346a4cddbe7adc3f82eccf01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:55:07Z,use_quota=True,user_id='443f2e63fd9f4abcbb3569fc8516b13f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-36e704de-fa9f-4151-9921-e457caa8ff85 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fabe6a2b-9229-4ac2-b6b4-9ecb503ae4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-36e704de-fa9f-4151-9921-e457caa8ff85 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fabe6a2b-9229-4ac2-b6b4-9ecb503ae4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-36e704de-fa9f-4151-9921-e457caa8ff85 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37702a1-e853-440e-8e51-3d93383ea7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-36e704de-fa9f-4151-9921-e457caa8ff85 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37702a1-e853-440e-8e51-3d93383ea7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd804f2d1-0347-4881-b7c7-27e4e5d3b21e', 'volume_name': 'volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-36e704de-fa9f-4151-9921-e457caa8ff85 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd9a2153-a4bb-4999-84aa-30b2f564ffc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-36e704de-fa9f-4151-9921-e457caa8ff85 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd9a2153-a4bb-4999-84aa-30b2f564ffc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-36e704de-fa9f-4151-9921-e457caa8ff85 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8bad1f9-2fbe-4cd5-a3be-74cc167dc173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:07 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-36e704de-fa9f-4151-9921-e457caa8ff85 tempest-ProjectMemberTests-1781514586 None] Volume d804f2d1-0347-4881-b7c7-27e4e5d3b21e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e', 'volume_size': 1} Jul 28 10:55:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-36e704de-fa9f-4151-9921-e457caa8ff85 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-36e704de-fa9f-4151-9921-e457caa8ff85 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:07 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-36e704de-fa9f-4151-9921-e457caa8ff85 tempest-ProjectMemberTests-1781514586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-547861821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d804f2d1-0347-4881-b7c7-27e4e5d3b21e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61e1f2c346a4cddbe7adc3f82eccf01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:55:07Z,use_quota=True,user_id='443f2e63fd9f4abcbb3569fc8516b13f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:55:07 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-36e704de-fa9f-4151-9921-e457caa8ff85 tempest-ProjectMemberTests-1781514586 None] Creating volume d804f2d1-0347-4881-b7c7-27e4e5d3b21e {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:55:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-36e704de-fa9f-4151-9921-e457caa8ff85 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-36e704de-fa9f-4151-9921-e457caa8ff85 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:07 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-36e704de-fa9f-4151-9921-e457caa8ff85 tempest-ProjectMemberTests-1781514586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:55:07 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-36e704de-fa9f-4151-9921-e457caa8ff85 tempest-ProjectMemberTests-1781514586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:55:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-36e704de-fa9f-4151-9921-e457caa8ff85 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:07 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-36e704de-fa9f-4151-9921-e457caa8ff85 tempest-ProjectMemberTests-1781514586 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:55:07 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-36e704de-fa9f-4151-9921-e457caa8ff85 tempest-ProjectMemberTests-1781514586 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:55:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-36e704de-fa9f-4151-9921-e457caa8ff85 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:07 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e 1073741824 Jul 28 10:55:07 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:08 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-36e704de-fa9f-4151-9921-e457caa8ff85 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e 1073741824" returned: 0 in 0.805s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-36e704de-fa9f-4151-9921-e457caa8ff85 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:08 devstack sudo[107845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e Jul 28 10:55:08 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:08 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-36e704de-fa9f-4151-9921-e457caa8ff85 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e" returned: 0 in 0.318s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:08 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-36e704de-fa9f-4151-9921-e457caa8ff85 tempest-ProjectMemberTests-1781514586 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:55:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-36e704de-fa9f-4151-9921-e457caa8ff85 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-36e704de-fa9f-4151-9921-e457caa8ff85 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8bad1f9-2fbe-4cd5-a3be-74cc167dc173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-36e704de-fa9f-4151-9921-e457caa8ff85 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (449a20be-1cb6-425e-933e-11f1bf58b6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:08 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-36e704de-fa9f-4151-9921-e457caa8ff85 tempest-ProjectMemberTests-1781514586 None] Volume volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e (d804f2d1-0347-4881-b7c7-27e4e5d3b21e): created successfully Jul 28 10:55:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-36e704de-fa9f-4151-9921-e457caa8ff85 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (449a20be-1cb6-425e-933e-11f1bf58b6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:08 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-36e704de-fa9f-4151-9921-e457caa8ff85 tempest-ProjectMemberTests-1781514586 None] Flow 'volume_create_manager' (346871a9-f3bc-40d1-8efd-ea0c81288a96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:55:08 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-36e704de-fa9f-4151-9921-e457caa8ff85 tempest-ProjectMemberTests-1781514586 None] Created volume successfully. Jul 28 10:55:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c11491a6-189e-49ce-8648-f2e0abe1957b tempest-ProjectMemberTests-1781514586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c11491a6-189e-49ce-8648-f2e0abe1957b tempest-ProjectMemberTests-1781514586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:09 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-c11491a6-189e-49ce-8648-f2e0abe1957b tempest-ProjectMemberTests-1781514586 None] Creating offline snapshot a171ea63-a9dc-4cd0-b069-2423b1ce9dce of volume d804f2d1-0347-4881-b7c7-27e4e5d3b21e {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:55:10 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfeec496-0cc7-4d1f-9163-62c70c157f90]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:55:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c11491a6-189e-49ce-8648-f2e0abe1957b tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:10 devstack sudo[107912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e Jul 28 10:55:10 devstack sudo[107912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:10 devstack sudo[107912]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c11491a6-189e-49ce-8648-f2e0abe1957b tempest-ProjectMemberTests-1781514586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e" returned: 0 in 0.615s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c11491a6-189e-49ce-8648-f2e0abe1957b tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e.a171ea63-a9dc-4cd0-b069-2423b1ce9dce 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:10 devstack sudo[107918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e.a171ea63-a9dc-4cd0-b069-2423b1ce9dce 1G Jul 28 10:55:10 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:11 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c11491a6-189e-49ce-8648-f2e0abe1957b tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e.a171ea63-a9dc-4cd0-b069-2423b1ce9dce 1G" returned: 0 in 0.495s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c11491a6-189e-49ce-8648-f2e0abe1957b tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e.a171ea63-a9dc-4cd0-b069-2423b1ce9dce {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:11 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e.a171ea63-a9dc-4cd0-b069-2423b1ce9dce Jul 28 10:55:11 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:11 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c11491a6-189e-49ce-8648-f2e0abe1957b tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e.a171ea63-a9dc-4cd0-b069-2423b1ce9dce" returned: 0 in 0.356s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:11 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-c11491a6-189e-49ce-8648-f2e0abe1957b tempest-ProjectMemberTests-1781514586 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e.a171ea63-a9dc-4cd0-b069-2423b1ce9dce is being set with open permissions: ugo+rw Jul 28 10:55:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c11491a6-189e-49ce-8648-f2e0abe1957b tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e.a171ea63-a9dc-4cd0-b069-2423b1ce9dce {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:11 devstack sudo[107930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e.a171ea63-a9dc-4cd0-b069-2423b1ce9dce Jul 28 10:55:11 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:11 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c11491a6-189e-49ce-8648-f2e0abe1957b tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e.a171ea63-a9dc-4cd0-b069-2423b1ce9dce" returned: 0 in 0.304s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c11491a6-189e-49ce-8648-f2e0abe1957b tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:11 devstack sudo[107933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e.info Jul 28 10:55:11 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:12 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c11491a6-189e-49ce-8648-f2e0abe1957b tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e.info" returned: 0 in 0.330s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:12 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-c11491a6-189e-49ce-8648-f2e0abe1957b tempest-ProjectMemberTests-1781514586 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e.info is being set with open permissions: ugo+rw Jul 28 10:55:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c11491a6-189e-49ce-8648-f2e0abe1957b tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:12 devstack sudo[107936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e.info Jul 28 10:55:12 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:12 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c11491a6-189e-49ce-8648-f2e0abe1957b tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e.info" returned: 0 in 0.413s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c11491a6-189e-49ce-8648-f2e0abe1957b tempest-ProjectMemberTests-1781514586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.648s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:12 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-c11491a6-189e-49ce-8648-f2e0abe1957b tempest-ProjectMemberTests-1781514586 None] Create snapshot completed successfully Jul 28 10:55:13 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ec2f76eb-1e3b-4dc0-b556-1c16579545c0 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-a171ea63-a9dc-4cd0-b069-2423b1ce9dce-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:13 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ec2f76eb-1e3b-4dc0-b556-1c16579545c0 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-a171ea63-a9dc-4cd0-b069-2423b1ce9dce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:13 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ec2f76eb-1e3b-4dc0-b556-1c16579545c0 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-quobyte-d804f2d1-0347-4881-b7c7-27e4e5d3b21e" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:13 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ec2f76eb-1e3b-4dc0-b556-1c16579545c0 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-d804f2d1-0347-4881-b7c7-27e4e5d3b21e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:13 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ec2f76eb-1e3b-4dc0-b556-1c16579545c0 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-quobyte-a171ea63-a9dc-4cd0-b069-2423b1ce9dce" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:13 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ec2f76eb-1e3b-4dc0-b556-1c16579545c0 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-a171ea63-a9dc-4cd0-b069-2423b1ce9dce" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:13 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-ec2f76eb-1e3b-4dc0-b556-1c16579545c0 tempest-ProjectMemberTests-1781514586 None] Deleting offline snapshot a171ea63-a9dc-4cd0-b069-2423b1ce9dce of volume d804f2d1-0347-4881-b7c7-27e4e5d3b21e {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:55:13 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-ec2f76eb-1e3b-4dc0-b556-1c16579545c0 tempest-ProjectMemberTests-1781514586 None] snapshot_file for this snap is: volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e.a171ea63-a9dc-4cd0-b069-2423b1ce9dce {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:55:13 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[027e8d57-a757-42e7-ae6e-4e4e2c801d0b]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:55:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ec2f76eb-1e3b-4dc0-b556-1c16579545c0 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e.a171ea63-a9dc-4cd0-b069-2423b1ce9dce {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:13 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e.a171ea63-a9dc-4cd0-b069-2423b1ce9dce Jul 28 10:55:13 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:13 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ec2f76eb-1e3b-4dc0-b556-1c16579545c0 tempest-ProjectMemberTests-1781514586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e.a171ea63-a9dc-4cd0-b069-2423b1ce9dce" returned: 0 in 0.595s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:13 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-ec2f76eb-1e3b-4dc0-b556-1c16579545c0 tempest-ProjectMemberTests-1781514586 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:55:13 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3be2df2-2e76-4a9d-8788-445dc5e8fc4c]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:55:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ec2f76eb-1e3b-4dc0-b556-1c16579545c0 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:14 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e Jul 28 10:55:14 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:14 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ec2f76eb-1e3b-4dc0-b556-1c16579545c0 tempest-ProjectMemberTests-1781514586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e" returned: 0 in 0.458s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ec2f76eb-1e3b-4dc0-b556-1c16579545c0 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e.a171ea63-a9dc-4cd0-b069-2423b1ce9dce {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:14 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e.a171ea63-a9dc-4cd0-b069-2423b1ce9dce Jul 28 10:55:14 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:14 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ec2f76eb-1e3b-4dc0-b556-1c16579545c0 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e.a171ea63-a9dc-4cd0-b069-2423b1ce9dce" returned: 0 in 0.449s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ec2f76eb-1e3b-4dc0-b556-1c16579545c0 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e.a171ea63-a9dc-4cd0-b069-2423b1ce9dce {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:14 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e.a171ea63-a9dc-4cd0-b069-2423b1ce9dce Jul 28 10:55:14 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:15 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ec2f76eb-1e3b-4dc0-b556-1c16579545c0 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e.a171ea63-a9dc-4cd0-b069-2423b1ce9dce" returned: 0 in 0.370s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:15 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ec2f76eb-1e3b-4dc0-b556-1c16579545c0 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-a171ea63-a9dc-4cd0-b069-2423b1ce9dce" released by "_delete_snapshot" :: held 2.054s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:15 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ec2f76eb-1e3b-4dc0-b556-1c16579545c0 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-d804f2d1-0347-4881-b7c7-27e4e5d3b21e" released by "delete_snapshot" :: held 2.085s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:15 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-ec2f76eb-1e3b-4dc0-b556-1c16579545c0 tempest-ProjectMemberTests-1781514586 None] Created reservations ['37fdb760-a3d5-487a-aa6f-4773c90522ae', '94f90bdf-7c00-445d-9593-c41779248b4b', '3ae6dc1f-dbf1-48fb-a1d3-e26bb1ae5341', 'd914a107-c032-4f14-851f-6a16d5d9527c'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:55:15 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-ec2f76eb-1e3b-4dc0-b556-1c16579545c0 tempest-ProjectMemberTests-1781514586 None] Delete snapshot completed successfully. Jul 28 10:55:15 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ec2f76eb-1e3b-4dc0-b556-1c16579545c0 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-a171ea63-a9dc-4cd0-b069-2423b1ce9dce-delete_snapshot" released by "delete_snapshot" :: held 2.258s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:16 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-49c8269d-428a-47f9-b858-bcaef84519d9 tempest-ProjectReaderTests-1559131237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:55:16 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-49c8269d-428a-47f9-b858-bcaef84519d9 tempest-ProjectReaderTests-1559131237 None] Flow 'volume_create_manager' (6ed69979-f1dd-4167-be38-ec053561561b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:55:16 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-49c8269d-428a-47f9-b858-bcaef84519d9 tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2b623f3-fa3b-41f9-adb0-75695830f8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:16 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-49c8269d-428a-47f9-b858-bcaef84519d9 tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2b623f3-fa3b-41f9-adb0-75695830f8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-633340679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29aa81b1-ea42-4fe6-8076-04dc7d450a1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e809d2b3590e4773b21dff75fddc337c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:55:16Z,use_quota=True,user_id='0888e2403d394ef590bbf50188e14d5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:16 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-49c8269d-428a-47f9-b858-bcaef84519d9 tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d64bd2f-2b66-4aa5-bb00-92dad85d5f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:16 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-49c8269d-428a-47f9-b858-bcaef84519d9 tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d64bd2f-2b66-4aa5-bb00-92dad85d5f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:16 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-49c8269d-428a-47f9-b858-bcaef84519d9 tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c77f7a0c-5bee-4ddc-aca6-ab9c5f583ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:16 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-49c8269d-428a-47f9-b858-bcaef84519d9 tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c77f7a0c-5bee-4ddc-aca6-ab9c5f583ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29aa81b1-ea42-4fe6-8076-04dc7d450a1c', 'volume_name': 'volume-29aa81b1-ea42-4fe6-8076-04dc7d450a1c', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:16 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-49c8269d-428a-47f9-b858-bcaef84519d9 tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (072911fd-f7cb-4d7f-ac50-99bb8f10987c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:16 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-49c8269d-428a-47f9-b858-bcaef84519d9 tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (072911fd-f7cb-4d7f-ac50-99bb8f10987c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:16 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-49c8269d-428a-47f9-b858-bcaef84519d9 tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab93571-6a35-4272-a065-cf95d6248694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:16 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-49c8269d-428a-47f9-b858-bcaef84519d9 tempest-ProjectReaderTests-1559131237 None] Volume 29aa81b1-ea42-4fe6-8076-04dc7d450a1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29aa81b1-ea42-4fe6-8076-04dc7d450a1c', 'volume_size': 1} Jul 28 10:55:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-49c8269d-428a-47f9-b858-bcaef84519d9 tempest-ProjectReaderTests-1559131237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-49c8269d-428a-47f9-b858-bcaef84519d9 tempest-ProjectReaderTests-1559131237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:16 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-49c8269d-428a-47f9-b858-bcaef84519d9 tempest-ProjectReaderTests-1559131237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-633340679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29aa81b1-ea42-4fe6-8076-04dc7d450a1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e809d2b3590e4773b21dff75fddc337c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:55:16Z,use_quota=True,user_id='0888e2403d394ef590bbf50188e14d5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:55:16 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-49c8269d-428a-47f9-b858-bcaef84519d9 tempest-ProjectReaderTests-1559131237 None] Creating volume 29aa81b1-ea42-4fe6-8076-04dc7d450a1c {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:55:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-49c8269d-428a-47f9-b858-bcaef84519d9 tempest-ProjectReaderTests-1559131237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-49c8269d-428a-47f9-b858-bcaef84519d9 tempest-ProjectReaderTests-1559131237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:16 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-49c8269d-428a-47f9-b858-bcaef84519d9 tempest-ProjectReaderTests-1559131237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:55:16 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-49c8269d-428a-47f9-b858-bcaef84519d9 tempest-ProjectReaderTests-1559131237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:55:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-49c8269d-428a-47f9-b858-bcaef84519d9 tempest-ProjectReaderTests-1559131237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:16 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-49c8269d-428a-47f9-b858-bcaef84519d9 tempest-ProjectReaderTests-1559131237 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:55:16 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-49c8269d-428a-47f9-b858-bcaef84519d9 tempest-ProjectReaderTests-1559131237 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:55:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-49c8269d-428a-47f9-b858-bcaef84519d9 tempest-ProjectReaderTests-1559131237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-29aa81b1-ea42-4fe6-8076-04dc7d450a1c 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:16 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-29aa81b1-ea42-4fe6-8076-04dc7d450a1c 1073741824 Jul 28 10:55:16 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:16 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ab0378be-0301-40fc-b995-2fb44fa1076f tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-d804f2d1-0347-4881-b7c7-27e4e5d3b21e-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:16 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ab0378be-0301-40fc-b995-2fb44fa1076f tempest-ProjectMemberTests-1781514586 None] Lock "cinder-d804f2d1-0347-4881-b7c7-27e4e5d3b21e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:16 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ab0378be-0301-40fc-b995-2fb44fa1076f tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-quobyte-d804f2d1-0347-4881-b7c7-27e4e5d3b21e" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:16 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ab0378be-0301-40fc-b995-2fb44fa1076f tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-d804f2d1-0347-4881-b7c7-27e4e5d3b21e" acquired by "delete_volume" :: waited 0.021s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:16 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[b131e7fd-2a28-4a89-b09a-9e22a364bb54]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:55:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ab0378be-0301-40fc-b995-2fb44fa1076f tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:16 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-49c8269d-428a-47f9-b858-bcaef84519d9 tempest-ProjectReaderTests-1559131237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-29aa81b1-ea42-4fe6-8076-04dc7d450a1c 1073741824" returned: 0 in 0.570s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:16 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e Jul 28 10:55:16 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-49c8269d-428a-47f9-b858-bcaef84519d9 tempest-ProjectReaderTests-1559131237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-29aa81b1-ea42-4fe6-8076-04dc7d450a1c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:16 devstack sudo[107966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-29aa81b1-ea42-4fe6-8076-04dc7d450a1c Jul 28 10:55:16 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:17 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-49c8269d-428a-47f9-b858-bcaef84519d9 tempest-ProjectReaderTests-1559131237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-29aa81b1-ea42-4fe6-8076-04dc7d450a1c" returned: 0 in 0.299s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:17 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-49c8269d-428a-47f9-b858-bcaef84519d9 tempest-ProjectReaderTests-1559131237 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:55:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-49c8269d-428a-47f9-b858-bcaef84519d9 tempest-ProjectReaderTests-1559131237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:17 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-49c8269d-428a-47f9-b858-bcaef84519d9 tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab93571-6a35-4272-a065-cf95d6248694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29aa81b1-ea42-4fe6-8076-04dc7d450a1c', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:17 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-49c8269d-428a-47f9-b858-bcaef84519d9 tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a97455d-296a-4a8b-9256-5be751979f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:17 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-49c8269d-428a-47f9-b858-bcaef84519d9 tempest-ProjectReaderTests-1559131237 None] Volume volume-29aa81b1-ea42-4fe6-8076-04dc7d450a1c (29aa81b1-ea42-4fe6-8076-04dc7d450a1c): created successfully Jul 28 10:55:17 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-49c8269d-428a-47f9-b858-bcaef84519d9 tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a97455d-296a-4a8b-9256-5be751979f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:17 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-49c8269d-428a-47f9-b858-bcaef84519d9 tempest-ProjectReaderTests-1559131237 None] Flow 'volume_create_manager' (6ed69979-f1dd-4167-be38-ec053561561b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:55:17 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-49c8269d-428a-47f9-b858-bcaef84519d9 tempest-ProjectReaderTests-1559131237 None] Created volume successfully. Jul 28 10:55:17 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ab0378be-0301-40fc-b995-2fb44fa1076f tempest-ProjectMemberTests-1781514586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e" returned: 0 in 0.562s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ab0378be-0301-40fc-b995-2fb44fa1076f tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:17 devstack sudo[107972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e Jul 28 10:55:17 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:17 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ab0378be-0301-40fc-b995-2fb44fa1076f tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-d804f2d1-0347-4881-b7c7-27e4e5d3b21e" returned: 0 in 0.267s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:17 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ab0378be-0301-40fc-b995-2fb44fa1076f tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-d804f2d1-0347-4881-b7c7-27e4e5d3b21e" released by "delete_volume" :: held 0.903s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:17 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-ab0378be-0301-40fc-b995-2fb44fa1076f tempest-ProjectMemberTests-1781514586 None] Created reservations ['dcdba313-04c5-441e-ae68-614b5443eb9e', '7ecec5a7-da85-48e1-84ca-4764b84234fd', '06020b46-be9b-47c8-b92c-8619417ee416', '3f1c0db9-7941-458c-9be8-f9bf8b60ddc8'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:55:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ab0378be-0301-40fc-b995-2fb44fa1076f tempest-ProjectMemberTests-1781514586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ab0378be-0301-40fc-b995-2fb44fa1076f tempest-ProjectMemberTests-1781514586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:17 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-ab0378be-0301-40fc-b995-2fb44fa1076f tempest-ProjectMemberTests-1781514586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:55:17 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-ab0378be-0301-40fc-b995-2fb44fa1076f tempest-ProjectMemberTests-1781514586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:55:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ab0378be-0301-40fc-b995-2fb44fa1076f tempest-ProjectMemberTests-1781514586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ab0378be-0301-40fc-b995-2fb44fa1076f tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:17 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:55:17 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:17 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ab0378be-0301-40fc-b995-2fb44fa1076f tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.273s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:17 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-ab0378be-0301-40fc-b995-2fb44fa1076f tempest-ProjectMemberTests-1781514586 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:55:17 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-ab0378be-0301-40fc-b995-2fb44fa1076f tempest-ProjectMemberTests-1781514586 None] Deleted volume successfully. Jul 28 10:55:17 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ab0378be-0301-40fc-b995-2fb44fa1076f tempest-ProjectMemberTests-1781514586 None] Lock "cinder-d804f2d1-0347-4881-b7c7-27e4e5d3b21e-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:18 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b9463ff-619e-4800-9487-2ec0318b41f7 tempest-ProjectMemberTests-1781514586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:55:18 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7b9463ff-619e-4800-9487-2ec0318b41f7 tempest-ProjectMemberTests-1781514586 None] Flow 'volume_create_manager' (f7262263-9890-44cf-b80c-90c17df1dd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:55:18 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7b9463ff-619e-4800-9487-2ec0318b41f7 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f53108-0ebe-4887-8766-03072f509855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:18 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7b9463ff-619e-4800-9487-2ec0318b41f7 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f53108-0ebe-4887-8766-03072f509855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-909866550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c3af05d-fe50-4658-a8a4-eb63d081127b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61e1f2c346a4cddbe7adc3f82eccf01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:55:18Z,use_quota=True,user_id='443f2e63fd9f4abcbb3569fc8516b13f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:18 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7b9463ff-619e-4800-9487-2ec0318b41f7 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f199660-8679-46b9-9136-89f83a165c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:18 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7b9463ff-619e-4800-9487-2ec0318b41f7 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f199660-8679-46b9-9136-89f83a165c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:18 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7b9463ff-619e-4800-9487-2ec0318b41f7 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (543711b5-f8b7-451e-843a-8aff6b40ec1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:18 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7b9463ff-619e-4800-9487-2ec0318b41f7 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (543711b5-f8b7-451e-843a-8aff6b40ec1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c3af05d-fe50-4658-a8a4-eb63d081127b', 'volume_name': 'volume-0c3af05d-fe50-4658-a8a4-eb63d081127b', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:18 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7b9463ff-619e-4800-9487-2ec0318b41f7 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad60d05d-39a3-412f-a557-5be0f8a385e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:18 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7b9463ff-619e-4800-9487-2ec0318b41f7 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad60d05d-39a3-412f-a557-5be0f8a385e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:18 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7b9463ff-619e-4800-9487-2ec0318b41f7 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1a4bab3-1180-4f2a-9f6e-4ba9236476e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:18 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-7b9463ff-619e-4800-9487-2ec0318b41f7 tempest-ProjectMemberTests-1781514586 None] Volume 0c3af05d-fe50-4658-a8a4-eb63d081127b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c3af05d-fe50-4658-a8a4-eb63d081127b', 'volume_size': 1} Jul 28 10:55:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7b9463ff-619e-4800-9487-2ec0318b41f7 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7b9463ff-619e-4800-9487-2ec0318b41f7 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:18 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7b9463ff-619e-4800-9487-2ec0318b41f7 tempest-ProjectMemberTests-1781514586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-909866550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c3af05d-fe50-4658-a8a4-eb63d081127b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61e1f2c346a4cddbe7adc3f82eccf01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:55:18Z,use_quota=True,user_id='443f2e63fd9f4abcbb3569fc8516b13f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:55:18 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-7b9463ff-619e-4800-9487-2ec0318b41f7 tempest-ProjectMemberTests-1781514586 None] Creating volume 0c3af05d-fe50-4658-a8a4-eb63d081127b {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:55:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7b9463ff-619e-4800-9487-2ec0318b41f7 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7b9463ff-619e-4800-9487-2ec0318b41f7 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:18 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7b9463ff-619e-4800-9487-2ec0318b41f7 tempest-ProjectMemberTests-1781514586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:55:18 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7b9463ff-619e-4800-9487-2ec0318b41f7 tempest-ProjectMemberTests-1781514586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:55:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7b9463ff-619e-4800-9487-2ec0318b41f7 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:18 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7b9463ff-619e-4800-9487-2ec0318b41f7 tempest-ProjectMemberTests-1781514586 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:55:18 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-7b9463ff-619e-4800-9487-2ec0318b41f7 tempest-ProjectMemberTests-1781514586 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:55:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7b9463ff-619e-4800-9487-2ec0318b41f7 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:18 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b 1073741824 Jul 28 10:55:18 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:18 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7c8f7d1d-751b-4128-8ea1-401e0f802bb4 tempest-ProjectReaderTests-1559131237 None] Acquiring lock "cinder-29aa81b1-ea42-4fe6-8076-04dc7d450a1c-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:18 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7c8f7d1d-751b-4128-8ea1-401e0f802bb4 tempest-ProjectReaderTests-1559131237 None] Lock "cinder-29aa81b1-ea42-4fe6-8076-04dc7d450a1c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:18 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7c8f7d1d-751b-4128-8ea1-401e0f802bb4 tempest-ProjectReaderTests-1559131237 None] Acquiring lock "cinder-quobyte-29aa81b1-ea42-4fe6-8076-04dc7d450a1c" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:18 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7c8f7d1d-751b-4128-8ea1-401e0f802bb4 tempest-ProjectReaderTests-1559131237 None] Lock "cinder-quobyte-29aa81b1-ea42-4fe6-8076-04dc7d450a1c" acquired by "delete_volume" :: waited 0.019s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:18 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ad4a8d-bcaf-4067-932d-f5a296425d7e]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:55:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7c8f7d1d-751b-4128-8ea1-401e0f802bb4 tempest-ProjectReaderTests-1559131237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-29aa81b1-ea42-4fe6-8076-04dc7d450a1c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:18 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-29aa81b1-ea42-4fe6-8076-04dc7d450a1c Jul 28 10:55:18 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:18 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7b9463ff-619e-4800-9487-2ec0318b41f7 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b 1073741824" returned: 0 in 0.585s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7b9463ff-619e-4800-9487-2ec0318b41f7 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:18 devstack sudo[107989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b Jul 28 10:55:18 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:18 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7c8f7d1d-751b-4128-8ea1-401e0f802bb4 tempest-ProjectReaderTests-1559131237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-29aa81b1-ea42-4fe6-8076-04dc7d450a1c" returned: 0 in 0.446s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7c8f7d1d-751b-4128-8ea1-401e0f802bb4 tempest-ProjectReaderTests-1559131237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-29aa81b1-ea42-4fe6-8076-04dc7d450a1c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:18 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-29aa81b1-ea42-4fe6-8076-04dc7d450a1c Jul 28 10:55:18 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:19 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7b9463ff-619e-4800-9487-2ec0318b41f7 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b" returned: 0 in 0.279s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:19 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7b9463ff-619e-4800-9487-2ec0318b41f7 tempest-ProjectMemberTests-1781514586 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:55:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7b9463ff-619e-4800-9487-2ec0318b41f7 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7b9463ff-619e-4800-9487-2ec0318b41f7 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1a4bab3-1180-4f2a-9f6e-4ba9236476e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c3af05d-fe50-4658-a8a4-eb63d081127b', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7b9463ff-619e-4800-9487-2ec0318b41f7 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (498b21e1-1762-4d85-a901-73134ca42d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:19 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-7b9463ff-619e-4800-9487-2ec0318b41f7 tempest-ProjectMemberTests-1781514586 None] Volume volume-0c3af05d-fe50-4658-a8a4-eb63d081127b (0c3af05d-fe50-4658-a8a4-eb63d081127b): created successfully Jul 28 10:55:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7b9463ff-619e-4800-9487-2ec0318b41f7 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (498b21e1-1762-4d85-a901-73134ca42d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7b9463ff-619e-4800-9487-2ec0318b41f7 tempest-ProjectMemberTests-1781514586 None] Flow 'volume_create_manager' (f7262263-9890-44cf-b80c-90c17df1dd27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:55:19 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-7b9463ff-619e-4800-9487-2ec0318b41f7 tempest-ProjectMemberTests-1781514586 None] Created volume successfully. Jul 28 10:55:19 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7c8f7d1d-751b-4128-8ea1-401e0f802bb4 tempest-ProjectReaderTests-1559131237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-29aa81b1-ea42-4fe6-8076-04dc7d450a1c" returned: 0 in 0.311s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:19 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7c8f7d1d-751b-4128-8ea1-401e0f802bb4 tempest-ProjectReaderTests-1559131237 None] Lock "cinder-quobyte-29aa81b1-ea42-4fe6-8076-04dc7d450a1c" released by "delete_volume" :: held 0.810s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:19 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-7c8f7d1d-751b-4128-8ea1-401e0f802bb4 tempest-ProjectReaderTests-1559131237 None] Created reservations ['8ac6449f-65c5-4ceb-b5b0-4932905c5d58', '71ecd81e-3f19-4692-a74c-0046c08ce714', '92cd1260-42c9-41c1-aeaf-6ec1ff749a14', 'd49fe902-b9bb-4595-a0db-76bb1abf44c8'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:55:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7c8f7d1d-751b-4128-8ea1-401e0f802bb4 tempest-ProjectReaderTests-1559131237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7c8f7d1d-751b-4128-8ea1-401e0f802bb4 tempest-ProjectReaderTests-1559131237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:19 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7c8f7d1d-751b-4128-8ea1-401e0f802bb4 tempest-ProjectReaderTests-1559131237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:55:19 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7c8f7d1d-751b-4128-8ea1-401e0f802bb4 tempest-ProjectReaderTests-1559131237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:55:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7c8f7d1d-751b-4128-8ea1-401e0f802bb4 tempest-ProjectReaderTests-1559131237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7c8f7d1d-751b-4128-8ea1-401e0f802bb4 tempest-ProjectReaderTests-1559131237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:19 devstack sudo[107999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:55:19 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:19 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7c8f7d1d-751b-4128-8ea1-401e0f802bb4 tempest-ProjectReaderTests-1559131237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.422s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:19 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-7c8f7d1d-751b-4128-8ea1-401e0f802bb4 tempest-ProjectReaderTests-1559131237 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:55:19 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-7c8f7d1d-751b-4128-8ea1-401e0f802bb4 tempest-ProjectReaderTests-1559131237 None] Deleted volume successfully. Jul 28 10:55:19 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7c8f7d1d-751b-4128-8ea1-401e0f802bb4 tempest-ProjectReaderTests-1559131237 None] Lock "cinder-29aa81b1-ea42-4fe6-8076-04dc7d450a1c-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:20 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca246389-c350-40df-8057-7b71e733eade tempest-ProjectReaderTests-1559131237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:55:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ca246389-c350-40df-8057-7b71e733eade tempest-ProjectReaderTests-1559131237 None] Flow 'volume_create_manager' (94ecbc04-811a-41a1-9c33-b1c8c7010cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:55:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ca246389-c350-40df-8057-7b71e733eade tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1963e9d6-a833-4e56-a055-dbe874d5e3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ca246389-c350-40df-8057-7b71e733eade tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1963e9d6-a833-4e56-a055-dbe874d5e3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1368828968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2090aa10-c05c-4661-a29b-474860320f36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e809d2b3590e4773b21dff75fddc337c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:55:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:55:20Z,use_quota=True,user_id='0888e2403d394ef590bbf50188e14d5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ca246389-c350-40df-8057-7b71e733eade tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aea56bd0-e55a-47be-8383-8304435ab5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ca246389-c350-40df-8057-7b71e733eade tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aea56bd0-e55a-47be-8383-8304435ab5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ca246389-c350-40df-8057-7b71e733eade tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbfb0e37-731e-4956-9379-4dc7abc672b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ca246389-c350-40df-8057-7b71e733eade tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbfb0e37-731e-4956-9379-4dc7abc672b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2090aa10-c05c-4661-a29b-474860320f36', 'volume_name': 'volume-2090aa10-c05c-4661-a29b-474860320f36', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ca246389-c350-40df-8057-7b71e733eade tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ce31e00-e1bb-4cc5-9e49-f8c522eec117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ca246389-c350-40df-8057-7b71e733eade tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ce31e00-e1bb-4cc5-9e49-f8c522eec117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ca246389-c350-40df-8057-7b71e733eade tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e40753ff-1d9e-4006-9c6e-0752f9276aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:20 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-ca246389-c350-40df-8057-7b71e733eade tempest-ProjectReaderTests-1559131237 None] Volume 2090aa10-c05c-4661-a29b-474860320f36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2090aa10-c05c-4661-a29b-474860320f36', 'volume_size': 1} Jul 28 10:55:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ca246389-c350-40df-8057-7b71e733eade tempest-ProjectReaderTests-1559131237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ca246389-c350-40df-8057-7b71e733eade tempest-ProjectReaderTests-1559131237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:20 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-ca246389-c350-40df-8057-7b71e733eade tempest-ProjectReaderTests-1559131237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1368828968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2090aa10-c05c-4661-a29b-474860320f36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e809d2b3590e4773b21dff75fddc337c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:55:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:55:20Z,use_quota=True,user_id='0888e2403d394ef590bbf50188e14d5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:55:20 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-ca246389-c350-40df-8057-7b71e733eade tempest-ProjectReaderTests-1559131237 None] Creating volume 2090aa10-c05c-4661-a29b-474860320f36 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:55:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ca246389-c350-40df-8057-7b71e733eade tempest-ProjectReaderTests-1559131237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ca246389-c350-40df-8057-7b71e733eade tempest-ProjectReaderTests-1559131237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:20 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-ca246389-c350-40df-8057-7b71e733eade tempest-ProjectReaderTests-1559131237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:55:20 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-ca246389-c350-40df-8057-7b71e733eade tempest-ProjectReaderTests-1559131237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:55:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ca246389-c350-40df-8057-7b71e733eade tempest-ProjectReaderTests-1559131237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:20 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-ca246389-c350-40df-8057-7b71e733eade tempest-ProjectReaderTests-1559131237 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:55:20 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-ca246389-c350-40df-8057-7b71e733eade tempest-ProjectReaderTests-1559131237 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:55:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ca246389-c350-40df-8057-7b71e733eade tempest-ProjectReaderTests-1559131237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2090aa10-c05c-4661-a29b-474860320f36 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:20 devstack sudo[108086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2090aa10-c05c-4661-a29b-474860320f36 1073741824 Jul 28 10:55:20 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-31b81292-9327-461f-b9de-2a03b389373e tempest-ProjectMemberTests-1781514586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:20 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7495022-ba8a-491c-a6c6-c88bce8c0b67 tempest-SnapshotDependencyTests-1391677029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:55:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c7495022-ba8a-491c-a6c6-c88bce8c0b67 tempest-SnapshotDependencyTests-1391677029 None] Flow 'volume_create_manager' (500b01cf-ce09-49dd-8291-142461252074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:55:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c7495022-ba8a-491c-a6c6-c88bce8c0b67 tempest-SnapshotDependencyTests-1391677029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce34ff07-7196-4a8c-a6e7-80bff16a357c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c7495022-ba8a-491c-a6c6-c88bce8c0b67 tempest-SnapshotDependencyTests-1391677029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce34ff07-7196-4a8c-a6e7-80bff16a357c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1881320421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b3c958e-b5cd-40fe-8ac8-500dcac492c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ea890ab30b4bd2a03b3c89fc68f23c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:55:21Z,use_quota=True,user_id='02fec31f952e4472b80b12b8739f4154',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c7495022-ba8a-491c-a6c6-c88bce8c0b67 tempest-SnapshotDependencyTests-1391677029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02724c4e-b071-4478-9805-8d857bf025d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c7495022-ba8a-491c-a6c6-c88bce8c0b67 tempest-SnapshotDependencyTests-1391677029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02724c4e-b071-4478-9805-8d857bf025d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:20 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:21 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c7495022-ba8a-491c-a6c6-c88bce8c0b67 tempest-SnapshotDependencyTests-1391677029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7793afe-2a81-4eb7-8ff5-4d2f56860510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:21 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c7495022-ba8a-491c-a6c6-c88bce8c0b67 tempest-SnapshotDependencyTests-1391677029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7793afe-2a81-4eb7-8ff5-4d2f56860510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b3c958e-b5cd-40fe-8ac8-500dcac492c5', 'volume_name': 'volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:21 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c7495022-ba8a-491c-a6c6-c88bce8c0b67 tempest-SnapshotDependencyTests-1391677029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e277abbd-650f-4a98-be19-08696afed9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:21 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c7495022-ba8a-491c-a6c6-c88bce8c0b67 tempest-SnapshotDependencyTests-1391677029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e277abbd-650f-4a98-be19-08696afed9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:21 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c7495022-ba8a-491c-a6c6-c88bce8c0b67 tempest-SnapshotDependencyTests-1391677029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b961d2af-03ce-4937-a069-d2ff145ff894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:21 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-c7495022-ba8a-491c-a6c6-c88bce8c0b67 tempest-SnapshotDependencyTests-1391677029 None] Volume 4b3c958e-b5cd-40fe-8ac8-500dcac492c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5', 'volume_size': 1} Jul 28 10:55:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c7495022-ba8a-491c-a6c6-c88bce8c0b67 tempest-SnapshotDependencyTests-1391677029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ca246389-c350-40df-8057-7b71e733eade tempest-ProjectReaderTests-1559131237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2090aa10-c05c-4661-a29b-474860320f36 1073741824" returned: 0 in 0.522s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ca246389-c350-40df-8057-7b71e733eade tempest-ProjectReaderTests-1559131237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2090aa10-c05c-4661-a29b-474860320f36 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:21 devstack sudo[108093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2090aa10-c05c-4661-a29b-474860320f36 Jul 28 10:55:21 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:21 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ca246389-c350-40df-8057-7b71e733eade tempest-ProjectReaderTests-1559131237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2090aa10-c05c-4661-a29b-474860320f36" returned: 0 in 0.272s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:21 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-ca246389-c350-40df-8057-7b71e733eade tempest-ProjectReaderTests-1559131237 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:55:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ca246389-c350-40df-8057-7b71e733eade tempest-ProjectReaderTests-1559131237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-31b81292-9327-461f-b9de-2a03b389373e tempest-ProjectMemberTests-1781514586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.788s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:21 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ca246389-c350-40df-8057-7b71e733eade tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e40753ff-1d9e-4006-9c6e-0752f9276aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2090aa10-c05c-4661-a29b-474860320f36', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:21 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ca246389-c350-40df-8057-7b71e733eade tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b41fa2a2-43eb-448f-91c4-13f1b0e9e273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:21 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-31b81292-9327-461f-b9de-2a03b389373e tempest-ProjectMemberTests-1781514586 None] Creating offline snapshot 71080976-0b65-4a03-912b-e9a07dd2ed89 of volume 0c3af05d-fe50-4658-a8a4-eb63d081127b {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:55:21 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-ca246389-c350-40df-8057-7b71e733eade tempest-ProjectReaderTests-1559131237 None] Volume volume-2090aa10-c05c-4661-a29b-474860320f36 (2090aa10-c05c-4661-a29b-474860320f36): created successfully Jul 28 10:55:21 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ca246389-c350-40df-8057-7b71e733eade tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b41fa2a2-43eb-448f-91c4-13f1b0e9e273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:21 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-ca246389-c350-40df-8057-7b71e733eade tempest-ProjectReaderTests-1559131237 None] Flow 'volume_create_manager' (94ecbc04-811a-41a1-9c33-b1c8c7010cb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:55:21 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebe9c1b-4610-455c-b6ff-3919d23cffca]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:55:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-31b81292-9327-461f-b9de-2a03b389373e tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:21 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-ca246389-c350-40df-8057-7b71e733eade tempest-ProjectReaderTests-1559131237 None] Created volume successfully. Jul 28 10:55:21 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b Jul 28 10:55:21 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:21 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-31b81292-9327-461f-b9de-2a03b389373e tempest-ProjectMemberTests-1781514586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b" returned: 0 in 0.378s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-31b81292-9327-461f-b9de-2a03b389373e tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b.71080976-0b65-4a03-912b-e9a07dd2ed89 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:21 devstack sudo[108101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b.71080976-0b65-4a03-912b-e9a07dd2ed89 1G Jul 28 10:55:21 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:22 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-31b81292-9327-461f-b9de-2a03b389373e tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b.71080976-0b65-4a03-912b-e9a07dd2ed89 1G" returned: 0 in 0.420s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-31b81292-9327-461f-b9de-2a03b389373e tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c3af05d-fe50-4658-a8a4-eb63d081127b -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b.71080976-0b65-4a03-912b-e9a07dd2ed89 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:22 devstack sudo[108107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c3af05d-fe50-4658-a8a4-eb63d081127b -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b.71080976-0b65-4a03-912b-e9a07dd2ed89 Jul 28 10:55:22 devstack sudo[108107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:22 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f8c94901-3c98-4bbe-bcc4-a65c3a75966b tempest-ProjectReaderTests-1559131237 None] Acquiring lock "cinder-2090aa10-c05c-4661-a29b-474860320f36-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:22 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f8c94901-3c98-4bbe-bcc4-a65c3a75966b tempest-ProjectReaderTests-1559131237 None] Lock "cinder-2090aa10-c05c-4661-a29b-474860320f36-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:22 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f8c94901-3c98-4bbe-bcc4-a65c3a75966b tempest-ProjectReaderTests-1559131237 None] Acquiring lock "cinder-quobyte-2090aa10-c05c-4661-a29b-474860320f36" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:22 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f8c94901-3c98-4bbe-bcc4-a65c3a75966b tempest-ProjectReaderTests-1559131237 None] Lock "cinder-quobyte-2090aa10-c05c-4661-a29b-474860320f36" acquired by "delete_volume" :: waited 0.018s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:22 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd80bdd7-962b-41f1-9d5c-21871b0f2e17]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:55:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f8c94901-3c98-4bbe-bcc4-a65c3a75966b tempest-ProjectReaderTests-1559131237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2090aa10-c05c-4661-a29b-474860320f36 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:22 devstack sudo[108109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2090aa10-c05c-4661-a29b-474860320f36 Jul 28 10:55:22 devstack sudo[108109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:22 devstack sudo[108107]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-31b81292-9327-461f-b9de-2a03b389373e tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c3af05d-fe50-4658-a8a4-eb63d081127b -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b.71080976-0b65-4a03-912b-e9a07dd2ed89" returned: 0 in 0.317s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:22 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-31b81292-9327-461f-b9de-2a03b389373e tempest-ProjectMemberTests-1781514586 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b.71080976-0b65-4a03-912b-e9a07dd2ed89 is being set with open permissions: ugo+rw Jul 28 10:55:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-31b81292-9327-461f-b9de-2a03b389373e tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b.71080976-0b65-4a03-912b-e9a07dd2ed89 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:22 devstack sudo[108114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b.71080976-0b65-4a03-912b-e9a07dd2ed89 Jul 28 10:55:22 devstack sudo[108114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:22 devstack sudo[108109]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f8c94901-3c98-4bbe-bcc4-a65c3a75966b tempest-ProjectReaderTests-1559131237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2090aa10-c05c-4661-a29b-474860320f36" returned: 0 in 0.364s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f8c94901-3c98-4bbe-bcc4-a65c3a75966b tempest-ProjectReaderTests-1559131237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2090aa10-c05c-4661-a29b-474860320f36 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:22 devstack sudo[108114]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-31b81292-9327-461f-b9de-2a03b389373e tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b.71080976-0b65-4a03-912b-e9a07dd2ed89" returned: 0 in 0.256s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:22 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2090aa10-c05c-4661-a29b-474860320f36 Jul 28 10:55:22 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-31b81292-9327-461f-b9de-2a03b389373e tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:22 devstack sudo[108122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b.info Jul 28 10:55:22 devstack sudo[108122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:23 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f8c94901-3c98-4bbe-bcc4-a65c3a75966b tempest-ProjectReaderTests-1559131237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-2090aa10-c05c-4661-a29b-474860320f36" returned: 0 in 0.249s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:23 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f8c94901-3c98-4bbe-bcc4-a65c3a75966b tempest-ProjectReaderTests-1559131237 None] Lock "cinder-quobyte-2090aa10-c05c-4661-a29b-474860320f36" released by "delete_volume" :: held 0.657s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:23 devstack sudo[108122]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-31b81292-9327-461f-b9de-2a03b389373e tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b.info" returned: 0 in 0.264s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:23 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-31b81292-9327-461f-b9de-2a03b389373e tempest-ProjectMemberTests-1781514586 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b.info is being set with open permissions: ugo+rw Jul 28 10:55:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-31b81292-9327-461f-b9de-2a03b389373e tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:23 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-f8c94901-3c98-4bbe-bcc4-a65c3a75966b tempest-ProjectReaderTests-1559131237 None] Created reservations ['fe83a826-30de-4875-81a0-92cbf8c334e0', '3c64047b-c62e-4d42-b1e4-d1acb9b51a7f', '753966f5-8adc-4ce1-abb5-00650d7ed209', '17bbc498-3133-4236-8f88-8caae0dd81fd'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:55:23 devstack sudo[108126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b.info Jul 28 10:55:23 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f8c94901-3c98-4bbe-bcc4-a65c3a75966b tempest-ProjectReaderTests-1559131237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f8c94901-3c98-4bbe-bcc4-a65c3a75966b tempest-ProjectReaderTests-1559131237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:23 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f8c94901-3c98-4bbe-bcc4-a65c3a75966b tempest-ProjectReaderTests-1559131237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:55:23 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-f8c94901-3c98-4bbe-bcc4-a65c3a75966b tempest-ProjectReaderTests-1559131237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:55:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-f8c94901-3c98-4bbe-bcc4-a65c3a75966b tempest-ProjectReaderTests-1559131237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f8c94901-3c98-4bbe-bcc4-a65c3a75966b tempest-ProjectReaderTests-1559131237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:23 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:55:23 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:23 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-31b81292-9327-461f-b9de-2a03b389373e tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b.info" returned: 0 in 0.262s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-31b81292-9327-461f-b9de-2a03b389373e tempest-ProjectMemberTests-1781514586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.014s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c7495022-ba8a-491c-a6c6-c88bce8c0b67 tempest-SnapshotDependencyTests-1391677029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.342s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:23 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c7495022-ba8a-491c-a6c6-c88bce8c0b67 tempest-SnapshotDependencyTests-1391677029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1881320421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b3c958e-b5cd-40fe-8ac8-500dcac492c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ea890ab30b4bd2a03b3c89fc68f23c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:55:21Z,use_quota=True,user_id='02fec31f952e4472b80b12b8739f4154',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:55:23 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-c7495022-ba8a-491c-a6c6-c88bce8c0b67 tempest-SnapshotDependencyTests-1391677029 None] Creating volume 4b3c958e-b5cd-40fe-8ac8-500dcac492c5 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:55:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c7495022-ba8a-491c-a6c6-c88bce8c0b67 tempest-SnapshotDependencyTests-1391677029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c7495022-ba8a-491c-a6c6-c88bce8c0b67 tempest-SnapshotDependencyTests-1391677029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:23 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c7495022-ba8a-491c-a6c6-c88bce8c0b67 tempest-SnapshotDependencyTests-1391677029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:55:23 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c7495022-ba8a-491c-a6c6-c88bce8c0b67 tempest-SnapshotDependencyTests-1391677029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:55:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c7495022-ba8a-491c-a6c6-c88bce8c0b67 tempest-SnapshotDependencyTests-1391677029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:23 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c7495022-ba8a-491c-a6c6-c88bce8c0b67 tempest-SnapshotDependencyTests-1391677029 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:55:23 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-c7495022-ba8a-491c-a6c6-c88bce8c0b67 tempest-SnapshotDependencyTests-1391677029 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:55:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c7495022-ba8a-491c-a6c6-c88bce8c0b67 tempest-SnapshotDependencyTests-1391677029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:23 devstack sudo[108132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5 1073741824 Jul 28 10:55:23 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:23 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-31b81292-9327-461f-b9de-2a03b389373e tempest-ProjectMemberTests-1781514586 None] Create snapshot completed successfully Jul 28 10:55:23 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-f8c94901-3c98-4bbe-bcc4-a65c3a75966b tempest-ProjectReaderTests-1559131237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.277s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:23 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-f8c94901-3c98-4bbe-bcc4-a65c3a75966b tempest-ProjectReaderTests-1559131237 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:55:23 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-f8c94901-3c98-4bbe-bcc4-a65c3a75966b tempest-ProjectReaderTests-1559131237 None] Deleted volume successfully. Jul 28 10:55:23 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-f8c94901-3c98-4bbe-bcc4-a65c3a75966b tempest-ProjectReaderTests-1559131237 None] Lock "cinder-2090aa10-c05c-4661-a29b-474860320f36-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:23 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1a351856-2741-46d6-a105-c6c6e8e09f1f tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-71080976-0b65-4a03-912b-e9a07dd2ed89-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:23 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1a351856-2741-46d6-a105-c6c6e8e09f1f tempest-ProjectMemberTests-1781514586 None] Lock "cinder-71080976-0b65-4a03-912b-e9a07dd2ed89-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:23 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1a351856-2741-46d6-a105-c6c6e8e09f1f tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-quobyte-0c3af05d-fe50-4658-a8a4-eb63d081127b" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:23 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1a351856-2741-46d6-a105-c6c6e8e09f1f tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-0c3af05d-fe50-4658-a8a4-eb63d081127b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:23 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1a351856-2741-46d6-a105-c6c6e8e09f1f tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-quobyte-71080976-0b65-4a03-912b-e9a07dd2ed89" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:23 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1a351856-2741-46d6-a105-c6c6e8e09f1f tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-71080976-0b65-4a03-912b-e9a07dd2ed89" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:23 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-1a351856-2741-46d6-a105-c6c6e8e09f1f tempest-ProjectMemberTests-1781514586 None] Deleting offline snapshot 71080976-0b65-4a03-912b-e9a07dd2ed89 of volume 0c3af05d-fe50-4658-a8a4-eb63d081127b {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:55:23 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-1a351856-2741-46d6-a105-c6c6e8e09f1f tempest-ProjectMemberTests-1781514586 None] snapshot_file for this snap is: volume-0c3af05d-fe50-4658-a8a4-eb63d081127b.71080976-0b65-4a03-912b-e9a07dd2ed89 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:55:23 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d38ceb4-ee49-4b4e-a52e-28b2d9e574a5]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:55:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1a351856-2741-46d6-a105-c6c6e8e09f1f tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b.71080976-0b65-4a03-912b-e9a07dd2ed89 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:23 devstack sudo[108137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b.71080976-0b65-4a03-912b-e9a07dd2ed89 Jul 28 10:55:23 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:23 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c7495022-ba8a-491c-a6c6-c88bce8c0b67 tempest-SnapshotDependencyTests-1391677029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5 1073741824" returned: 0 in 0.591s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:24 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b40013c-1e9e-4a22-8cee-6c8e0b4796cd tempest-ProjectReaderTests-1559131237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:55:24 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8b40013c-1e9e-4a22-8cee-6c8e0b4796cd tempest-ProjectReaderTests-1559131237 None] Flow 'volume_create_manager' (9cd20e42-d968-4229-bc07-5d4e91a977a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:55:24 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8b40013c-1e9e-4a22-8cee-6c8e0b4796cd tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95e1a1da-fb2f-485a-bf6c-63b5b93df548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c7495022-ba8a-491c-a6c6-c88bce8c0b67 tempest-SnapshotDependencyTests-1391677029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:24 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8b40013c-1e9e-4a22-8cee-6c8e0b4796cd tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95e1a1da-fb2f-485a-bf6c-63b5b93df548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-866919569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=736d2202-e55e-406b-8d45-fd22dc4c1fdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e809d2b3590e4773b21dff75fddc337c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:55:24Z,use_quota=True,user_id='0888e2403d394ef590bbf50188e14d5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:24 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8b40013c-1e9e-4a22-8cee-6c8e0b4796cd tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8e3cb1f-eed9-4ffd-9a16-6f8d6961bee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:24 devstack sudo[108140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5 Jul 28 10:55:24 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:24 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8b40013c-1e9e-4a22-8cee-6c8e0b4796cd tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8e3cb1f-eed9-4ffd-9a16-6f8d6961bee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:24 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8b40013c-1e9e-4a22-8cee-6c8e0b4796cd tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07a2a537-0697-4c44-996f-d31cc3347b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:24 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8b40013c-1e9e-4a22-8cee-6c8e0b4796cd tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07a2a537-0697-4c44-996f-d31cc3347b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '736d2202-e55e-406b-8d45-fd22dc4c1fdf', 'volume_name': 'volume-736d2202-e55e-406b-8d45-fd22dc4c1fdf', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:24 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8b40013c-1e9e-4a22-8cee-6c8e0b4796cd tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a79d3aa8-50d4-48c2-a7fa-3271bcc2b7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:24 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8b40013c-1e9e-4a22-8cee-6c8e0b4796cd tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a79d3aa8-50d4-48c2-a7fa-3271bcc2b7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:24 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8b40013c-1e9e-4a22-8cee-6c8e0b4796cd tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbf9c7bc-6f89-4c5d-b024-5d8db262cfbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:24 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-8b40013c-1e9e-4a22-8cee-6c8e0b4796cd tempest-ProjectReaderTests-1559131237 None] Volume 736d2202-e55e-406b-8d45-fd22dc4c1fdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-736d2202-e55e-406b-8d45-fd22dc4c1fdf', 'volume_size': 1} Jul 28 10:55:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8b40013c-1e9e-4a22-8cee-6c8e0b4796cd tempest-ProjectReaderTests-1559131237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:24 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1a351856-2741-46d6-a105-c6c6e8e09f1f tempest-ProjectMemberTests-1781514586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b.71080976-0b65-4a03-912b-e9a07dd2ed89" returned: 0 in 0.405s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:24 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-1a351856-2741-46d6-a105-c6c6e8e09f1f tempest-ProjectMemberTests-1781514586 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c3af05d-fe50-4658-a8a4-eb63d081127b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:55:24 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3762597-c637-4dd3-bea0-0a6134b82aef]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:55:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1a351856-2741-46d6-a105-c6c6e8e09f1f tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:24 devstack sudo[108145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b Jul 28 10:55:24 devstack sudo[108145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:24 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c7495022-ba8a-491c-a6c6-c88bce8c0b67 tempest-SnapshotDependencyTests-1391677029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5" returned: 0 in 0.246s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:24 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c7495022-ba8a-491c-a6c6-c88bce8c0b67 tempest-SnapshotDependencyTests-1391677029 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:55:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c7495022-ba8a-491c-a6c6-c88bce8c0b67 tempest-SnapshotDependencyTests-1391677029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8b40013c-1e9e-4a22-8cee-6c8e0b4796cd tempest-ProjectReaderTests-1559131237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.188s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:24 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8b40013c-1e9e-4a22-8cee-6c8e0b4796cd tempest-ProjectReaderTests-1559131237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-866919569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=736d2202-e55e-406b-8d45-fd22dc4c1fdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e809d2b3590e4773b21dff75fddc337c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:55:24Z,use_quota=True,user_id='0888e2403d394ef590bbf50188e14d5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:55:24 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-8b40013c-1e9e-4a22-8cee-6c8e0b4796cd tempest-ProjectReaderTests-1559131237 None] Creating volume 736d2202-e55e-406b-8d45-fd22dc4c1fdf {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:55:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8b40013c-1e9e-4a22-8cee-6c8e0b4796cd tempest-ProjectReaderTests-1559131237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8b40013c-1e9e-4a22-8cee-6c8e0b4796cd tempest-ProjectReaderTests-1559131237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:24 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8b40013c-1e9e-4a22-8cee-6c8e0b4796cd tempest-ProjectReaderTests-1559131237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:55:24 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8b40013c-1e9e-4a22-8cee-6c8e0b4796cd tempest-ProjectReaderTests-1559131237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:55:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8b40013c-1e9e-4a22-8cee-6c8e0b4796cd tempest-ProjectReaderTests-1559131237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:24 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8b40013c-1e9e-4a22-8cee-6c8e0b4796cd tempest-ProjectReaderTests-1559131237 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:55:24 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-8b40013c-1e9e-4a22-8cee-6c8e0b4796cd tempest-ProjectReaderTests-1559131237 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:55:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8b40013c-1e9e-4a22-8cee-6c8e0b4796cd tempest-ProjectReaderTests-1559131237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-736d2202-e55e-406b-8d45-fd22dc4c1fdf 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:24 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c7495022-ba8a-491c-a6c6-c88bce8c0b67 tempest-SnapshotDependencyTests-1391677029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b961d2af-03ce-4937-a069-d2ff145ff894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:24 devstack sudo[108148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-736d2202-e55e-406b-8d45-fd22dc4c1fdf 1073741824 Jul 28 10:55:24 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c7495022-ba8a-491c-a6c6-c88bce8c0b67 tempest-SnapshotDependencyTests-1391677029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a7e81b4-8e4f-46f6-8a37-e77784892afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:24 devstack sudo[108148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:24 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-c7495022-ba8a-491c-a6c6-c88bce8c0b67 tempest-SnapshotDependencyTests-1391677029 None] Volume volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5 (4b3c958e-b5cd-40fe-8ac8-500dcac492c5): created successfully Jul 28 10:55:24 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c7495022-ba8a-491c-a6c6-c88bce8c0b67 tempest-SnapshotDependencyTests-1391677029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a7e81b4-8e4f-46f6-8a37-e77784892afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:24 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c7495022-ba8a-491c-a6c6-c88bce8c0b67 tempest-SnapshotDependencyTests-1391677029 None] Flow 'volume_create_manager' (500b01cf-ce09-49dd-8291-142461252074) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:55:24 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-c7495022-ba8a-491c-a6c6-c88bce8c0b67 tempest-SnapshotDependencyTests-1391677029 None] Created volume successfully. Jul 28 10:55:24 devstack sudo[108145]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1a351856-2741-46d6-a105-c6c6e8e09f1f tempest-ProjectMemberTests-1781514586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b" returned: 0 in 0.386s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1a351856-2741-46d6-a105-c6c6e8e09f1f tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b.71080976-0b65-4a03-912b-e9a07dd2ed89 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:24 devstack sudo[108156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b.71080976-0b65-4a03-912b-e9a07dd2ed89 Jul 28 10:55:24 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:24 devstack sudo[108148]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8b40013c-1e9e-4a22-8cee-6c8e0b4796cd tempest-ProjectReaderTests-1559131237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-736d2202-e55e-406b-8d45-fd22dc4c1fdf 1073741824" returned: 0 in 0.437s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8b40013c-1e9e-4a22-8cee-6c8e0b4796cd tempest-ProjectReaderTests-1559131237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-736d2202-e55e-406b-8d45-fd22dc4c1fdf {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:24 devstack sudo[108160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-736d2202-e55e-406b-8d45-fd22dc4c1fdf Jul 28 10:55:24 devstack sudo[108160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:24 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1a351856-2741-46d6-a105-c6c6e8e09f1f tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b.71080976-0b65-4a03-912b-e9a07dd2ed89" returned: 0 in 0.341s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1a351856-2741-46d6-a105-c6c6e8e09f1f tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b.71080976-0b65-4a03-912b-e9a07dd2ed89 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:24 devstack sudo[108164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b.71080976-0b65-4a03-912b-e9a07dd2ed89 Jul 28 10:55:24 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:25 devstack sudo[108160]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8b40013c-1e9e-4a22-8cee-6c8e0b4796cd tempest-ProjectReaderTests-1559131237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-736d2202-e55e-406b-8d45-fd22dc4c1fdf" returned: 0 in 0.301s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:25 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8b40013c-1e9e-4a22-8cee-6c8e0b4796cd tempest-ProjectReaderTests-1559131237 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:55:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8b40013c-1e9e-4a22-8cee-6c8e0b4796cd tempest-ProjectReaderTests-1559131237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8b40013c-1e9e-4a22-8cee-6c8e0b4796cd tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbf9c7bc-6f89-4c5d-b024-5d8db262cfbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-736d2202-e55e-406b-8d45-fd22dc4c1fdf', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8b40013c-1e9e-4a22-8cee-6c8e0b4796cd tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dcc0a38-a2a6-41df-8d4f-02537f31bb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:25 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-8b40013c-1e9e-4a22-8cee-6c8e0b4796cd tempest-ProjectReaderTests-1559131237 None] Volume volume-736d2202-e55e-406b-8d45-fd22dc4c1fdf (736d2202-e55e-406b-8d45-fd22dc4c1fdf): created successfully Jul 28 10:55:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8b40013c-1e9e-4a22-8cee-6c8e0b4796cd tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dcc0a38-a2a6-41df-8d4f-02537f31bb5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:25 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-8b40013c-1e9e-4a22-8cee-6c8e0b4796cd tempest-ProjectReaderTests-1559131237 None] Flow 'volume_create_manager' (9cd20e42-d968-4229-bc07-5d4e91a977a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:55:25 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-8b40013c-1e9e-4a22-8cee-6c8e0b4796cd tempest-ProjectReaderTests-1559131237 None] Created volume successfully. Jul 28 10:55:25 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1a351856-2741-46d6-a105-c6c6e8e09f1f tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b.71080976-0b65-4a03-912b-e9a07dd2ed89" returned: 0 in 0.268s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:25 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1a351856-2741-46d6-a105-c6c6e8e09f1f tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-71080976-0b65-4a03-912b-e9a07dd2ed89" released by "_delete_snapshot" :: held 1.515s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:25 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1a351856-2741-46d6-a105-c6c6e8e09f1f tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-0c3af05d-fe50-4658-a8a4-eb63d081127b" released by "delete_snapshot" :: held 1.546s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:25 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-1a351856-2741-46d6-a105-c6c6e8e09f1f tempest-ProjectMemberTests-1781514586 None] Created reservations ['b440911c-0ffb-40e0-aa37-0fef83d55c9b', '18db0e4f-8cf7-450f-9252-f9fe109e02ea', '18c51bf0-b00f-46bb-920a-741677725574', '5e4119a1-516c-42c9-b36e-8da9712302d5'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:55:25 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-1a351856-2741-46d6-a105-c6c6e8e09f1f tempest-ProjectMemberTests-1781514586 None] Delete snapshot completed successfully. Jul 28 10:55:25 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1a351856-2741-46d6-a105-c6c6e8e09f1f tempest-ProjectMemberTests-1781514586 None] Lock "cinder-71080976-0b65-4a03-912b-e9a07dd2ed89-delete_snapshot" released by "delete_snapshot" :: held 1.725s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-bfc42148-43f2-4de7-ab6c-a2ea4b023f51 tempest-SnapshotDependencyTests-1391677029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-bfc42148-43f2-4de7-ab6c-a2ea4b023f51 tempest-SnapshotDependencyTests-1391677029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:25 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-bfc42148-43f2-4de7-ab6c-a2ea4b023f51 tempest-SnapshotDependencyTests-1391677029 None] Creating offline snapshot dc0006ce-87fe-4986-85c1-c8fdfda57ae9 of volume 4b3c958e-b5cd-40fe-8ac8-500dcac492c5 {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:55:25 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c118cc8-c839-4d0e-b783-30cba08a7259]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:55:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bfc42148-43f2-4de7-ab6c-a2ea4b023f51 tempest-SnapshotDependencyTests-1391677029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:25 devstack sudo[108168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5 Jul 28 10:55:25 devstack sudo[108168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:25 devstack sudo[108168]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bfc42148-43f2-4de7-ab6c-a2ea4b023f51 tempest-SnapshotDependencyTests-1391677029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5" returned: 0 in 0.368s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bfc42148-43f2-4de7-ab6c-a2ea4b023f51 tempest-SnapshotDependencyTests-1391677029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5.dc0006ce-87fe-4986-85c1-c8fdfda57ae9 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:25 devstack sudo[108173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5.dc0006ce-87fe-4986-85c1-c8fdfda57ae9 1G Jul 28 10:55:25 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:25 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-661e9267-78ca-4cca-9c22-2cbeccd1d040 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-0c3af05d-fe50-4658-a8a4-eb63d081127b-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:25 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-661e9267-78ca-4cca-9c22-2cbeccd1d040 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-0c3af05d-fe50-4658-a8a4-eb63d081127b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:25 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-661e9267-78ca-4cca-9c22-2cbeccd1d040 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-quobyte-0c3af05d-fe50-4658-a8a4-eb63d081127b" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:25 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-661e9267-78ca-4cca-9c22-2cbeccd1d040 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-0c3af05d-fe50-4658-a8a4-eb63d081127b" acquired by "delete_volume" :: waited 0.014s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:25 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[93dcbebb-122a-4565-9800-a3fa99e6e544]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:55:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-661e9267-78ca-4cca-9c22-2cbeccd1d040 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:26 devstack sudo[108175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b Jul 28 10:55:26 devstack sudo[108175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:26 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1e4d3b86-f9b0-4509-b29b-79b06558a866 tempest-ProjectReaderTests-1559131237 None] Acquiring lock "cinder-736d2202-e55e-406b-8d45-fd22dc4c1fdf-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:26 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1e4d3b86-f9b0-4509-b29b-79b06558a866 tempest-ProjectReaderTests-1559131237 None] Lock "cinder-736d2202-e55e-406b-8d45-fd22dc4c1fdf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:26 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1e4d3b86-f9b0-4509-b29b-79b06558a866 tempest-ProjectReaderTests-1559131237 None] Acquiring lock "cinder-quobyte-736d2202-e55e-406b-8d45-fd22dc4c1fdf" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:26 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1e4d3b86-f9b0-4509-b29b-79b06558a866 tempest-ProjectReaderTests-1559131237 None] Lock "cinder-quobyte-736d2202-e55e-406b-8d45-fd22dc4c1fdf" acquired by "delete_volume" :: waited 0.022s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:26 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[553d636b-f14f-4ad7-9f34-e3953884fbd1]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:55:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1e4d3b86-f9b0-4509-b29b-79b06558a866 tempest-ProjectReaderTests-1559131237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-736d2202-e55e-406b-8d45-fd22dc4c1fdf {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:26 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bfc42148-43f2-4de7-ab6c-a2ea4b023f51 tempest-SnapshotDependencyTests-1391677029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5.dc0006ce-87fe-4986-85c1-c8fdfda57ae9 1G" returned: 0 in 0.495s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bfc42148-43f2-4de7-ab6c-a2ea4b023f51 tempest-SnapshotDependencyTests-1391677029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5.dc0006ce-87fe-4986-85c1-c8fdfda57ae9 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:26 devstack sudo[108182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5.dc0006ce-87fe-4986-85c1-c8fdfda57ae9 Jul 28 10:55:26 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:26 devstack sudo[108175]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-661e9267-78ca-4cca-9c22-2cbeccd1d040 tempest-ProjectMemberTests-1781514586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b" returned: 0 in 0.452s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-661e9267-78ca-4cca-9c22-2cbeccd1d040 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:26 devstack sudo[108181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-736d2202-e55e-406b-8d45-fd22dc4c1fdf Jul 28 10:55:26 devstack sudo[108181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:26 devstack sudo[108188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b Jul 28 10:55:26 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:26 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bfc42148-43f2-4de7-ab6c-a2ea4b023f51 tempest-SnapshotDependencyTests-1391677029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5.dc0006ce-87fe-4986-85c1-c8fdfda57ae9" returned: 0 in 0.316s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:26 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-bfc42148-43f2-4de7-ab6c-a2ea4b023f51 tempest-SnapshotDependencyTests-1391677029 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5.dc0006ce-87fe-4986-85c1-c8fdfda57ae9 is being set with open permissions: ugo+rw Jul 28 10:55:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bfc42148-43f2-4de7-ab6c-a2ea4b023f51 tempest-SnapshotDependencyTests-1391677029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5.dc0006ce-87fe-4986-85c1-c8fdfda57ae9 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:26 devstack sudo[108195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5.dc0006ce-87fe-4986-85c1-c8fdfda57ae9 Jul 28 10:55:26 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:26 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-661e9267-78ca-4cca-9c22-2cbeccd1d040 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0c3af05d-fe50-4658-a8a4-eb63d081127b" returned: 0 in 0.270s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:26 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-661e9267-78ca-4cca-9c22-2cbeccd1d040 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-0c3af05d-fe50-4658-a8a4-eb63d081127b" released by "delete_volume" :: held 0.787s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:26 devstack sudo[108181]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1e4d3b86-f9b0-4509-b29b-79b06558a866 tempest-ProjectReaderTests-1559131237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-736d2202-e55e-406b-8d45-fd22dc4c1fdf" returned: 0 in 0.446s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1e4d3b86-f9b0-4509-b29b-79b06558a866 tempest-ProjectReaderTests-1559131237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-736d2202-e55e-406b-8d45-fd22dc4c1fdf {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:26 devstack sudo[108200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-736d2202-e55e-406b-8d45-fd22dc4c1fdf Jul 28 10:55:26 devstack sudo[108200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:26 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-661e9267-78ca-4cca-9c22-2cbeccd1d040 tempest-ProjectMemberTests-1781514586 None] Created reservations ['83c364b5-d263-406b-91a2-c9296f04ab51', '9e8fa308-f252-4f64-97c4-e14b5b7c043c', 'b85eb526-add7-44cc-9ebb-caf014cff7e9', '7b529ade-aa05-4b30-8183-e42411308ff3'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:55:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-661e9267-78ca-4cca-9c22-2cbeccd1d040 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-661e9267-78ca-4cca-9c22-2cbeccd1d040 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:26 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-661e9267-78ca-4cca-9c22-2cbeccd1d040 tempest-ProjectMemberTests-1781514586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:55:26 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-661e9267-78ca-4cca-9c22-2cbeccd1d040 tempest-ProjectMemberTests-1781514586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:55:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-661e9267-78ca-4cca-9c22-2cbeccd1d040 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-661e9267-78ca-4cca-9c22-2cbeccd1d040 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:26 devstack sudo[108202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:55:26 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:26 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bfc42148-43f2-4de7-ab6c-a2ea4b023f51 tempest-SnapshotDependencyTests-1391677029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5.dc0006ce-87fe-4986-85c1-c8fdfda57ae9" returned: 0 in 0.297s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bfc42148-43f2-4de7-ab6c-a2ea4b023f51 tempest-SnapshotDependencyTests-1391677029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:26 devstack sudo[108206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5.info Jul 28 10:55:26 devstack sudo[108206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:27 devstack sudo[108200]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1e4d3b86-f9b0-4509-b29b-79b06558a866 tempest-ProjectReaderTests-1559131237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-736d2202-e55e-406b-8d45-fd22dc4c1fdf" returned: 0 in 0.276s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1e4d3b86-f9b0-4509-b29b-79b06558a866 tempest-ProjectReaderTests-1559131237 None] Lock "cinder-quobyte-736d2202-e55e-406b-8d45-fd22dc4c1fdf" released by "delete_volume" :: held 0.776s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-1e4d3b86-f9b0-4509-b29b-79b06558a866 tempest-ProjectReaderTests-1559131237 None] Created reservations ['a4868dac-4158-4d41-8045-d93b5ffc291d', 'c8d65c3e-68df-4500-9d11-74cd58bbe446', '25446131-c1f7-4833-8b9e-1a5c17c6cbe3', 'cd24af42-d30b-4ff0-962e-6e4097b7d40a'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:55:27 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-661e9267-78ca-4cca-9c22-2cbeccd1d040 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.286s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-661e9267-78ca-4cca-9c22-2cbeccd1d040 tempest-ProjectMemberTests-1781514586 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:55:27 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-661e9267-78ca-4cca-9c22-2cbeccd1d040 tempest-ProjectMemberTests-1781514586 None] Deleted volume successfully. Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1e4d3b86-f9b0-4509-b29b-79b06558a866 tempest-ProjectReaderTests-1559131237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1e4d3b86-f9b0-4509-b29b-79b06558a866 tempest-ProjectReaderTests-1559131237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-1e4d3b86-f9b0-4509-b29b-79b06558a866 tempest-ProjectReaderTests-1559131237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-1e4d3b86-f9b0-4509-b29b-79b06558a866 tempest-ProjectReaderTests-1559131237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1e4d3b86-f9b0-4509-b29b-79b06558a866 tempest-ProjectReaderTests-1559131237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1e4d3b86-f9b0-4509-b29b-79b06558a866 tempest-ProjectReaderTests-1559131237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-661e9267-78ca-4cca-9c22-2cbeccd1d040 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-0c3af05d-fe50-4658-a8a4-eb63d081127b-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:27 devstack sudo[108209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:55:27 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:27 devstack sudo[108206]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bfc42148-43f2-4de7-ab6c-a2ea4b023f51 tempest-SnapshotDependencyTests-1391677029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5.info" returned: 0 in 0.330s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:27 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-bfc42148-43f2-4de7-ab6c-a2ea4b023f51 tempest-SnapshotDependencyTests-1391677029 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5.info is being set with open permissions: ugo+rw Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bfc42148-43f2-4de7-ab6c-a2ea4b023f51 tempest-SnapshotDependencyTests-1391677029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:27 devstack sudo[108212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5.info Jul 28 10:55:27 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:27 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1e4d3b86-f9b0-4509-b29b-79b06558a866 tempest-ProjectReaderTests-1559131237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.408s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-1e4d3b86-f9b0-4509-b29b-79b06558a866 tempest-ProjectReaderTests-1559131237 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:55:27 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-1e4d3b86-f9b0-4509-b29b-79b06558a866 tempest-ProjectReaderTests-1559131237 None] Deleted volume successfully. Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1e4d3b86-f9b0-4509-b29b-79b06558a866 tempest-ProjectReaderTests-1559131237 None] Lock "cinder-736d2202-e55e-406b-8d45-fd22dc4c1fdf-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:27 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bfc42148-43f2-4de7-ab6c-a2ea4b023f51 tempest-SnapshotDependencyTests-1391677029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5.info" returned: 0 in 0.387s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-bfc42148-43f2-4de7-ab6c-a2ea4b023f51 tempest-SnapshotDependencyTests-1391677029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.291s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bed1f8a-555f-42f4-a44f-56c3968d6865 tempest-ProjectMemberTests-1781514586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3bed1f8a-555f-42f4-a44f-56c3968d6865 tempest-ProjectMemberTests-1781514586 None] Flow 'volume_create_manager' (7c73a9c4-100e-4d6d-a1da-b6bfffb4401a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3bed1f8a-555f-42f4-a44f-56c3968d6865 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ebb51d-3e8a-4bda-ac79-065488145029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3bed1f8a-555f-42f4-a44f-56c3968d6865 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ebb51d-3e8a-4bda-ac79-065488145029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-370224547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61e1f2c346a4cddbe7adc3f82eccf01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:55:28Z,use_quota=True,user_id='443f2e63fd9f4abcbb3569fc8516b13f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3bed1f8a-555f-42f4-a44f-56c3968d6865 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cb6adc8-e63c-4ae9-94cd-5bd41994f7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3bed1f8a-555f-42f4-a44f-56c3968d6865 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cb6adc8-e63c-4ae9-94cd-5bd41994f7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3bed1f8a-555f-42f4-a44f-56c3968d6865 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24eb99c7-42bb-4ce3-96b0-efb470ca2922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3bed1f8a-555f-42f4-a44f-56c3968d6865 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24eb99c7-42bb-4ce3-96b0-efb470ca2922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c', 'volume_name': 'volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3bed1f8a-555f-42f4-a44f-56c3968d6865 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a72f107b-9e66-48ed-8382-afd1d6926a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3bed1f8a-555f-42f4-a44f-56c3968d6865 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a72f107b-9e66-48ed-8382-afd1d6926a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3bed1f8a-555f-42f4-a44f-56c3968d6865 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4ed3aa3-c67c-405f-889d-8b77c6b1dd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:27 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-3bed1f8a-555f-42f4-a44f-56c3968d6865 tempest-ProjectMemberTests-1781514586 None] Volume f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c', 'volume_size': 1} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3bed1f8a-555f-42f4-a44f-56c3968d6865 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3bed1f8a-555f-42f4-a44f-56c3968d6865 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3bed1f8a-555f-42f4-a44f-56c3968d6865 tempest-ProjectMemberTests-1781514586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-370224547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61e1f2c346a4cddbe7adc3f82eccf01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:55:28Z,use_quota=True,user_id='443f2e63fd9f4abcbb3569fc8516b13f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-3bed1f8a-555f-42f4-a44f-56c3968d6865 tempest-ProjectMemberTests-1781514586 None] Creating volume f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3bed1f8a-555f-42f4-a44f-56c3968d6865 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3bed1f8a-555f-42f4-a44f-56c3968d6865 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3bed1f8a-555f-42f4-a44f-56c3968d6865 tempest-ProjectMemberTests-1781514586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3bed1f8a-555f-42f4-a44f-56c3968d6865 tempest-ProjectMemberTests-1781514586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3bed1f8a-555f-42f4-a44f-56c3968d6865 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3bed1f8a-555f-42f4-a44f-56c3968d6865 tempest-ProjectMemberTests-1781514586 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:55:27 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-3bed1f8a-555f-42f4-a44f-56c3968d6865 tempest-ProjectMemberTests-1781514586 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3bed1f8a-555f-42f4-a44f-56c3968d6865 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:27 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-bfc42148-43f2-4de7-ab6c-a2ea4b023f51 tempest-SnapshotDependencyTests-1391677029 None] Create snapshot completed successfully Jul 28 10:55:27 devstack sudo[108216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c 1073741824 Jul 28 10:55:27 devstack sudo[108216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-05d36d00-9269-4ac3-af8d-4b641b3e3a3a tempest-ProjectReaderTests-1559131237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-05d36d00-9269-4ac3-af8d-4b641b3e3a3a tempest-ProjectReaderTests-1559131237 None] Flow 'volume_create_manager' (ec7abca3-d371-47a9-addc-d12c56c9670a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-05d36d00-9269-4ac3-af8d-4b641b3e3a3a tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b10eb5b-e015-4a44-ac58-5e1d99661c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-05d36d00-9269-4ac3-af8d-4b641b3e3a3a tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b10eb5b-e015-4a44-ac58-5e1d99661c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1497301499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=831507dc-63e4-4232-9ef3-45773bc5a2fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e809d2b3590e4773b21dff75fddc337c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:55:28Z,use_quota=True,user_id='0888e2403d394ef590bbf50188e14d5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-05d36d00-9269-4ac3-af8d-4b641b3e3a3a tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fb92c30-5098-4220-9d4b-9e74c05290a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-05d36d00-9269-4ac3-af8d-4b641b3e3a3a tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fb92c30-5098-4220-9d4b-9e74c05290a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-05d36d00-9269-4ac3-af8d-4b641b3e3a3a tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed5b6202-add7-4742-bd58-8c5a9f844a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-05d36d00-9269-4ac3-af8d-4b641b3e3a3a tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed5b6202-add7-4742-bd58-8c5a9f844a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '831507dc-63e4-4232-9ef3-45773bc5a2fa', 'volume_name': 'volume-831507dc-63e4-4232-9ef3-45773bc5a2fa', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-05d36d00-9269-4ac3-af8d-4b641b3e3a3a tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de0bf7c5-74fd-421d-b334-de2269c74745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-05d36d00-9269-4ac3-af8d-4b641b3e3a3a tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de0bf7c5-74fd-421d-b334-de2269c74745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:27 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-05d36d00-9269-4ac3-af8d-4b641b3e3a3a tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b54f38ff-1454-464c-a97c-1206aef7c8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:28 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-05d36d00-9269-4ac3-af8d-4b641b3e3a3a tempest-ProjectReaderTests-1559131237 None] Volume 831507dc-63e4-4232-9ef3-45773bc5a2fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-831507dc-63e4-4232-9ef3-45773bc5a2fa', 'volume_size': 1} Jul 28 10:55:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-05d36d00-9269-4ac3-af8d-4b641b3e3a3a tempest-ProjectReaderTests-1559131237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:28 devstack sudo[108216]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3bed1f8a-555f-42f4-a44f-56c3968d6865 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c 1073741824" returned: 0 in 0.427s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3bed1f8a-555f-42f4-a44f-56c3968d6865 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:28 devstack sudo[108221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c Jul 28 10:55:28 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:28 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:55:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:55:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:55:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:28 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:55:28 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:28 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3bed1f8a-555f-42f4-a44f-56c3968d6865 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c" returned: 0 in 0.266s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3bed1f8a-555f-42f4-a44f-56c3968d6865 tempest-ProjectMemberTests-1781514586 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:55:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3bed1f8a-555f-42f4-a44f-56c3968d6865 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-05d36d00-9269-4ac3-af8d-4b641b3e3a3a tempest-ProjectReaderTests-1559131237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.545s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-05d36d00-9269-4ac3-af8d-4b641b3e3a3a tempest-ProjectReaderTests-1559131237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1497301499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=831507dc-63e4-4232-9ef3-45773bc5a2fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e809d2b3590e4773b21dff75fddc337c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:55:28Z,use_quota=True,user_id='0888e2403d394ef590bbf50188e14d5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:55:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-05d36d00-9269-4ac3-af8d-4b641b3e3a3a tempest-ProjectReaderTests-1559131237 None] Creating volume 831507dc-63e4-4232-9ef3-45773bc5a2fa {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:55:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-05d36d00-9269-4ac3-af8d-4b641b3e3a3a tempest-ProjectReaderTests-1559131237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-05d36d00-9269-4ac3-af8d-4b641b3e3a3a tempest-ProjectReaderTests-1559131237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-05d36d00-9269-4ac3-af8d-4b641b3e3a3a tempest-ProjectReaderTests-1559131237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:55:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-05d36d00-9269-4ac3-af8d-4b641b3e3a3a tempest-ProjectReaderTests-1559131237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:55:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-05d36d00-9269-4ac3-af8d-4b641b3e3a3a tempest-ProjectReaderTests-1559131237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-05d36d00-9269-4ac3-af8d-4b641b3e3a3a tempest-ProjectReaderTests-1559131237 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:55:28 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-05d36d00-9269-4ac3-af8d-4b641b3e3a3a tempest-ProjectReaderTests-1559131237 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:55:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-05d36d00-9269-4ac3-af8d-4b641b3e3a3a tempest-ProjectReaderTests-1559131237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-831507dc-63e4-4232-9ef3-45773bc5a2fa 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3bed1f8a-555f-42f4-a44f-56c3968d6865 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4ed3aa3-c67c-405f-889d-8b77c6b1dd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3bed1f8a-555f-42f4-a44f-56c3968d6865 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f4b695e-3b5a-4d87-908d-497edffe84fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:28 devstack sudo[108226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-831507dc-63e4-4232-9ef3-45773bc5a2fa 1073741824 Jul 28 10:55:28 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:28 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-3bed1f8a-555f-42f4-a44f-56c3968d6865 tempest-ProjectMemberTests-1781514586 None] Volume volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c (f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c): created successfully Jul 28 10:55:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3bed1f8a-555f-42f4-a44f-56c3968d6865 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f4b695e-3b5a-4d87-908d-497edffe84fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3bed1f8a-555f-42f4-a44f-56c3968d6865 tempest-ProjectMemberTests-1781514586 None] Flow 'volume_create_manager' (7c73a9c4-100e-4d6d-a1da-b6bfffb4401a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:55:28 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-3bed1f8a-555f-42f4-a44f-56c3968d6865 tempest-ProjectMemberTests-1781514586 None] Created volume successfully. Jul 28 10:55:28 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.294s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:28 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:55:28 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager._thread_info {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:55:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread count: 29 {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 10:55:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread info: [<_MainThread(MainThread, started 137939890385024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 10:55:29 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-05d36d00-9269-4ac3-af8d-4b641b3e3a3a tempest-ProjectReaderTests-1559131237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-831507dc-63e4-4232-9ef3-45773bc5a2fa 1073741824" returned: 0 in 0.522s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-05d36d00-9269-4ac3-af8d-4b641b3e3a3a tempest-ProjectReaderTests-1559131237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-831507dc-63e4-4232-9ef3-45773bc5a2fa {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:29 devstack sudo[108233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-831507dc-63e4-4232-9ef3-45773bc5a2fa Jul 28 10:55:29 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Flow 'volume_create_manager' (75c84535-6b34-49cc-adef-a8af224e4b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7ab27d2-93ea-4564-9a57-776fc48d4f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7ab27d2-93ea-4564-9a57-776fc48d4f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3171dcce-6142-4781-a976-31acf20ae0f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ea890ab30b4bd2a03b3c89fc68f23c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dc0006ce-87fe-4986-85c1-c8fdfda57ae9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:55:29Z,use_quota=True,user_id='02fec31f952e4472b80b12b8739f4154',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a8723c8-f22f-4c4f-8e73-9efb947175e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a8723c8-f22f-4c4f-8e73-9efb947175e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8465f18-5a2a-4e5a-aea6-38ecacd3e29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8465f18-5a2a-4e5a-aea6-38ecacd3e29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3171dcce-6142-4781-a976-31acf20ae0f5', 'volume_name': 'volume-3171dcce-6142-4781-a976-31acf20ae0f5', 'volume_size': 1, 'snapshot_id': 'dc0006ce-87fe-4986-85c1-c8fdfda57ae9'}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3b7b935-ad4b-4e41-9a86-34a786335299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3b7b935-ad4b-4e41-9a86-34a786335299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc12db6-35f9-4009-b0e2-879a9724f0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:29 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Volume 3171dcce-6142-4781-a976-31acf20ae0f5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3171dcce-6142-4781-a976-31acf20ae0f5', 'volume_size': 1, 'snapshot_id': 'dc0006ce-87fe-4986-85c1-c8fdfda57ae9'} Jul 28 10:55:29 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-05d36d00-9269-4ac3-af8d-4b641b3e3a3a tempest-ProjectReaderTests-1559131237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-831507dc-63e4-4232-9ef3-45773bc5a2fa" returned: 0 in 0.266s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-05d36d00-9269-4ac3-af8d-4b641b3e3a3a tempest-ProjectReaderTests-1559131237 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-05d36d00-9269-4ac3-af8d-4b641b3e3a3a tempest-ProjectReaderTests-1559131237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Acquiring lock "cinder-quobyte-dc0006ce-87fe-4986-85c1-c8fdfda57ae9-3171dcce-6142-4781-a976-31acf20ae0f5" by "_create_volume_from_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-05d36d00-9269-4ac3-af8d-4b641b3e3a3a tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b54f38ff-1454-464c-a97c-1206aef7c8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-831507dc-63e4-4232-9ef3-45773bc5a2fa', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-05d36d00-9269-4ac3-af8d-4b641b3e3a3a tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e39f89-fc1a-493e-bd55-c7fc6277363a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:29 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-05d36d00-9269-4ac3-af8d-4b641b3e3a3a tempest-ProjectReaderTests-1559131237 None] Volume volume-831507dc-63e4-4232-9ef3-45773bc5a2fa (831507dc-63e4-4232-9ef3-45773bc5a2fa): created successfully Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-05d36d00-9269-4ac3-af8d-4b641b3e3a3a tempest-ProjectReaderTests-1559131237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e39f89-fc1a-493e-bd55-c7fc6277363a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-05d36d00-9269-4ac3-af8d-4b641b3e3a3a tempest-ProjectReaderTests-1559131237 None] Flow 'volume_create_manager' (ec7abca3-d371-47a9-addc-d12c56c9670a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Lock "cinder-quobyte-dc0006ce-87fe-4986-85c1-c8fdfda57ae9-3171dcce-6142-4781-a976-31acf20ae0f5" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Creating volume 3171dcce-6142-4781-a976-31acf20ae0f5 from snapshot dc0006ce-87fe-4986-85c1-c8fdfda57ae9 {{(pid=88413) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Acquiring lock "cinder-quobyte-3171dcce-6142-4781-a976-31acf20ae0f5" by "_copy_volume_from_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:29 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-05d36d00-9269-4ac3-af8d-4b641b3e3a3a tempest-ProjectReaderTests-1559131237 None] Created volume successfully. Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Lock "cinder-quobyte-3171dcce-6142-4781-a976-31acf20ae0f5" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] snapshot: dc0006ce-87fe-4986-85c1-c8fdfda57ae9, volume: 3171dcce-6142-4781-a976-31acf20ae0f5, {{(pid=88413) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f8a188-815a-483f-91ed-952d79361f9c]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5.dc0006ce-87fe-4986-85c1-c8fdfda57ae9 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:29 devstack sudo[108236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5.dc0006ce-87fe-4986-85c1-c8fdfda57ae9 Jul 28 10:55:29 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-312a906d-eb5c-466f-80db-ea6ef34b8dc3 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:29 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5.dc0006ce-87fe-4986-85c1-c8fdfda57ae9" returned: 0 in 0.466s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5 {{(pid=88413) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 28 10:55:29 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Creating direct copy from snapshot {{(pid=88413) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 28 10:55:30 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8589eb-424f-46e9-af9d-1f80df4f47a0]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:55:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:30 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-c774dcb2-e89c-4f5d-8dab-36442e7e5e6c tempest-ProjectReaderTests-1559131237 None] Acquiring lock "cinder-831507dc-63e4-4232-9ef3-45773bc5a2fa-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:30 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-c774dcb2-e89c-4f5d-8dab-36442e7e5e6c tempest-ProjectReaderTests-1559131237 None] Lock "cinder-831507dc-63e4-4232-9ef3-45773bc5a2fa-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:30 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-c774dcb2-e89c-4f5d-8dab-36442e7e5e6c tempest-ProjectReaderTests-1559131237 None] Acquiring lock "cinder-quobyte-831507dc-63e4-4232-9ef3-45773bc5a2fa" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:30 devstack sudo[108277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5 Jul 28 10:55:30 devstack sudo[108277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:30 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-c774dcb2-e89c-4f5d-8dab-36442e7e5e6c tempest-ProjectReaderTests-1559131237 None] Lock "cinder-quobyte-831507dc-63e4-4232-9ef3-45773bc5a2fa" acquired by "delete_volume" :: waited 0.019s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:30 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d58e3b0-7297-4118-9892-344ca59dae50]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:55:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c774dcb2-e89c-4f5d-8dab-36442e7e5e6c tempest-ProjectReaderTests-1559131237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-831507dc-63e4-4232-9ef3-45773bc5a2fa {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:30 devstack sudo[108280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-831507dc-63e4-4232-9ef3-45773bc5a2fa Jul 28 10:55:30 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:30 devstack sudo[108277]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5" returned: 0 in 0.402s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:30 devstack cinder-volume[88413]: DEBUG cinder.utils [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Path /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3171dcce-6142-4781-a976-31acf20ae0f5 not found in is_blk_device check {{(pid=88413) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 28 10:55:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3171dcce-6142-4781-a976-31acf20ae0f5 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:30 devstack sudo[108285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3171dcce-6142-4781-a976-31acf20ae0f5 Jul 28 10:55:30 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:30 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c774dcb2-e89c-4f5d-8dab-36442e7e5e6c tempest-ProjectReaderTests-1559131237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-831507dc-63e4-4232-9ef3-45773bc5a2fa" returned: 0 in 0.383s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c774dcb2-e89c-4f5d-8dab-36442e7e5e6c tempest-ProjectReaderTests-1559131237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-831507dc-63e4-4232-9ef3-45773bc5a2fa {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:30 devstack sudo[108290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-831507dc-63e4-4232-9ef3-45773bc5a2fa Jul 28 10:55:30 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:30 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c774dcb2-e89c-4f5d-8dab-36442e7e5e6c tempest-ProjectReaderTests-1559131237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-831507dc-63e4-4232-9ef3-45773bc5a2fa" returned: 0 in 0.257s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:30 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-c774dcb2-e89c-4f5d-8dab-36442e7e5e6c tempest-ProjectReaderTests-1559131237 None] Lock "cinder-quobyte-831507dc-63e4-4232-9ef3-45773bc5a2fa" released by "delete_volume" :: held 0.698s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:30 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-c774dcb2-e89c-4f5d-8dab-36442e7e5e6c tempest-ProjectReaderTests-1559131237 None] Created reservations ['3316a5da-a1b1-4634-813f-0feeb67c2166', 'eb27e173-307d-482a-b42b-ef71f0cf5ad3', '0a17a8ff-6938-41e5-b1e6-731e8237086a', 'ef4a3a84-69a2-4e0d-8845-c3b3be27586d'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:55:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c774dcb2-e89c-4f5d-8dab-36442e7e5e6c tempest-ProjectReaderTests-1559131237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c774dcb2-e89c-4f5d-8dab-36442e7e5e6c tempest-ProjectReaderTests-1559131237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:31 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c774dcb2-e89c-4f5d-8dab-36442e7e5e6c tempest-ProjectReaderTests-1559131237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:55:31 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c774dcb2-e89c-4f5d-8dab-36442e7e5e6c tempest-ProjectReaderTests-1559131237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:55:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c774dcb2-e89c-4f5d-8dab-36442e7e5e6c tempest-ProjectReaderTests-1559131237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c774dcb2-e89c-4f5d-8dab-36442e7e5e6c tempest-ProjectReaderTests-1559131237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:31 devstack sudo[108303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:55:31 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:31 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c774dcb2-e89c-4f5d-8dab-36442e7e5e6c tempest-ProjectReaderTests-1559131237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.470s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:31 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-c774dcb2-e89c-4f5d-8dab-36442e7e5e6c tempest-ProjectReaderTests-1559131237 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:55:31 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-c774dcb2-e89c-4f5d-8dab-36442e7e5e6c tempest-ProjectReaderTests-1559131237 None] Deleted volume successfully. Jul 28 10:55:31 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-c774dcb2-e89c-4f5d-8dab-36442e7e5e6c tempest-ProjectReaderTests-1559131237 None] Lock "cinder-831507dc-63e4-4232-9ef3-45773bc5a2fa-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:35 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3171dcce-6142-4781-a976-31acf20ae0f5" returned: 0 in 5.156s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:35 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[85665266-618b-4466-a408-113302a97f2f]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:55:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:35 devstack sudo[108315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5 Jul 28 10:55:35 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:36 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5" returned: 0 in 0.525s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:36 devstack cinder-volume[88413]: DEBUG cinder.image.image_utils [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5, size 1024.00 MB, duration 5.16 sec, destination /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3171dcce-6142-4781-a976-31acf20ae0f5 {{(pid=88413) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 10:55:36 devstack cinder-volume[88413]: INFO cinder.image.image_utils [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Converted 1024.00 MB image at 198.58 MB/s Jul 28 10:55:36 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3171dcce-6142-4781-a976-31acf20ae0f5 is being set with open permissions: ugo+rw Jul 28 10:55:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3171dcce-6142-4781-a976-31acf20ae0f5 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:36 devstack sudo[108320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3171dcce-6142-4781-a976-31acf20ae0f5 Jul 28 10:55:36 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:36 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3171dcce-6142-4781-a976-31acf20ae0f5" returned: 0 in 0.254s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:36 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Lock "cinder-quobyte-3171dcce-6142-4781-a976-31acf20ae0f5" released by "_copy_volume_from_snapshot" :: held 6.905s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:36 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Lock "cinder-quobyte-dc0006ce-87fe-4986-85c1-c8fdfda57ae9-3171dcce-6142-4781-a976-31acf20ae0f5" released by "_create_volume_from_snapshot" :: held 6.939s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.983s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-312a906d-eb5c-466f-80db-ea6ef34b8dc3 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.459s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:36 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-312a906d-eb5c-466f-80db-ea6ef34b8dc3 tempest-ProjectMemberTests-1781514586 None] Creating offline snapshot 654d01db-61dc-4d58-82f0-6925e386a593 of volume f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:55:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc12db6-35f9-4009-b0e2-879a9724f0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3171dcce-6142-4781-a976-31acf20ae0f5', 'volume_size': 1, 'snapshot_id': 'dc0006ce-87fe-4986-85c1-c8fdfda57ae9'}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faf0bbb6-ef15-4910-b330-2684759437de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:36 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[62119951-0178-4e98-ad40-d253e45a587d]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:55:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-312a906d-eb5c-466f-80db-ea6ef34b8dc3 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:36 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Volume volume-3171dcce-6142-4781-a976-31acf20ae0f5 (3171dcce-6142-4781-a976-31acf20ae0f5): created successfully Jul 28 10:55:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faf0bbb6-ef15-4910-b330-2684759437de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:36 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Flow 'volume_create_manager' (75c84535-6b34-49cc-adef-a8af224e4b55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:55:36 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-aff208fa-421a-4cae-9b23-45d3f27ba044 tempest-SnapshotDependencyTests-1391677029 None] Created volume successfully. Jul 28 10:55:36 devstack sudo[108323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c Jul 28 10:55:36 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:36 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-312a906d-eb5c-466f-80db-ea6ef34b8dc3 tempest-ProjectMemberTests-1781514586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c" returned: 0 in 0.354s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-312a906d-eb5c-466f-80db-ea6ef34b8dc3 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c.654d01db-61dc-4d58-82f0-6925e386a593 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:36 devstack sudo[108328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c.654d01db-61dc-4d58-82f0-6925e386a593 1G Jul 28 10:55:36 devstack sudo[108328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:37 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-d1b97bee-0cd6-47bf-bfa6-966693c7f49f tempest-SnapshotDependencyTests-1391677029 None] Acquiring lock "cinder-dc0006ce-87fe-4986-85c1-c8fdfda57ae9-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:37 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-d1b97bee-0cd6-47bf-bfa6-966693c7f49f tempest-SnapshotDependencyTests-1391677029 None] Lock "cinder-dc0006ce-87fe-4986-85c1-c8fdfda57ae9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:37 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-d1b97bee-0cd6-47bf-bfa6-966693c7f49f tempest-SnapshotDependencyTests-1391677029 None] Acquiring lock "cinder-quobyte-4b3c958e-b5cd-40fe-8ac8-500dcac492c5" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:37 devstack sudo[108328]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-312a906d-eb5c-466f-80db-ea6ef34b8dc3 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c.654d01db-61dc-4d58-82f0-6925e386a593 1G" returned: 0 in 0.422s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-312a906d-eb5c-466f-80db-ea6ef34b8dc3 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c.654d01db-61dc-4d58-82f0-6925e386a593 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:37 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-d1b97bee-0cd6-47bf-bfa6-966693c7f49f tempest-SnapshotDependencyTests-1391677029 None] Lock "cinder-quobyte-4b3c958e-b5cd-40fe-8ac8-500dcac492c5" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:37 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-d1b97bee-0cd6-47bf-bfa6-966693c7f49f tempest-SnapshotDependencyTests-1391677029 None] Acquiring lock "cinder-quobyte-dc0006ce-87fe-4986-85c1-c8fdfda57ae9" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:37 devstack sudo[108333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c.654d01db-61dc-4d58-82f0-6925e386a593 Jul 28 10:55:37 devstack sudo[108333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:37 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-d1b97bee-0cd6-47bf-bfa6-966693c7f49f tempest-SnapshotDependencyTests-1391677029 None] Lock "cinder-quobyte-dc0006ce-87fe-4986-85c1-c8fdfda57ae9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:37 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-d1b97bee-0cd6-47bf-bfa6-966693c7f49f tempest-SnapshotDependencyTests-1391677029 None] Deleting offline snapshot dc0006ce-87fe-4986-85c1-c8fdfda57ae9 of volume 4b3c958e-b5cd-40fe-8ac8-500dcac492c5 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:55:37 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-d1b97bee-0cd6-47bf-bfa6-966693c7f49f tempest-SnapshotDependencyTests-1391677029 None] snapshot_file for this snap is: volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5.dc0006ce-87fe-4986-85c1-c8fdfda57ae9 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:55:37 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[3917e3d8-d018-4c5c-907c-83f4f85fc064]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:55:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d1b97bee-0cd6-47bf-bfa6-966693c7f49f tempest-SnapshotDependencyTests-1391677029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5.dc0006ce-87fe-4986-85c1-c8fdfda57ae9 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:37 devstack sudo[108335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5.dc0006ce-87fe-4986-85c1-c8fdfda57ae9 Jul 28 10:55:37 devstack sudo[108335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:37 devstack sudo[108333]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-312a906d-eb5c-466f-80db-ea6ef34b8dc3 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c.654d01db-61dc-4d58-82f0-6925e386a593" returned: 0 in 0.307s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:37 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-312a906d-eb5c-466f-80db-ea6ef34b8dc3 tempest-ProjectMemberTests-1781514586 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c.654d01db-61dc-4d58-82f0-6925e386a593 is being set with open permissions: ugo+rw Jul 28 10:55:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-312a906d-eb5c-466f-80db-ea6ef34b8dc3 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c.654d01db-61dc-4d58-82f0-6925e386a593 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:37 devstack sudo[108340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c.654d01db-61dc-4d58-82f0-6925e386a593 Jul 28 10:55:37 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:37 devstack sudo[108335]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d1b97bee-0cd6-47bf-bfa6-966693c7f49f tempest-SnapshotDependencyTests-1391677029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5.dc0006ce-87fe-4986-85c1-c8fdfda57ae9" returned: 0 in 0.368s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:37 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-d1b97bee-0cd6-47bf-bfa6-966693c7f49f tempest-SnapshotDependencyTests-1391677029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:55:37 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ff2547-dbe2-4456-80b0-c9eefd9034bf]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:55:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d1b97bee-0cd6-47bf-bfa6-966693c7f49f tempest-SnapshotDependencyTests-1391677029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:37 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-312a906d-eb5c-466f-80db-ea6ef34b8dc3 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c.654d01db-61dc-4d58-82f0-6925e386a593" returned: 0 in 0.255s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-312a906d-eb5c-466f-80db-ea6ef34b8dc3 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:37 devstack sudo[108345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5 Jul 28 10:55:37 devstack sudo[108345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:37 devstack sudo[108347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c.info Jul 28 10:55:37 devstack sudo[108347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:38 devstack sudo[108347]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-312a906d-eb5c-466f-80db-ea6ef34b8dc3 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c.info" returned: 0 in 0.254s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:38 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-312a906d-eb5c-466f-80db-ea6ef34b8dc3 tempest-ProjectMemberTests-1781514586 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c.info is being set with open permissions: ugo+rw Jul 28 10:55:38 devstack sudo[108345]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-312a906d-eb5c-466f-80db-ea6ef34b8dc3 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d1b97bee-0cd6-47bf-bfa6-966693c7f49f tempest-SnapshotDependencyTests-1391677029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5" returned: 0 in 0.378s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d1b97bee-0cd6-47bf-bfa6-966693c7f49f tempest-SnapshotDependencyTests-1391677029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5.dc0006ce-87fe-4986-85c1-c8fdfda57ae9 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:38 devstack sudo[108354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c.info Jul 28 10:55:38 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:38 devstack sudo[108355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5.dc0006ce-87fe-4986-85c1-c8fdfda57ae9 Jul 28 10:55:38 devstack sudo[108355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:38 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-312a906d-eb5c-466f-80db-ea6ef34b8dc3 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c.info" returned: 0 in 0.253s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-312a906d-eb5c-466f-80db-ea6ef34b8dc3 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.941s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:38 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-312a906d-eb5c-466f-80db-ea6ef34b8dc3 tempest-ProjectMemberTests-1781514586 None] Create snapshot completed successfully Jul 28 10:55:38 devstack sudo[108355]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d1b97bee-0cd6-47bf-bfa6-966693c7f49f tempest-SnapshotDependencyTests-1391677029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5.dc0006ce-87fe-4986-85c1-c8fdfda57ae9" returned: 0 in 0.348s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d1b97bee-0cd6-47bf-bfa6-966693c7f49f tempest-SnapshotDependencyTests-1391677029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5.dc0006ce-87fe-4986-85c1-c8fdfda57ae9 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:38 devstack sudo[108362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5.dc0006ce-87fe-4986-85c1-c8fdfda57ae9 Jul 28 10:55:38 devstack sudo[108362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:38 devstack sudo[108362]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d1b97bee-0cd6-47bf-bfa6-966693c7f49f tempest-SnapshotDependencyTests-1391677029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5.dc0006ce-87fe-4986-85c1-c8fdfda57ae9" returned: 0 in 0.261s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:38 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-d1b97bee-0cd6-47bf-bfa6-966693c7f49f tempest-SnapshotDependencyTests-1391677029 None] Lock "cinder-quobyte-dc0006ce-87fe-4986-85c1-c8fdfda57ae9" released by "_delete_snapshot" :: held 1.462s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:38 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-d1b97bee-0cd6-47bf-bfa6-966693c7f49f tempest-SnapshotDependencyTests-1391677029 None] Lock "cinder-quobyte-4b3c958e-b5cd-40fe-8ac8-500dcac492c5" released by "delete_snapshot" :: held 1.485s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:38 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-d1b97bee-0cd6-47bf-bfa6-966693c7f49f tempest-SnapshotDependencyTests-1391677029 None] Created reservations ['b6a3e100-c7ea-40d4-ba58-a619d7ed2d2e', '521142cc-04d8-40e0-afc3-cab14c4090e7', '674fd771-4d8e-446f-b169-0d92b5a54f83', '76dfe875-7c2e-42eb-aa67-c261c73ce522'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:55:38 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-d1b97bee-0cd6-47bf-bfa6-966693c7f49f tempest-SnapshotDependencyTests-1391677029 None] Delete snapshot completed successfully. Jul 28 10:55:38 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-d1b97bee-0cd6-47bf-bfa6-966693c7f49f tempest-SnapshotDependencyTests-1391677029 None] Lock "cinder-dc0006ce-87fe-4986-85c1-c8fdfda57ae9-delete_snapshot" released by "delete_snapshot" :: held 1.634s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:39 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-dd4ca4ee-1b57-4595-b2dc-b05835de749d tempest-SnapshotDependencyTests-1391677029 None] Acquiring lock "cinder-4b3c958e-b5cd-40fe-8ac8-500dcac492c5-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:39 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-dd4ca4ee-1b57-4595-b2dc-b05835de749d tempest-SnapshotDependencyTests-1391677029 None] Lock "cinder-4b3c958e-b5cd-40fe-8ac8-500dcac492c5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:39 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-dd4ca4ee-1b57-4595-b2dc-b05835de749d tempest-SnapshotDependencyTests-1391677029 None] Acquiring lock "cinder-quobyte-4b3c958e-b5cd-40fe-8ac8-500dcac492c5" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:39 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-dd4ca4ee-1b57-4595-b2dc-b05835de749d tempest-SnapshotDependencyTests-1391677029 None] Lock "cinder-quobyte-4b3c958e-b5cd-40fe-8ac8-500dcac492c5" acquired by "delete_volume" :: waited 0.019s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:39 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b30107-4856-4758-80b8-e4841f3deb64]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:55:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dd4ca4ee-1b57-4595-b2dc-b05835de749d tempest-SnapshotDependencyTests-1391677029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:39 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4764896c-8e28-4af1-96af-c48840c378f4 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-654d01db-61dc-4d58-82f0-6925e386a593-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:39 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4764896c-8e28-4af1-96af-c48840c378f4 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-654d01db-61dc-4d58-82f0-6925e386a593-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:39 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4764896c-8e28-4af1-96af-c48840c378f4 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-quobyte-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:39 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4764896c-8e28-4af1-96af-c48840c378f4 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:39 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4764896c-8e28-4af1-96af-c48840c378f4 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-quobyte-654d01db-61dc-4d58-82f0-6925e386a593" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:39 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4764896c-8e28-4af1-96af-c48840c378f4 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-654d01db-61dc-4d58-82f0-6925e386a593" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:39 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-4764896c-8e28-4af1-96af-c48840c378f4 tempest-ProjectMemberTests-1781514586 None] Deleting offline snapshot 654d01db-61dc-4d58-82f0-6925e386a593 of volume f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:55:39 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-4764896c-8e28-4af1-96af-c48840c378f4 tempest-ProjectMemberTests-1781514586 None] snapshot_file for this snap is: volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c.654d01db-61dc-4d58-82f0-6925e386a593 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:55:39 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[4119cacb-1d05-41ef-b598-ed355ee2fc32]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:55:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4764896c-8e28-4af1-96af-c48840c378f4 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c.654d01db-61dc-4d58-82f0-6925e386a593 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:39 devstack sudo[108365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5 Jul 28 10:55:39 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:39 devstack sudo[108366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c.654d01db-61dc-4d58-82f0-6925e386a593 Jul 28 10:55:39 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:39 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dd4ca4ee-1b57-4595-b2dc-b05835de749d tempest-SnapshotDependencyTests-1391677029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5" returned: 0 in 0.387s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dd4ca4ee-1b57-4595-b2dc-b05835de749d tempest-SnapshotDependencyTests-1391677029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:39 devstack sudo[108372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5 Jul 28 10:55:39 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:39 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4764896c-8e28-4af1-96af-c48840c378f4 tempest-ProjectMemberTests-1781514586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c.654d01db-61dc-4d58-82f0-6925e386a593" returned: 0 in 0.383s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:39 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-4764896c-8e28-4af1-96af-c48840c378f4 tempest-ProjectMemberTests-1781514586 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:55:39 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[180d6c87-16aa-4059-9381-26c0b8c26c1e]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:55:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4764896c-8e28-4af1-96af-c48840c378f4 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:40 devstack sudo[108377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c Jul 28 10:55:40 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:40 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dd4ca4ee-1b57-4595-b2dc-b05835de749d tempest-SnapshotDependencyTests-1391677029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-4b3c958e-b5cd-40fe-8ac8-500dcac492c5" returned: 0 in 0.276s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:40 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-dd4ca4ee-1b57-4595-b2dc-b05835de749d tempest-SnapshotDependencyTests-1391677029 None] Lock "cinder-quobyte-4b3c958e-b5cd-40fe-8ac8-500dcac492c5" released by "delete_volume" :: held 0.729s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:40 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-dd4ca4ee-1b57-4595-b2dc-b05835de749d tempest-SnapshotDependencyTests-1391677029 None] Created reservations ['6475fd9b-d7c9-4492-856e-c9ce7321aa4c', '497b0177-639f-4520-8d88-d690e4a9ff25', '087d8d5b-ac77-45ee-a4ad-47d50e2aea79', 'ac8aca45-93a8-4afe-9fd6-63b78919a782'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:55:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-dd4ca4ee-1b57-4595-b2dc-b05835de749d tempest-SnapshotDependencyTests-1391677029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-dd4ca4ee-1b57-4595-b2dc-b05835de749d tempest-SnapshotDependencyTests-1391677029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:40 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-dd4ca4ee-1b57-4595-b2dc-b05835de749d tempest-SnapshotDependencyTests-1391677029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:55:40 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-dd4ca4ee-1b57-4595-b2dc-b05835de749d tempest-SnapshotDependencyTests-1391677029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:55:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-dd4ca4ee-1b57-4595-b2dc-b05835de749d tempest-SnapshotDependencyTests-1391677029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dd4ca4ee-1b57-4595-b2dc-b05835de749d tempest-SnapshotDependencyTests-1391677029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:40 devstack sudo[108381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:55:40 devstack sudo[108381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:40 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4764896c-8e28-4af1-96af-c48840c378f4 tempest-ProjectMemberTests-1781514586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c" returned: 0 in 0.389s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4764896c-8e28-4af1-96af-c48840c378f4 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c.654d01db-61dc-4d58-82f0-6925e386a593 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:40 devstack sudo[108386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c.654d01db-61dc-4d58-82f0-6925e386a593 Jul 28 10:55:40 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:40 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-835ae809-0136-4a51-8ddf-2c44cda09ce7 tempest-SnapshotDependencyTests-1391677029 None] Acquiring lock "cinder-3171dcce-6142-4781-a976-31acf20ae0f5-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:40 devstack sudo[108381]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:40 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-835ae809-0136-4a51-8ddf-2c44cda09ce7 tempest-SnapshotDependencyTests-1391677029 None] Lock "cinder-3171dcce-6142-4781-a976-31acf20ae0f5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-dd4ca4ee-1b57-4595-b2dc-b05835de749d tempest-SnapshotDependencyTests-1391677029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.289s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:40 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-dd4ca4ee-1b57-4595-b2dc-b05835de749d tempest-SnapshotDependencyTests-1391677029 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:55:40 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-dd4ca4ee-1b57-4595-b2dc-b05835de749d tempest-SnapshotDependencyTests-1391677029 None] Deleted volume successfully. Jul 28 10:55:40 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-dd4ca4ee-1b57-4595-b2dc-b05835de749d tempest-SnapshotDependencyTests-1391677029 None] Lock "cinder-4b3c958e-b5cd-40fe-8ac8-500dcac492c5-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:40 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-835ae809-0136-4a51-8ddf-2c44cda09ce7 tempest-SnapshotDependencyTests-1391677029 None] Acquiring lock "cinder-quobyte-3171dcce-6142-4781-a976-31acf20ae0f5" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:40 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-835ae809-0136-4a51-8ddf-2c44cda09ce7 tempest-SnapshotDependencyTests-1391677029 None] Lock "cinder-quobyte-3171dcce-6142-4781-a976-31acf20ae0f5" acquired by "delete_volume" :: waited 0.014s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:40 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a7592a-910e-4c35-bde5-27d71639a4e5]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:55:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-835ae809-0136-4a51-8ddf-2c44cda09ce7 tempest-SnapshotDependencyTests-1391677029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3171dcce-6142-4781-a976-31acf20ae0f5 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:40 devstack sudo[108392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3171dcce-6142-4781-a976-31acf20ae0f5 Jul 28 10:55:40 devstack sudo[108392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:40 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4764896c-8e28-4af1-96af-c48840c378f4 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c.654d01db-61dc-4d58-82f0-6925e386a593" returned: 0 in 0.389s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4764896c-8e28-4af1-96af-c48840c378f4 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c.654d01db-61dc-4d58-82f0-6925e386a593 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:40 devstack sudo[108394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c.654d01db-61dc-4d58-82f0-6925e386a593 Jul 28 10:55:40 devstack sudo[108394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:41 devstack sudo[108392]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:41 devstack sudo[108394]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4764896c-8e28-4af1-96af-c48840c378f4 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c.654d01db-61dc-4d58-82f0-6925e386a593" returned: 0 in 0.260s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-835ae809-0136-4a51-8ddf-2c44cda09ce7 tempest-SnapshotDependencyTests-1391677029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3171dcce-6142-4781-a976-31acf20ae0f5" returned: 0 in 0.401s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-835ae809-0136-4a51-8ddf-2c44cda09ce7 tempest-SnapshotDependencyTests-1391677029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3171dcce-6142-4781-a976-31acf20ae0f5 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:41 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4764896c-8e28-4af1-96af-c48840c378f4 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-654d01db-61dc-4d58-82f0-6925e386a593" released by "_delete_snapshot" :: held 1.531s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:41 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4764896c-8e28-4af1-96af-c48840c378f4 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c" released by "delete_snapshot" :: held 1.558s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:41 devstack sudo[108400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3171dcce-6142-4781-a976-31acf20ae0f5 Jul 28 10:55:41 devstack sudo[108400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:41 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-4764896c-8e28-4af1-96af-c48840c378f4 tempest-ProjectMemberTests-1781514586 None] Created reservations ['b404f0e3-6e9f-474a-8d8f-5259664c99ce', '13fcd6ab-a990-40c2-bd16-dbc59d254e3a', 'dcac0e06-b886-4827-b948-4f86067a4025', '3d98739a-dce8-4326-a8a7-70ce354eb530'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:55:41 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-4764896c-8e28-4af1-96af-c48840c378f4 tempest-ProjectMemberTests-1781514586 None] Delete snapshot completed successfully. Jul 28 10:55:41 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-4764896c-8e28-4af1-96af-c48840c378f4 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-654d01db-61dc-4d58-82f0-6925e386a593-delete_snapshot" released by "delete_snapshot" :: held 1.708s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:41 devstack sudo[108400]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-835ae809-0136-4a51-8ddf-2c44cda09ce7 tempest-SnapshotDependencyTests-1391677029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3171dcce-6142-4781-a976-31acf20ae0f5" returned: 0 in 0.252s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:41 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-835ae809-0136-4a51-8ddf-2c44cda09ce7 tempest-SnapshotDependencyTests-1391677029 None] Lock "cinder-quobyte-3171dcce-6142-4781-a976-31acf20ae0f5" released by "delete_volume" :: held 0.691s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:41 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-835ae809-0136-4a51-8ddf-2c44cda09ce7 tempest-SnapshotDependencyTests-1391677029 None] Created reservations ['c71cf029-560d-4b73-b088-efd7d071f890', '94c29612-3a23-4481-ab11-774a0dcb990c', '9e605bb3-bb5f-41b6-8b24-8184d59ab846', '092eb27a-5450-4208-9ae5-c4cd01d93aad'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:55:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-835ae809-0136-4a51-8ddf-2c44cda09ce7 tempest-SnapshotDependencyTests-1391677029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-835ae809-0136-4a51-8ddf-2c44cda09ce7 tempest-SnapshotDependencyTests-1391677029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:41 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-835ae809-0136-4a51-8ddf-2c44cda09ce7 tempest-SnapshotDependencyTests-1391677029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:55:41 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-835ae809-0136-4a51-8ddf-2c44cda09ce7 tempest-SnapshotDependencyTests-1391677029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:55:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-835ae809-0136-4a51-8ddf-2c44cda09ce7 tempest-SnapshotDependencyTests-1391677029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-835ae809-0136-4a51-8ddf-2c44cda09ce7 tempest-SnapshotDependencyTests-1391677029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:41 devstack sudo[108403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:55:41 devstack sudo[108403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:41 devstack sudo[108403]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-835ae809-0136-4a51-8ddf-2c44cda09ce7 tempest-SnapshotDependencyTests-1391677029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.257s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:41 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-835ae809-0136-4a51-8ddf-2c44cda09ce7 tempest-SnapshotDependencyTests-1391677029 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:55:41 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-59065800-70a5-4eb4-9483-e09ee3ce7843 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:41 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-835ae809-0136-4a51-8ddf-2c44cda09ce7 tempest-SnapshotDependencyTests-1391677029 None] Deleted volume successfully. Jul 28 10:55:41 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-59065800-70a5-4eb4-9483-e09ee3ce7843 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:41 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-835ae809-0136-4a51-8ddf-2c44cda09ce7 tempest-SnapshotDependencyTests-1391677029 None] Lock "cinder-3171dcce-6142-4781-a976-31acf20ae0f5-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:41 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-59065800-70a5-4eb4-9483-e09ee3ce7843 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-quobyte-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:41 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-59065800-70a5-4eb4-9483-e09ee3ce7843 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c" acquired by "delete_volume" :: waited 0.015s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:41 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff16f1b4-3ac3-41f8-bf7a-d1c98b2495a0]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:55:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-59065800-70a5-4eb4-9483-e09ee3ce7843 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:41 devstack sudo[108406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c Jul 28 10:55:41 devstack sudo[108406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:42 devstack sudo[108406]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-59065800-70a5-4eb4-9483-e09ee3ce7843 tempest-ProjectMemberTests-1781514586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c" returned: 0 in 0.385s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-59065800-70a5-4eb4-9483-e09ee3ce7843 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:42 devstack sudo[108411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c Jul 28 10:55:42 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:42 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-59065800-70a5-4eb4-9483-e09ee3ce7843 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c" returned: 0 in 0.276s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:42 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-59065800-70a5-4eb4-9483-e09ee3ce7843 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c" released by "delete_volume" :: held 0.725s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:42 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-59065800-70a5-4eb4-9483-e09ee3ce7843 tempest-ProjectMemberTests-1781514586 None] Created reservations ['b1a933c9-6e5a-4f3f-ab71-b2c2b3b0bcd8', '9d811f26-deed-4653-aea4-3915844cf1e7', '56d961f2-4af4-46d1-8d13-9d08247d79c0', 'b98e5467-2b63-4213-ae58-c9dc11d6a383'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:55:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-59065800-70a5-4eb4-9483-e09ee3ce7843 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-59065800-70a5-4eb4-9483-e09ee3ce7843 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:42 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-59065800-70a5-4eb4-9483-e09ee3ce7843 tempest-ProjectMemberTests-1781514586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:55:42 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-59065800-70a5-4eb4-9483-e09ee3ce7843 tempest-ProjectMemberTests-1781514586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:55:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-59065800-70a5-4eb4-9483-e09ee3ce7843 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-59065800-70a5-4eb4-9483-e09ee3ce7843 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:42 devstack sudo[108414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:55:42 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:42 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-59065800-70a5-4eb4-9483-e09ee3ce7843 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.261s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:42 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-59065800-70a5-4eb4-9483-e09ee3ce7843 tempest-ProjectMemberTests-1781514586 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:55:42 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-59065800-70a5-4eb4-9483-e09ee3ce7843 tempest-ProjectMemberTests-1781514586 None] Deleted volume successfully. Jul 28 10:55:42 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-59065800-70a5-4eb4-9483-e09ee3ce7843 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-f91bafb2-9ec0-4035-b42e-7a3c9bc58a6c-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:43 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-399d63c1-8464-4712-af2f-719d61f96b59 tempest-ProjectMemberTests-1781514586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:55:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-399d63c1-8464-4712-af2f-719d61f96b59 tempest-ProjectMemberTests-1781514586 None] Flow 'volume_create_manager' (98ba2052-1e3c-4b05-8ee3-561f20eeab1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:55:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-399d63c1-8464-4712-af2f-719d61f96b59 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1926f69b-699a-40fb-bd06-6b28abbe4855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-399d63c1-8464-4712-af2f-719d61f96b59 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1926f69b-699a-40fb-bd06-6b28abbe4855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-373190879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43cb08cd-f49e-4092-8a28-4b6a868fa84f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61e1f2c346a4cddbe7adc3f82eccf01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:55:43Z,use_quota=True,user_id='443f2e63fd9f4abcbb3569fc8516b13f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-399d63c1-8464-4712-af2f-719d61f96b59 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec177160-911b-4ac3-86dd-6a2616d3dc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-399d63c1-8464-4712-af2f-719d61f96b59 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec177160-911b-4ac3-86dd-6a2616d3dc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-399d63c1-8464-4712-af2f-719d61f96b59 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2787709f-8510-4082-b3b0-8b44d5c9c64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-399d63c1-8464-4712-af2f-719d61f96b59 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2787709f-8510-4082-b3b0-8b44d5c9c64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43cb08cd-f49e-4092-8a28-4b6a868fa84f', 'volume_name': 'volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-399d63c1-8464-4712-af2f-719d61f96b59 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a306ffe-63ac-4974-98d0-788db027625a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-399d63c1-8464-4712-af2f-719d61f96b59 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a306ffe-63ac-4974-98d0-788db027625a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:43 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-399d63c1-8464-4712-af2f-719d61f96b59 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84140f46-aa66-4120-a7d7-93396126df93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:43 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-399d63c1-8464-4712-af2f-719d61f96b59 tempest-ProjectMemberTests-1781514586 None] Volume 43cb08cd-f49e-4092-8a28-4b6a868fa84f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f', 'volume_size': 1} Jul 28 10:55:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-399d63c1-8464-4712-af2f-719d61f96b59 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-399d63c1-8464-4712-af2f-719d61f96b59 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:43 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-399d63c1-8464-4712-af2f-719d61f96b59 tempest-ProjectMemberTests-1781514586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-373190879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43cb08cd-f49e-4092-8a28-4b6a868fa84f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61e1f2c346a4cddbe7adc3f82eccf01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:55:43Z,use_quota=True,user_id='443f2e63fd9f4abcbb3569fc8516b13f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:55:43 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-399d63c1-8464-4712-af2f-719d61f96b59 tempest-ProjectMemberTests-1781514586 None] Creating volume 43cb08cd-f49e-4092-8a28-4b6a868fa84f {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:55:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-399d63c1-8464-4712-af2f-719d61f96b59 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-399d63c1-8464-4712-af2f-719d61f96b59 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:43 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-399d63c1-8464-4712-af2f-719d61f96b59 tempest-ProjectMemberTests-1781514586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:55:43 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-399d63c1-8464-4712-af2f-719d61f96b59 tempest-ProjectMemberTests-1781514586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:55:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-399d63c1-8464-4712-af2f-719d61f96b59 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:43 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-399d63c1-8464-4712-af2f-719d61f96b59 tempest-ProjectMemberTests-1781514586 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:55:43 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-399d63c1-8464-4712-af2f-719d61f96b59 tempest-ProjectMemberTests-1781514586 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:55:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-399d63c1-8464-4712-af2f-719d61f96b59 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:43 devstack sudo[108418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f 1073741824 Jul 28 10:55:43 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:43 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-399d63c1-8464-4712-af2f-719d61f96b59 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f 1073741824" returned: 0 in 0.444s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-399d63c1-8464-4712-af2f-719d61f96b59 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:44 devstack sudo[108424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f Jul 28 10:55:44 devstack sudo[108424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:44 devstack sudo[108424]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-399d63c1-8464-4712-af2f-719d61f96b59 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f" returned: 0 in 0.280s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:44 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-399d63c1-8464-4712-af2f-719d61f96b59 tempest-ProjectMemberTests-1781514586 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:55:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-399d63c1-8464-4712-af2f-719d61f96b59 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:44 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-399d63c1-8464-4712-af2f-719d61f96b59 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84140f46-aa66-4120-a7d7-93396126df93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:44 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-399d63c1-8464-4712-af2f-719d61f96b59 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbe3be17-54e7-4fca-a58f-3ba98b52cb6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:44 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-399d63c1-8464-4712-af2f-719d61f96b59 tempest-ProjectMemberTests-1781514586 None] Volume volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f (43cb08cd-f49e-4092-8a28-4b6a868fa84f): created successfully Jul 28 10:55:44 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-399d63c1-8464-4712-af2f-719d61f96b59 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbe3be17-54e7-4fca-a58f-3ba98b52cb6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:44 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-399d63c1-8464-4712-af2f-719d61f96b59 tempest-ProjectMemberTests-1781514586 None] Flow 'volume_create_manager' (98ba2052-1e3c-4b05-8ee3-561f20eeab1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:55:44 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-399d63c1-8464-4712-af2f-719d61f96b59 tempest-ProjectMemberTests-1781514586 None] Created volume successfully. Jul 28 10:55:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-69d41834-6763-4bfa-8bae-d0a35cb9ec33 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-69d41834-6763-4bfa-8bae-d0a35cb9ec33 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:45 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-69d41834-6763-4bfa-8bae-d0a35cb9ec33 tempest-ProjectMemberTests-1781514586 None] Creating offline snapshot ad62489e-448a-43a4-b5e7-e01b5a375a7e of volume 43cb08cd-f49e-4092-8a28-4b6a868fa84f {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:55:45 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[f340cfb8-94dd-4dcc-a22c-92b1635081ea]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:55:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-69d41834-6763-4bfa-8bae-d0a35cb9ec33 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:45 devstack sudo[108428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f Jul 28 10:55:45 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:46 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-69d41834-6763-4bfa-8bae-d0a35cb9ec33 tempest-ProjectMemberTests-1781514586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f" returned: 0 in 0.384s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-69d41834-6763-4bfa-8bae-d0a35cb9ec33 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f.ad62489e-448a-43a4-b5e7-e01b5a375a7e 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:46 devstack sudo[108433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f.ad62489e-448a-43a4-b5e7-e01b5a375a7e 1G Jul 28 10:55:46 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:46 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-69d41834-6763-4bfa-8bae-d0a35cb9ec33 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f.ad62489e-448a-43a4-b5e7-e01b5a375a7e 1G" returned: 0 in 0.457s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-69d41834-6763-4bfa-8bae-d0a35cb9ec33 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f.ad62489e-448a-43a4-b5e7-e01b5a375a7e {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:46 devstack sudo[108438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f.ad62489e-448a-43a4-b5e7-e01b5a375a7e Jul 28 10:55:46 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:46 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-69d41834-6763-4bfa-8bae-d0a35cb9ec33 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f.ad62489e-448a-43a4-b5e7-e01b5a375a7e" returned: 0 in 0.298s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:46 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-69d41834-6763-4bfa-8bae-d0a35cb9ec33 tempest-ProjectMemberTests-1781514586 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f.ad62489e-448a-43a4-b5e7-e01b5a375a7e is being set with open permissions: ugo+rw Jul 28 10:55:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-69d41834-6763-4bfa-8bae-d0a35cb9ec33 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f.ad62489e-448a-43a4-b5e7-e01b5a375a7e {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:46 devstack sudo[108445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f.ad62489e-448a-43a4-b5e7-e01b5a375a7e Jul 28 10:55:46 devstack sudo[108445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:47 devstack sudo[108445]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-69d41834-6763-4bfa-8bae-d0a35cb9ec33 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f.ad62489e-448a-43a4-b5e7-e01b5a375a7e" returned: 0 in 0.277s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-69d41834-6763-4bfa-8bae-d0a35cb9ec33 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:47 devstack sudo[108448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f.info Jul 28 10:55:47 devstack sudo[108448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:47 devstack sudo[108448]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-69d41834-6763-4bfa-8bae-d0a35cb9ec33 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f.info" returned: 0 in 0.256s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:47 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-69d41834-6763-4bfa-8bae-d0a35cb9ec33 tempest-ProjectMemberTests-1781514586 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f.info is being set with open permissions: ugo+rw Jul 28 10:55:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-69d41834-6763-4bfa-8bae-d0a35cb9ec33 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:47 devstack sudo[108451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f.info Jul 28 10:55:47 devstack sudo[108451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:47 devstack sudo[108451]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-69d41834-6763-4bfa-8bae-d0a35cb9ec33 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f.info" returned: 0 in 0.249s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-69d41834-6763-4bfa-8bae-d0a35cb9ec33 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.012s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:47 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-69d41834-6763-4bfa-8bae-d0a35cb9ec33 tempest-ProjectMemberTests-1781514586 None] Create snapshot completed successfully Jul 28 10:55:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-cd0b5c6b-ab09-4ff0-8024-95670e307c98 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-ad62489e-448a-43a4-b5e7-e01b5a375a7e-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-cd0b5c6b-ab09-4ff0-8024-95670e307c98 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-ad62489e-448a-43a4-b5e7-e01b5a375a7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-cd0b5c6b-ab09-4ff0-8024-95670e307c98 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-quobyte-43cb08cd-f49e-4092-8a28-4b6a868fa84f" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-cd0b5c6b-ab09-4ff0-8024-95670e307c98 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-43cb08cd-f49e-4092-8a28-4b6a868fa84f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-cd0b5c6b-ab09-4ff0-8024-95670e307c98 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-quobyte-ad62489e-448a-43a4-b5e7-e01b5a375a7e" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-cd0b5c6b-ab09-4ff0-8024-95670e307c98 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-ad62489e-448a-43a4-b5e7-e01b5a375a7e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:48 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-cd0b5c6b-ab09-4ff0-8024-95670e307c98 tempest-ProjectMemberTests-1781514586 None] Deleting offline snapshot ad62489e-448a-43a4-b5e7-e01b5a375a7e of volume 43cb08cd-f49e-4092-8a28-4b6a868fa84f {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:55:48 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-cd0b5c6b-ab09-4ff0-8024-95670e307c98 tempest-ProjectMemberTests-1781514586 None] snapshot_file for this snap is: volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f.ad62489e-448a-43a4-b5e7-e01b5a375a7e {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:55:48 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c92fad-7f0e-4148-abde-1fa0764c2b6c]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:55:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cd0b5c6b-ab09-4ff0-8024-95670e307c98 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f.ad62489e-448a-43a4-b5e7-e01b5a375a7e {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:49 devstack sudo[108454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f.ad62489e-448a-43a4-b5e7-e01b5a375a7e Jul 28 10:55:49 devstack sudo[108454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:49 devstack sudo[108454]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cd0b5c6b-ab09-4ff0-8024-95670e307c98 tempest-ProjectMemberTests-1781514586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f.ad62489e-448a-43a4-b5e7-e01b5a375a7e" returned: 0 in 0.396s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:49 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-cd0b5c6b-ab09-4ff0-8024-95670e307c98 tempest-ProjectMemberTests-1781514586 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:55:49 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cce866-4856-4721-96a6-da0474fdd608]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:55:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cd0b5c6b-ab09-4ff0-8024-95670e307c98 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:49 devstack sudo[108460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f Jul 28 10:55:49 devstack sudo[108460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:49 devstack sudo[108460]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cd0b5c6b-ab09-4ff0-8024-95670e307c98 tempest-ProjectMemberTests-1781514586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f" returned: 0 in 0.391s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cd0b5c6b-ab09-4ff0-8024-95670e307c98 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f.ad62489e-448a-43a4-b5e7-e01b5a375a7e {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:49 devstack sudo[108466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f.ad62489e-448a-43a4-b5e7-e01b5a375a7e Jul 28 10:55:49 devstack sudo[108466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:50 devstack sudo[108466]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cd0b5c6b-ab09-4ff0-8024-95670e307c98 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f.ad62489e-448a-43a4-b5e7-e01b5a375a7e" returned: 0 in 0.339s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cd0b5c6b-ab09-4ff0-8024-95670e307c98 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f.ad62489e-448a-43a4-b5e7-e01b5a375a7e {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:50 devstack sudo[108473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f.ad62489e-448a-43a4-b5e7-e01b5a375a7e Jul 28 10:55:50 devstack sudo[108473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:50 devstack sudo[108473]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-cd0b5c6b-ab09-4ff0-8024-95670e307c98 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f.ad62489e-448a-43a4-b5e7-e01b5a375a7e" returned: 0 in 0.252s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-cd0b5c6b-ab09-4ff0-8024-95670e307c98 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-ad62489e-448a-43a4-b5e7-e01b5a375a7e" released by "_delete_snapshot" :: held 1.516s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-cd0b5c6b-ab09-4ff0-8024-95670e307c98 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-43cb08cd-f49e-4092-8a28-4b6a868fa84f" released by "delete_snapshot" :: held 1.542s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:50 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-cd0b5c6b-ab09-4ff0-8024-95670e307c98 tempest-ProjectMemberTests-1781514586 None] Created reservations ['847a80f9-7c44-49dd-a9e4-76313718db97', 'a1c9d92d-a328-41b8-aac1-e2cc97ad197e', '4060f3ef-2845-454e-9263-6c9a4b2334e9', '525865f9-338f-4b4d-8295-40d3258beebd'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:55:50 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-cd0b5c6b-ab09-4ff0-8024-95670e307c98 tempest-ProjectMemberTests-1781514586 None] Delete snapshot completed successfully. Jul 28 10:55:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-cd0b5c6b-ab09-4ff0-8024-95670e307c98 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-ad62489e-448a-43a4-b5e7-e01b5a375a7e-delete_snapshot" released by "delete_snapshot" :: held 1.716s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-2391c37f-bfc8-4ed0-bcbd-204af82dfc5b tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-43cb08cd-f49e-4092-8a28-4b6a868fa84f-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-2391c37f-bfc8-4ed0-bcbd-204af82dfc5b tempest-ProjectMemberTests-1781514586 None] Lock "cinder-43cb08cd-f49e-4092-8a28-4b6a868fa84f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-2391c37f-bfc8-4ed0-bcbd-204af82dfc5b tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-quobyte-43cb08cd-f49e-4092-8a28-4b6a868fa84f" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-2391c37f-bfc8-4ed0-bcbd-204af82dfc5b tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-43cb08cd-f49e-4092-8a28-4b6a868fa84f" acquired by "delete_volume" :: waited 0.024s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:51 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4c9378-4e2a-4d27-9de8-d85387a24978]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:55:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2391c37f-bfc8-4ed0-bcbd-204af82dfc5b tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:51 devstack sudo[108476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f Jul 28 10:55:51 devstack sudo[108476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:51 devstack sudo[108476]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2391c37f-bfc8-4ed0-bcbd-204af82dfc5b tempest-ProjectMemberTests-1781514586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f" returned: 0 in 0.388s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2391c37f-bfc8-4ed0-bcbd-204af82dfc5b tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:51 devstack sudo[108483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f Jul 28 10:55:51 devstack sudo[108483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:51 devstack sudo[108483]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2391c37f-bfc8-4ed0-bcbd-204af82dfc5b tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-43cb08cd-f49e-4092-8a28-4b6a868fa84f" returned: 0 in 0.257s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-2391c37f-bfc8-4ed0-bcbd-204af82dfc5b tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-43cb08cd-f49e-4092-8a28-4b6a868fa84f" released by "delete_volume" :: held 0.713s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:51 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-2391c37f-bfc8-4ed0-bcbd-204af82dfc5b tempest-ProjectMemberTests-1781514586 None] Created reservations ['bad2316c-681a-44d6-a3f2-9af7d83df21e', '936d4d92-9dbd-4c1a-8ae6-07a47dac5ba0', '9a2f8ccf-0734-4c80-89d2-c111924ad94d', '29c4deb3-55c2-4432-83d2-4bb5771cd111'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:55:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-2391c37f-bfc8-4ed0-bcbd-204af82dfc5b tempest-ProjectMemberTests-1781514586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-2391c37f-bfc8-4ed0-bcbd-204af82dfc5b tempest-ProjectMemberTests-1781514586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:51 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-2391c37f-bfc8-4ed0-bcbd-204af82dfc5b tempest-ProjectMemberTests-1781514586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:55:51 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-2391c37f-bfc8-4ed0-bcbd-204af82dfc5b tempest-ProjectMemberTests-1781514586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:55:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-2391c37f-bfc8-4ed0-bcbd-204af82dfc5b tempest-ProjectMemberTests-1781514586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2391c37f-bfc8-4ed0-bcbd-204af82dfc5b tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:51 devstack sudo[108486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:55:51 devstack sudo[108486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:52 devstack sudo[108486]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2391c37f-bfc8-4ed0-bcbd-204af82dfc5b tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.240s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:52 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-2391c37f-bfc8-4ed0-bcbd-204af82dfc5b tempest-ProjectMemberTests-1781514586 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:55:52 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-2391c37f-bfc8-4ed0-bcbd-204af82dfc5b tempest-ProjectMemberTests-1781514586 None] Deleted volume successfully. Jul 28 10:55:52 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-2391c37f-bfc8-4ed0-bcbd-204af82dfc5b tempest-ProjectMemberTests-1781514586 None] Lock "cinder-43cb08cd-f49e-4092-8a28-4b6a868fa84f-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:52 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-58fa27d5-e06d-41de-b8c6-3aa1e972385c tempest-ProjectMemberTests-1781514586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:55:52 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-58fa27d5-e06d-41de-b8c6-3aa1e972385c tempest-ProjectMemberTests-1781514586 None] Flow 'volume_create_manager' (f49f3151-6e3c-4507-834f-301df85b2e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:55:52 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-58fa27d5-e06d-41de-b8c6-3aa1e972385c tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c867029-33ce-4e63-8856-0a176dbc68ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:52 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-58fa27d5-e06d-41de-b8c6-3aa1e972385c tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c867029-33ce-4e63-8856-0a176dbc68ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-866000924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b40e969e-7b1b-4077-9301-93fb69d3d2ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61e1f2c346a4cddbe7adc3f82eccf01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:55:53Z,use_quota=True,user_id='443f2e63fd9f4abcbb3569fc8516b13f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:52 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-58fa27d5-e06d-41de-b8c6-3aa1e972385c tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (577ce71d-71be-4827-a192-72393a0249ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:52 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-58fa27d5-e06d-41de-b8c6-3aa1e972385c tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (577ce71d-71be-4827-a192-72393a0249ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:52 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-58fa27d5-e06d-41de-b8c6-3aa1e972385c tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4750ec65-a4fe-4f23-bf02-3b39839bf950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:52 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-58fa27d5-e06d-41de-b8c6-3aa1e972385c tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4750ec65-a4fe-4f23-bf02-3b39839bf950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b40e969e-7b1b-4077-9301-93fb69d3d2ee', 'volume_name': 'volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:52 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-58fa27d5-e06d-41de-b8c6-3aa1e972385c tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2282fdb7-f6ca-486b-ada6-e6b518772aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:52 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-58fa27d5-e06d-41de-b8c6-3aa1e972385c tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2282fdb7-f6ca-486b-ada6-e6b518772aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:52 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-58fa27d5-e06d-41de-b8c6-3aa1e972385c tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f8e428b-a6f4-4312-9028-680d518e4c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:52 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-58fa27d5-e06d-41de-b8c6-3aa1e972385c tempest-ProjectMemberTests-1781514586 None] Volume b40e969e-7b1b-4077-9301-93fb69d3d2ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee', 'volume_size': 1} Jul 28 10:55:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-58fa27d5-e06d-41de-b8c6-3aa1e972385c tempest-ProjectMemberTests-1781514586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-58fa27d5-e06d-41de-b8c6-3aa1e972385c tempest-ProjectMemberTests-1781514586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:52 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-58fa27d5-e06d-41de-b8c6-3aa1e972385c tempest-ProjectMemberTests-1781514586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-866000924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b40e969e-7b1b-4077-9301-93fb69d3d2ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61e1f2c346a4cddbe7adc3f82eccf01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:55:53Z,use_quota=True,user_id='443f2e63fd9f4abcbb3569fc8516b13f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:55:52 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-58fa27d5-e06d-41de-b8c6-3aa1e972385c tempest-ProjectMemberTests-1781514586 None] Creating volume b40e969e-7b1b-4077-9301-93fb69d3d2ee {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:55:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-58fa27d5-e06d-41de-b8c6-3aa1e972385c tempest-ProjectMemberTests-1781514586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-58fa27d5-e06d-41de-b8c6-3aa1e972385c tempest-ProjectMemberTests-1781514586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:52 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-58fa27d5-e06d-41de-b8c6-3aa1e972385c tempest-ProjectMemberTests-1781514586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:55:52 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-58fa27d5-e06d-41de-b8c6-3aa1e972385c tempest-ProjectMemberTests-1781514586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:55:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-58fa27d5-e06d-41de-b8c6-3aa1e972385c tempest-ProjectMemberTests-1781514586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:52 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-58fa27d5-e06d-41de-b8c6-3aa1e972385c tempest-ProjectMemberTests-1781514586 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:55:52 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-58fa27d5-e06d-41de-b8c6-3aa1e972385c tempest-ProjectMemberTests-1781514586 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:55:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-58fa27d5-e06d-41de-b8c6-3aa1e972385c tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:52 devstack sudo[108489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee 1073741824 Jul 28 10:55:52 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:53 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-58fa27d5-e06d-41de-b8c6-3aa1e972385c tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee 1073741824" returned: 0 in 0.407s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-58fa27d5-e06d-41de-b8c6-3aa1e972385c tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:53 devstack sudo[108494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee Jul 28 10:55:53 devstack sudo[108494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:53 devstack sudo[108494]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-58fa27d5-e06d-41de-b8c6-3aa1e972385c tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee" returned: 0 in 0.251s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:53 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-58fa27d5-e06d-41de-b8c6-3aa1e972385c tempest-ProjectMemberTests-1781514586 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:55:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-58fa27d5-e06d-41de-b8c6-3aa1e972385c tempest-ProjectMemberTests-1781514586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:53 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-58fa27d5-e06d-41de-b8c6-3aa1e972385c tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f8e428b-a6f4-4312-9028-680d518e4c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:53 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-58fa27d5-e06d-41de-b8c6-3aa1e972385c tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ca1b18d-47f6-48fa-8b94-ec561d71233f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:53 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-58fa27d5-e06d-41de-b8c6-3aa1e972385c tempest-ProjectMemberTests-1781514586 None] Volume volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee (b40e969e-7b1b-4077-9301-93fb69d3d2ee): created successfully Jul 28 10:55:53 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-58fa27d5-e06d-41de-b8c6-3aa1e972385c tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ca1b18d-47f6-48fa-8b94-ec561d71233f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:53 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-58fa27d5-e06d-41de-b8c6-3aa1e972385c tempest-ProjectMemberTests-1781514586 None] Flow 'volume_create_manager' (f49f3151-6e3c-4507-834f-301df85b2e23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:55:53 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-58fa27d5-e06d-41de-b8c6-3aa1e972385c tempest-ProjectMemberTests-1781514586 None] Created volume successfully. Jul 28 10:55:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d35e062c-f819-49c2-8745-d03424bca135 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d35e062c-f819-49c2-8745-d03424bca135 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:53 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-d35e062c-f819-49c2-8745-d03424bca135 tempest-ProjectMemberTests-1781514586 None] Creating offline snapshot c875ac8d-aec3-4662-85cf-d509a12fdce9 of volume b40e969e-7b1b-4077-9301-93fb69d3d2ee {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:55:53 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[487c7bc8-62ef-4a24-a696-f1993eb89359]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:55:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d35e062c-f819-49c2-8745-d03424bca135 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:53 devstack sudo[108497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee Jul 28 10:55:53 devstack sudo[108497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:54 devstack sudo[108497]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d35e062c-f819-49c2-8745-d03424bca135 tempest-ProjectMemberTests-1781514586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee" returned: 0 in 0.353s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d35e062c-f819-49c2-8745-d03424bca135 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee.c875ac8d-aec3-4662-85cf-d509a12fdce9 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:54 devstack sudo[108502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee.c875ac8d-aec3-4662-85cf-d509a12fdce9 1G Jul 28 10:55:54 devstack sudo[108502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:54 devstack sudo[108502]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d35e062c-f819-49c2-8745-d03424bca135 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee.c875ac8d-aec3-4662-85cf-d509a12fdce9 1G" returned: 0 in 0.388s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d35e062c-f819-49c2-8745-d03424bca135 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee.c875ac8d-aec3-4662-85cf-d509a12fdce9 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:54 devstack sudo[108507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee.c875ac8d-aec3-4662-85cf-d509a12fdce9 Jul 28 10:55:54 devstack sudo[108507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:54 devstack sudo[108507]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d35e062c-f819-49c2-8745-d03424bca135 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee.c875ac8d-aec3-4662-85cf-d509a12fdce9" returned: 0 in 0.281s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:54 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-d35e062c-f819-49c2-8745-d03424bca135 tempest-ProjectMemberTests-1781514586 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee.c875ac8d-aec3-4662-85cf-d509a12fdce9 is being set with open permissions: ugo+rw Jul 28 10:55:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d35e062c-f819-49c2-8745-d03424bca135 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee.c875ac8d-aec3-4662-85cf-d509a12fdce9 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:54 devstack sudo[108513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee.c875ac8d-aec3-4662-85cf-d509a12fdce9 Jul 28 10:55:54 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:55 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d35e062c-f819-49c2-8745-d03424bca135 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee.c875ac8d-aec3-4662-85cf-d509a12fdce9" returned: 0 in 0.230s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d35e062c-f819-49c2-8745-d03424bca135 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:55 devstack sudo[108516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee.info Jul 28 10:55:55 devstack sudo[108516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:55 devstack sudo[108516]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d35e062c-f819-49c2-8745-d03424bca135 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee.info" returned: 0 in 0.241s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:55 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-d35e062c-f819-49c2-8745-d03424bca135 tempest-ProjectMemberTests-1781514586 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee.info is being set with open permissions: ugo+rw Jul 28 10:55:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d35e062c-f819-49c2-8745-d03424bca135 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:55 devstack sudo[108519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee.info Jul 28 10:55:55 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:55 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d35e062c-f819-49c2-8745-d03424bca135 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee.info" returned: 0 in 0.239s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d35e062c-f819-49c2-8745-d03424bca135 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.811s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:55 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-d35e062c-f819-49c2-8745-d03424bca135 tempest-ProjectMemberTests-1781514586 None] Create snapshot completed successfully Jul 28 10:55:55 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-35ea8d0a-56f4-4f5a-a7bc-e333c23895cc tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-c875ac8d-aec3-4662-85cf-d509a12fdce9-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:55 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-35ea8d0a-56f4-4f5a-a7bc-e333c23895cc tempest-ProjectMemberTests-1781514586 None] Lock "cinder-c875ac8d-aec3-4662-85cf-d509a12fdce9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:55 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-35ea8d0a-56f4-4f5a-a7bc-e333c23895cc tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-quobyte-b40e969e-7b1b-4077-9301-93fb69d3d2ee" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:55 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-35ea8d0a-56f4-4f5a-a7bc-e333c23895cc tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-b40e969e-7b1b-4077-9301-93fb69d3d2ee" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:55 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-35ea8d0a-56f4-4f5a-a7bc-e333c23895cc tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-quobyte-c875ac8d-aec3-4662-85cf-d509a12fdce9" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:55 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-35ea8d0a-56f4-4f5a-a7bc-e333c23895cc tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-c875ac8d-aec3-4662-85cf-d509a12fdce9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:55 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-35ea8d0a-56f4-4f5a-a7bc-e333c23895cc tempest-ProjectMemberTests-1781514586 None] Deleting offline snapshot c875ac8d-aec3-4662-85cf-d509a12fdce9 of volume b40e969e-7b1b-4077-9301-93fb69d3d2ee {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:55:55 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-35ea8d0a-56f4-4f5a-a7bc-e333c23895cc tempest-ProjectMemberTests-1781514586 None] snapshot_file for this snap is: volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee.c875ac8d-aec3-4662-85cf-d509a12fdce9 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:55:55 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa67e86-85a7-4eb5-9eed-15444e068454]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:55:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-35ea8d0a-56f4-4f5a-a7bc-e333c23895cc tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee.c875ac8d-aec3-4662-85cf-d509a12fdce9 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:56 devstack sudo[108522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee.c875ac8d-aec3-4662-85cf-d509a12fdce9 Jul 28 10:55:56 devstack sudo[108522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:56 devstack sudo[108522]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-35ea8d0a-56f4-4f5a-a7bc-e333c23895cc tempest-ProjectMemberTests-1781514586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee.c875ac8d-aec3-4662-85cf-d509a12fdce9" returned: 0 in 0.363s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:56 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-35ea8d0a-56f4-4f5a-a7bc-e333c23895cc tempest-ProjectMemberTests-1781514586 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:55:56 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[222dbffa-e955-47f0-a8b4-d2804ebf7845]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:55:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-35ea8d0a-56f4-4f5a-a7bc-e333c23895cc tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:56 devstack sudo[108527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee Jul 28 10:55:56 devstack sudo[108527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:56 devstack sudo[108527]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-35ea8d0a-56f4-4f5a-a7bc-e333c23895cc tempest-ProjectMemberTests-1781514586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee" returned: 0 in 0.351s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-35ea8d0a-56f4-4f5a-a7bc-e333c23895cc tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee.c875ac8d-aec3-4662-85cf-d509a12fdce9 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:56 devstack sudo[108532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee.c875ac8d-aec3-4662-85cf-d509a12fdce9 Jul 28 10:55:56 devstack sudo[108532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:57 devstack sudo[108532]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-35ea8d0a-56f4-4f5a-a7bc-e333c23895cc tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee.c875ac8d-aec3-4662-85cf-d509a12fdce9" returned: 0 in 0.326s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-35ea8d0a-56f4-4f5a-a7bc-e333c23895cc tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee.c875ac8d-aec3-4662-85cf-d509a12fdce9 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:57 devstack sudo[108537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee.c875ac8d-aec3-4662-85cf-d509a12fdce9 Jul 28 10:55:57 devstack sudo[108537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:57 devstack sudo[108537]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-35ea8d0a-56f4-4f5a-a7bc-e333c23895cc tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee.c875ac8d-aec3-4662-85cf-d509a12fdce9" returned: 0 in 0.254s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:57 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-35ea8d0a-56f4-4f5a-a7bc-e333c23895cc tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-c875ac8d-aec3-4662-85cf-d509a12fdce9" released by "_delete_snapshot" :: held 1.383s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:57 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-35ea8d0a-56f4-4f5a-a7bc-e333c23895cc tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-b40e969e-7b1b-4077-9301-93fb69d3d2ee" released by "delete_snapshot" :: held 1.411s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:57 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-35ea8d0a-56f4-4f5a-a7bc-e333c23895cc tempest-ProjectMemberTests-1781514586 None] Created reservations ['8f5cb053-4517-4b12-901e-2a5404ff3167', '8d518cf2-e017-43ee-9c89-2b8fdbb4b52b', 'a8391f9c-aac5-4015-a6da-85f079933f5c', '75dc16fe-2dc9-4463-a47b-5eaf62cc3a84'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:55:57 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-35ea8d0a-56f4-4f5a-a7bc-e333c23895cc tempest-ProjectMemberTests-1781514586 None] Delete snapshot completed successfully. Jul 28 10:55:57 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-35ea8d0a-56f4-4f5a-a7bc-e333c23895cc tempest-ProjectMemberTests-1781514586 None] Lock "cinder-c875ac8d-aec3-4662-85cf-d509a12fdce9-delete_snapshot" released by "delete_snapshot" :: held 1.542s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:58 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-2a647f8d-3790-407f-8b5d-9d9964c4f654 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-b40e969e-7b1b-4077-9301-93fb69d3d2ee-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:58 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-2a647f8d-3790-407f-8b5d-9d9964c4f654 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-b40e969e-7b1b-4077-9301-93fb69d3d2ee-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:58 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-2a647f8d-3790-407f-8b5d-9d9964c4f654 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-quobyte-b40e969e-7b1b-4077-9301-93fb69d3d2ee" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:55:58 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-2a647f8d-3790-407f-8b5d-9d9964c4f654 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-b40e969e-7b1b-4077-9301-93fb69d3d2ee" acquired by "delete_volume" :: waited 0.014s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:55:58 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[b282af99-b439-426b-ada3-74606e7b57fb]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:55:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2a647f8d-3790-407f-8b5d-9d9964c4f654 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:58 devstack sudo[108541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee Jul 28 10:55:58 devstack sudo[108541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:58 devstack sudo[108541]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2a647f8d-3790-407f-8b5d-9d9964c4f654 tempest-ProjectMemberTests-1781514586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee" returned: 0 in 0.364s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2a647f8d-3790-407f-8b5d-9d9964c4f654 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:58 devstack sudo[108546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee Jul 28 10:55:58 devstack sudo[108546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:58 devstack sudo[108546]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2a647f8d-3790-407f-8b5d-9d9964c4f654 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-b40e969e-7b1b-4077-9301-93fb69d3d2ee" returned: 0 in 0.245s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:58 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-2a647f8d-3790-407f-8b5d-9d9964c4f654 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-b40e969e-7b1b-4077-9301-93fb69d3d2ee" released by "delete_volume" :: held 0.667s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:58 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-2a647f8d-3790-407f-8b5d-9d9964c4f654 tempest-ProjectMemberTests-1781514586 None] Created reservations ['17131a4c-630d-4f87-a08e-f28b869bffe4', 'b7d8fef6-d125-4dc5-8617-c63090a364dd', '7be4226f-543a-428c-8fce-57c7c483d958', '4108e777-2262-4e05-b8b9-4fbc37d69c4d'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:55:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-2a647f8d-3790-407f-8b5d-9d9964c4f654 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-2a647f8d-3790-407f-8b5d-9d9964c4f654 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:58 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-2a647f8d-3790-407f-8b5d-9d9964c4f654 tempest-ProjectMemberTests-1781514586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:55:58 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-2a647f8d-3790-407f-8b5d-9d9964c4f654 tempest-ProjectMemberTests-1781514586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:55:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-2a647f8d-3790-407f-8b5d-9d9964c4f654 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2a647f8d-3790-407f-8b5d-9d9964c4f654 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:58 devstack sudo[108549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:55:58 devstack sudo[108549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:55:59 devstack sudo[108549]: pam_unix(sudo:session): session closed for user root Jul 28 10:55:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-2a647f8d-3790-407f-8b5d-9d9964c4f654 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.234s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:55:59 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-2a647f8d-3790-407f-8b5d-9d9964c4f654 tempest-ProjectMemberTests-1781514586 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:55:59 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-2a647f8d-3790-407f-8b5d-9d9964c4f654 tempest-ProjectMemberTests-1781514586 None] Deleted volume successfully. Jul 28 10:55:59 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-2a647f8d-3790-407f-8b5d-9d9964c4f654 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-b40e969e-7b1b-4077-9301-93fb69d3d2ee-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:55:59 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eaf588b-6c26-41ad-8d59-fe04abe482b1 tempest-ProjectMemberTests-1781514586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:55:59 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3eaf588b-6c26-41ad-8d59-fe04abe482b1 tempest-ProjectMemberTests-1781514586 None] Flow 'volume_create_manager' (0a436004-a7b1-4b43-abc1-e0059d2418dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:55:59 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3eaf588b-6c26-41ad-8d59-fe04abe482b1 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd080192-9de4-4687-b5b2-4933f7c4489b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:59 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3eaf588b-6c26-41ad-8d59-fe04abe482b1 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd080192-9de4-4687-b5b2-4933f7c4489b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1482493737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e795c84-3675-4813-8b89-4ba607754d7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61e1f2c346a4cddbe7adc3f82eccf01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:56:00Z,use_quota=True,user_id='443f2e63fd9f4abcbb3569fc8516b13f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:59 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3eaf588b-6c26-41ad-8d59-fe04abe482b1 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7d3eb6c-3bf7-48a3-b91f-2969dc73a37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:59 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3eaf588b-6c26-41ad-8d59-fe04abe482b1 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7d3eb6c-3bf7-48a3-b91f-2969dc73a37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:59 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3eaf588b-6c26-41ad-8d59-fe04abe482b1 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b76c7f8a-269d-494c-b1db-2dbe318fe2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:59 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3eaf588b-6c26-41ad-8d59-fe04abe482b1 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b76c7f8a-269d-494c-b1db-2dbe318fe2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e795c84-3675-4813-8b89-4ba607754d7a', 'volume_name': 'volume-3e795c84-3675-4813-8b89-4ba607754d7a', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:59 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3eaf588b-6c26-41ad-8d59-fe04abe482b1 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba4b2cff-a322-40c2-9545-c0c12c2da1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:59 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3eaf588b-6c26-41ad-8d59-fe04abe482b1 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba4b2cff-a322-40c2-9545-c0c12c2da1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:55:59 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3eaf588b-6c26-41ad-8d59-fe04abe482b1 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4627a60d-a7f5-4673-b5e9-04f3f1bb1fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:55:59 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-3eaf588b-6c26-41ad-8d59-fe04abe482b1 tempest-ProjectMemberTests-1781514586 None] Volume 3e795c84-3675-4813-8b89-4ba607754d7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e795c84-3675-4813-8b89-4ba607754d7a', 'volume_size': 1} Jul 28 10:55:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3eaf588b-6c26-41ad-8d59-fe04abe482b1 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3eaf588b-6c26-41ad-8d59-fe04abe482b1 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:59 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3eaf588b-6c26-41ad-8d59-fe04abe482b1 tempest-ProjectMemberTests-1781514586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1482493737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e795c84-3675-4813-8b89-4ba607754d7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61e1f2c346a4cddbe7adc3f82eccf01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:56:00Z,use_quota=True,user_id='443f2e63fd9f4abcbb3569fc8516b13f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:55:59 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-3eaf588b-6c26-41ad-8d59-fe04abe482b1 tempest-ProjectMemberTests-1781514586 None] Creating volume 3e795c84-3675-4813-8b89-4ba607754d7a {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:55:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3eaf588b-6c26-41ad-8d59-fe04abe482b1 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:55:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3eaf588b-6c26-41ad-8d59-fe04abe482b1 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:55:59 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3eaf588b-6c26-41ad-8d59-fe04abe482b1 tempest-ProjectMemberTests-1781514586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:55:59 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3eaf588b-6c26-41ad-8d59-fe04abe482b1 tempest-ProjectMemberTests-1781514586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:55:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3eaf588b-6c26-41ad-8d59-fe04abe482b1 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:55:59 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3eaf588b-6c26-41ad-8d59-fe04abe482b1 tempest-ProjectMemberTests-1781514586 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:55:59 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-3eaf588b-6c26-41ad-8d59-fe04abe482b1 tempest-ProjectMemberTests-1781514586 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:55:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3eaf588b-6c26-41ad-8d59-fe04abe482b1 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:55:59 devstack sudo[108552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a 1073741824 Jul 28 10:55:59 devstack sudo[108552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:00 devstack sudo[108552]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3eaf588b-6c26-41ad-8d59-fe04abe482b1 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a 1073741824" returned: 0 in 0.413s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3eaf588b-6c26-41ad-8d59-fe04abe482b1 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:00 devstack sudo[108559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a Jul 28 10:56:00 devstack sudo[108559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:00 devstack sudo[108559]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3eaf588b-6c26-41ad-8d59-fe04abe482b1 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a" returned: 0 in 0.241s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:00 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3eaf588b-6c26-41ad-8d59-fe04abe482b1 tempest-ProjectMemberTests-1781514586 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:56:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3eaf588b-6c26-41ad-8d59-fe04abe482b1 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:56:00 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3eaf588b-6c26-41ad-8d59-fe04abe482b1 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4627a60d-a7f5-4673-b5e9-04f3f1bb1fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e795c84-3675-4813-8b89-4ba607754d7a', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:00 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3eaf588b-6c26-41ad-8d59-fe04abe482b1 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (524a2044-536f-4660-8479-c70816266a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:00 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-3eaf588b-6c26-41ad-8d59-fe04abe482b1 tempest-ProjectMemberTests-1781514586 None] Volume volume-3e795c84-3675-4813-8b89-4ba607754d7a (3e795c84-3675-4813-8b89-4ba607754d7a): created successfully Jul 28 10:56:00 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3eaf588b-6c26-41ad-8d59-fe04abe482b1 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (524a2044-536f-4660-8479-c70816266a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:00 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3eaf588b-6c26-41ad-8d59-fe04abe482b1 tempest-ProjectMemberTests-1781514586 None] Flow 'volume_create_manager' (0a436004-a7b1-4b43-abc1-e0059d2418dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:56:00 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-3eaf588b-6c26-41ad-8d59-fe04abe482b1 tempest-ProjectMemberTests-1781514586 None] Created volume successfully. Jul 28 10:56:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-4ad43334-1071-47bc-bc2e-078123dc09c3 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:56:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-4ad43334-1071-47bc-bc2e-078123dc09c3 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:56:00 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-4ad43334-1071-47bc-bc2e-078123dc09c3 tempest-ProjectMemberTests-1781514586 None] Creating offline snapshot 97c91d5d-cb97-4653-98fa-7ba89f8d32bf of volume 3e795c84-3675-4813-8b89-4ba607754d7a {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:56:00 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[713bda01-b11e-482b-9ce0-1fe822bda4c7]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:56:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4ad43334-1071-47bc-bc2e-078123dc09c3 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:00 devstack sudo[108564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a Jul 28 10:56:00 devstack sudo[108564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:01 devstack sudo[108564]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4ad43334-1071-47bc-bc2e-078123dc09c3 tempest-ProjectMemberTests-1781514586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a" returned: 0 in 0.345s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4ad43334-1071-47bc-bc2e-078123dc09c3 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a.97c91d5d-cb97-4653-98fa-7ba89f8d32bf 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:01 devstack sudo[108569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a.97c91d5d-cb97-4653-98fa-7ba89f8d32bf 1G Jul 28 10:56:01 devstack sudo[108569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:01 devstack sudo[108569]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4ad43334-1071-47bc-bc2e-078123dc09c3 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a.97c91d5d-cb97-4653-98fa-7ba89f8d32bf 1G" returned: 0 in 0.379s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4ad43334-1071-47bc-bc2e-078123dc09c3 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e795c84-3675-4813-8b89-4ba607754d7a -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a.97c91d5d-cb97-4653-98fa-7ba89f8d32bf {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:01 devstack sudo[108574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e795c84-3675-4813-8b89-4ba607754d7a -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a.97c91d5d-cb97-4653-98fa-7ba89f8d32bf Jul 28 10:56:01 devstack sudo[108574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:01 devstack sudo[108574]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4ad43334-1071-47bc-bc2e-078123dc09c3 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e795c84-3675-4813-8b89-4ba607754d7a -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a.97c91d5d-cb97-4653-98fa-7ba89f8d32bf" returned: 0 in 0.294s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:01 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-4ad43334-1071-47bc-bc2e-078123dc09c3 tempest-ProjectMemberTests-1781514586 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a.97c91d5d-cb97-4653-98fa-7ba89f8d32bf is being set with open permissions: ugo+rw Jul 28 10:56:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4ad43334-1071-47bc-bc2e-078123dc09c3 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a.97c91d5d-cb97-4653-98fa-7ba89f8d32bf {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:01 devstack sudo[108580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a.97c91d5d-cb97-4653-98fa-7ba89f8d32bf Jul 28 10:56:01 devstack sudo[108580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:02 devstack sudo[108580]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4ad43334-1071-47bc-bc2e-078123dc09c3 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a.97c91d5d-cb97-4653-98fa-7ba89f8d32bf" returned: 0 in 0.237s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4ad43334-1071-47bc-bc2e-078123dc09c3 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:02 devstack sudo[108583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a.info Jul 28 10:56:02 devstack sudo[108583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:02 devstack sudo[108583]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4ad43334-1071-47bc-bc2e-078123dc09c3 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a.info" returned: 0 in 0.246s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:02 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-4ad43334-1071-47bc-bc2e-078123dc09c3 tempest-ProjectMemberTests-1781514586 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a.info is being set with open permissions: ugo+rw Jul 28 10:56:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4ad43334-1071-47bc-bc2e-078123dc09c3 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:02 devstack sudo[108586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a.info Jul 28 10:56:02 devstack sudo[108586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:02 devstack sudo[108586]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4ad43334-1071-47bc-bc2e-078123dc09c3 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a.info" returned: 0 in 0.262s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-4ad43334-1071-47bc-bc2e-078123dc09c3 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.838s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:56:02 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-4ad43334-1071-47bc-bc2e-078123dc09c3 tempest-ProjectMemberTests-1781514586 None] Create snapshot completed successfully Jul 28 10:56:02 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1c80ef6a-b66a-4f40-aad6-1bcb6ef926bc tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-97c91d5d-cb97-4653-98fa-7ba89f8d32bf-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:56:02 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1c80ef6a-b66a-4f40-aad6-1bcb6ef926bc tempest-ProjectMemberTests-1781514586 None] Lock "cinder-97c91d5d-cb97-4653-98fa-7ba89f8d32bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:56:02 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1c80ef6a-b66a-4f40-aad6-1bcb6ef926bc tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-quobyte-3e795c84-3675-4813-8b89-4ba607754d7a" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:56:02 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1c80ef6a-b66a-4f40-aad6-1bcb6ef926bc tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-3e795c84-3675-4813-8b89-4ba607754d7a" acquired by "delete_snapshot" :: waited 0.013s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:56:02 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1c80ef6a-b66a-4f40-aad6-1bcb6ef926bc tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-quobyte-97c91d5d-cb97-4653-98fa-7ba89f8d32bf" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:56:03 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1c80ef6a-b66a-4f40-aad6-1bcb6ef926bc tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-97c91d5d-cb97-4653-98fa-7ba89f8d32bf" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:56:03 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-1c80ef6a-b66a-4f40-aad6-1bcb6ef926bc tempest-ProjectMemberTests-1781514586 None] Deleting offline snapshot 97c91d5d-cb97-4653-98fa-7ba89f8d32bf of volume 3e795c84-3675-4813-8b89-4ba607754d7a {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:56:03 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-1c80ef6a-b66a-4f40-aad6-1bcb6ef926bc tempest-ProjectMemberTests-1781514586 None] snapshot_file for this snap is: volume-3e795c84-3675-4813-8b89-4ba607754d7a.97c91d5d-cb97-4653-98fa-7ba89f8d32bf {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:56:03 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[134826d9-871a-4994-83a5-039c8cba0243]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:56:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1c80ef6a-b66a-4f40-aad6-1bcb6ef926bc tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a.97c91d5d-cb97-4653-98fa-7ba89f8d32bf {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:03 devstack sudo[108589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a.97c91d5d-cb97-4653-98fa-7ba89f8d32bf Jul 28 10:56:03 devstack sudo[108589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:03 devstack sudo[108589]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1c80ef6a-b66a-4f40-aad6-1bcb6ef926bc tempest-ProjectMemberTests-1781514586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a.97c91d5d-cb97-4653-98fa-7ba89f8d32bf" returned: 0 in 0.356s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:03 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-1c80ef6a-b66a-4f40-aad6-1bcb6ef926bc tempest-ProjectMemberTests-1781514586 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e795c84-3675-4813-8b89-4ba607754d7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:56:03 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[8967bd98-e01d-4f7b-be5c-71ea85c14bda]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:56:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1c80ef6a-b66a-4f40-aad6-1bcb6ef926bc tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:03 devstack sudo[108594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a Jul 28 10:56:03 devstack sudo[108594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:03 devstack sudo[108594]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1c80ef6a-b66a-4f40-aad6-1bcb6ef926bc tempest-ProjectMemberTests-1781514586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a" returned: 0 in 0.348s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1c80ef6a-b66a-4f40-aad6-1bcb6ef926bc tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a.97c91d5d-cb97-4653-98fa-7ba89f8d32bf {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:03 devstack sudo[108600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a.97c91d5d-cb97-4653-98fa-7ba89f8d32bf Jul 28 10:56:03 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:04 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1c80ef6a-b66a-4f40-aad6-1bcb6ef926bc tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a.97c91d5d-cb97-4653-98fa-7ba89f8d32bf" returned: 0 in 0.333s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1c80ef6a-b66a-4f40-aad6-1bcb6ef926bc tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a.97c91d5d-cb97-4653-98fa-7ba89f8d32bf {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:04 devstack sudo[108606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a.97c91d5d-cb97-4653-98fa-7ba89f8d32bf Jul 28 10:56:04 devstack sudo[108606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:04 devstack sudo[108606]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1c80ef6a-b66a-4f40-aad6-1bcb6ef926bc tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a.97c91d5d-cb97-4653-98fa-7ba89f8d32bf" returned: 0 in 0.253s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:04 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1c80ef6a-b66a-4f40-aad6-1bcb6ef926bc tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-97c91d5d-cb97-4653-98fa-7ba89f8d32bf" released by "_delete_snapshot" :: held 1.378s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:56:04 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1c80ef6a-b66a-4f40-aad6-1bcb6ef926bc tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-3e795c84-3675-4813-8b89-4ba607754d7a" released by "delete_snapshot" :: held 1.398s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:56:04 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-1c80ef6a-b66a-4f40-aad6-1bcb6ef926bc tempest-ProjectMemberTests-1781514586 None] Created reservations ['05b3b3bb-cc5c-4fb0-be22-781009778760', '9c3f1f36-cdc8-4f3e-8ed8-1bea1c9cba51', '32a2f69a-0b7d-440a-869e-6fabd51174ca', '943257e5-ae22-44d3-81c7-be3eb9bb39d1'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:56:04 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-1c80ef6a-b66a-4f40-aad6-1bcb6ef926bc tempest-ProjectMemberTests-1781514586 None] Delete snapshot completed successfully. Jul 28 10:56:04 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-1c80ef6a-b66a-4f40-aad6-1bcb6ef926bc tempest-ProjectMemberTests-1781514586 None] Lock "cinder-97c91d5d-cb97-4653-98fa-7ba89f8d32bf-delete_snapshot" released by "delete_snapshot" :: held 1.517s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:56:05 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-689c9d1c-d9c3-4e28-b97e-4523088643d8 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-3e795c84-3675-4813-8b89-4ba607754d7a-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:56:05 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-689c9d1c-d9c3-4e28-b97e-4523088643d8 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-3e795c84-3675-4813-8b89-4ba607754d7a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:56:05 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-689c9d1c-d9c3-4e28-b97e-4523088643d8 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-quobyte-3e795c84-3675-4813-8b89-4ba607754d7a" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:56:05 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-689c9d1c-d9c3-4e28-b97e-4523088643d8 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-3e795c84-3675-4813-8b89-4ba607754d7a" acquired by "delete_volume" :: waited 0.018s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:56:05 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad30712-2a04-4acd-82e0-0e01c2cb2afd]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:56:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-689c9d1c-d9c3-4e28-b97e-4523088643d8 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:05 devstack sudo[108609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a Jul 28 10:56:05 devstack sudo[108609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:05 devstack sudo[108609]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-689c9d1c-d9c3-4e28-b97e-4523088643d8 tempest-ProjectMemberTests-1781514586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a" returned: 0 in 0.350s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-689c9d1c-d9c3-4e28-b97e-4523088643d8 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:05 devstack sudo[108614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a Jul 28 10:56:05 devstack sudo[108614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:05 devstack sudo[108614]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-689c9d1c-d9c3-4e28-b97e-4523088643d8 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-3e795c84-3675-4813-8b89-4ba607754d7a" returned: 0 in 0.240s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:05 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-689c9d1c-d9c3-4e28-b97e-4523088643d8 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-3e795c84-3675-4813-8b89-4ba607754d7a" released by "delete_volume" :: held 0.650s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:56:05 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-689c9d1c-d9c3-4e28-b97e-4523088643d8 tempest-ProjectMemberTests-1781514586 None] Created reservations ['35d5539b-2a34-46d6-88e4-7750c47eea4d', 'd18a278d-d92e-427c-9fc5-7abbd605a6a7', '49a03349-6233-4ce7-9fd4-b8766819f525', 'f86d2702-7c6f-4aa2-b90c-428ebf05c629'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:56:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-689c9d1c-d9c3-4e28-b97e-4523088643d8 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:56:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-689c9d1c-d9c3-4e28-b97e-4523088643d8 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:56:05 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-689c9d1c-d9c3-4e28-b97e-4523088643d8 tempest-ProjectMemberTests-1781514586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:56:05 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-689c9d1c-d9c3-4e28-b97e-4523088643d8 tempest-ProjectMemberTests-1781514586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:56:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-689c9d1c-d9c3-4e28-b97e-4523088643d8 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:56:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-689c9d1c-d9c3-4e28-b97e-4523088643d8 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:05 devstack sudo[108617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:56:05 devstack sudo[108617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:06 devstack sudo[108617]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-689c9d1c-d9c3-4e28-b97e-4523088643d8 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.244s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:06 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-689c9d1c-d9c3-4e28-b97e-4523088643d8 tempest-ProjectMemberTests-1781514586 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:56:06 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-689c9d1c-d9c3-4e28-b97e-4523088643d8 tempest-ProjectMemberTests-1781514586 None] Deleted volume successfully. Jul 28 10:56:06 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-689c9d1c-d9c3-4e28-b97e-4523088643d8 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-3e795c84-3675-4813-8b89-4ba607754d7a-delete_volume" released by "delete_volume" :: held 1.088s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:56:06 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-7660a6a4-8acd-456e-b667-7931dc1484bf tempest-ProjectMemberTests-1781514586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:56:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7660a6a4-8acd-456e-b667-7931dc1484bf tempest-ProjectMemberTests-1781514586 None] Flow 'volume_create_manager' (a358281e-2594-409a-b711-45b9ac9cd411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:56:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7660a6a4-8acd-456e-b667-7931dc1484bf tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64a6e9e3-6c06-471b-9d00-d7a1a0711dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7660a6a4-8acd-456e-b667-7931dc1484bf tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64a6e9e3-6c06-471b-9d00-d7a1a0711dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1051400263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c91c341-4121-4bec-91e3-2bd9ce63feb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61e1f2c346a4cddbe7adc3f82eccf01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:56:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:56:07Z,use_quota=True,user_id='443f2e63fd9f4abcbb3569fc8516b13f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7660a6a4-8acd-456e-b667-7931dc1484bf tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (465dfd22-3cf1-486d-8073-553fd2b6a44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7660a6a4-8acd-456e-b667-7931dc1484bf tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (465dfd22-3cf1-486d-8073-553fd2b6a44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7660a6a4-8acd-456e-b667-7931dc1484bf tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35cff54a-31bf-4d35-9be9-beef1f35a223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7660a6a4-8acd-456e-b667-7931dc1484bf tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35cff54a-31bf-4d35-9be9-beef1f35a223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c91c341-4121-4bec-91e3-2bd9ce63feb0', 'volume_name': 'volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7660a6a4-8acd-456e-b667-7931dc1484bf tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20798d53-83d9-4412-a4b1-c8a04d00a92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7660a6a4-8acd-456e-b667-7931dc1484bf tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20798d53-83d9-4412-a4b1-c8a04d00a92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:06 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7660a6a4-8acd-456e-b667-7931dc1484bf tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (458fb34c-9ffc-4bd9-8611-14e38c474b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:06 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-7660a6a4-8acd-456e-b667-7931dc1484bf tempest-ProjectMemberTests-1781514586 None] Volume 1c91c341-4121-4bec-91e3-2bd9ce63feb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0', 'volume_size': 1} Jul 28 10:56:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7660a6a4-8acd-456e-b667-7931dc1484bf tempest-ProjectMemberTests-1781514586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:56:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7660a6a4-8acd-456e-b667-7931dc1484bf tempest-ProjectMemberTests-1781514586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:56:06 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7660a6a4-8acd-456e-b667-7931dc1484bf tempest-ProjectMemberTests-1781514586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1051400263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c91c341-4121-4bec-91e3-2bd9ce63feb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61e1f2c346a4cddbe7adc3f82eccf01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:56:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:56:07Z,use_quota=True,user_id='443f2e63fd9f4abcbb3569fc8516b13f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:56:06 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-7660a6a4-8acd-456e-b667-7931dc1484bf tempest-ProjectMemberTests-1781514586 None] Creating volume 1c91c341-4121-4bec-91e3-2bd9ce63feb0 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:56:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7660a6a4-8acd-456e-b667-7931dc1484bf tempest-ProjectMemberTests-1781514586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:56:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7660a6a4-8acd-456e-b667-7931dc1484bf tempest-ProjectMemberTests-1781514586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:56:06 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7660a6a4-8acd-456e-b667-7931dc1484bf tempest-ProjectMemberTests-1781514586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:56:06 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7660a6a4-8acd-456e-b667-7931dc1484bf tempest-ProjectMemberTests-1781514586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:56:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7660a6a4-8acd-456e-b667-7931dc1484bf tempest-ProjectMemberTests-1781514586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:56:06 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7660a6a4-8acd-456e-b667-7931dc1484bf tempest-ProjectMemberTests-1781514586 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:56:06 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-7660a6a4-8acd-456e-b667-7931dc1484bf tempest-ProjectMemberTests-1781514586 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:56:06 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7660a6a4-8acd-456e-b667-7931dc1484bf tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:06 devstack sudo[108620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0 1073741824 Jul 28 10:56:06 devstack sudo[108620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:07 devstack sudo[108620]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7660a6a4-8acd-456e-b667-7931dc1484bf tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0 1073741824" returned: 0 in 0.401s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7660a6a4-8acd-456e-b667-7931dc1484bf tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:07 devstack sudo[108626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0 Jul 28 10:56:07 devstack sudo[108626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:07 devstack sudo[108626]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7660a6a4-8acd-456e-b667-7931dc1484bf tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0" returned: 0 in 0.245s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:07 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7660a6a4-8acd-456e-b667-7931dc1484bf tempest-ProjectMemberTests-1781514586 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:56:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7660a6a4-8acd-456e-b667-7931dc1484bf tempest-ProjectMemberTests-1781514586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:56:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7660a6a4-8acd-456e-b667-7931dc1484bf tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (458fb34c-9ffc-4bd9-8611-14e38c474b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7660a6a4-8acd-456e-b667-7931dc1484bf tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5e866fd-1feb-443d-a484-c9868f457aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:07 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-7660a6a4-8acd-456e-b667-7931dc1484bf tempest-ProjectMemberTests-1781514586 None] Volume volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0 (1c91c341-4121-4bec-91e3-2bd9ce63feb0): created successfully Jul 28 10:56:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7660a6a4-8acd-456e-b667-7931dc1484bf tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5e866fd-1feb-443d-a484-c9868f457aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:07 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-7660a6a4-8acd-456e-b667-7931dc1484bf tempest-ProjectMemberTests-1781514586 None] Flow 'volume_create_manager' (a358281e-2594-409a-b711-45b9ac9cd411) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:56:07 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-7660a6a4-8acd-456e-b667-7931dc1484bf tempest-ProjectMemberTests-1781514586 None] Created volume successfully. Jul 28 10:56:07 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=135,cinder:UPDATE=182,cinder:INSERT=50,cinder:DELETE=17 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:56:07 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=147,cinder:UPDATE=185,cinder:DELETE=15,cinder:INSERT=45 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:56:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-457605a9-e09e-4f5b-aa0a-1cee3462c2d5 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:56:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-457605a9-e09e-4f5b-aa0a-1cee3462c2d5 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:56:07 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-457605a9-e09e-4f5b-aa0a-1cee3462c2d5 tempest-ProjectMemberTests-1781514586 None] Creating offline snapshot cba20e62-c801-4614-992d-41cb733b5f77 of volume 1c91c341-4121-4bec-91e3-2bd9ce63feb0 {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:56:07 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a1f32d-e34f-44df-92b2-2c52e6062446]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:56:07 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-457605a9-e09e-4f5b-aa0a-1cee3462c2d5 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:07 devstack sudo[108629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0 Jul 28 10:56:07 devstack sudo[108629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:08 devstack sudo[108629]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-457605a9-e09e-4f5b-aa0a-1cee3462c2d5 tempest-ProjectMemberTests-1781514586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0" returned: 0 in 0.357s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-457605a9-e09e-4f5b-aa0a-1cee3462c2d5 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0.cba20e62-c801-4614-992d-41cb733b5f77 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:08 devstack sudo[108634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0.cba20e62-c801-4614-992d-41cb733b5f77 1G Jul 28 10:56:08 devstack sudo[108634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:08 devstack sudo[108634]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-457605a9-e09e-4f5b-aa0a-1cee3462c2d5 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0.cba20e62-c801-4614-992d-41cb733b5f77 1G" returned: 0 in 0.395s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-457605a9-e09e-4f5b-aa0a-1cee3462c2d5 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0.cba20e62-c801-4614-992d-41cb733b5f77 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:08 devstack sudo[108640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0.cba20e62-c801-4614-992d-41cb733b5f77 Jul 28 10:56:08 devstack sudo[108640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:08 devstack sudo[108640]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-457605a9-e09e-4f5b-aa0a-1cee3462c2d5 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0.cba20e62-c801-4614-992d-41cb733b5f77" returned: 0 in 0.290s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:08 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-457605a9-e09e-4f5b-aa0a-1cee3462c2d5 tempest-ProjectMemberTests-1781514586 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0.cba20e62-c801-4614-992d-41cb733b5f77 is being set with open permissions: ugo+rw Jul 28 10:56:08 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-457605a9-e09e-4f5b-aa0a-1cee3462c2d5 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0.cba20e62-c801-4614-992d-41cb733b5f77 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:08 devstack sudo[108645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0.cba20e62-c801-4614-992d-41cb733b5f77 Jul 28 10:56:08 devstack sudo[108645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:09 devstack sudo[108645]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-457605a9-e09e-4f5b-aa0a-1cee3462c2d5 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0.cba20e62-c801-4614-992d-41cb733b5f77" returned: 0 in 0.238s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-457605a9-e09e-4f5b-aa0a-1cee3462c2d5 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:09 devstack sudo[108648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0.info Jul 28 10:56:09 devstack sudo[108648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:09 devstack sudo[108648]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-457605a9-e09e-4f5b-aa0a-1cee3462c2d5 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0.info" returned: 0 in 0.244s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:09 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-457605a9-e09e-4f5b-aa0a-1cee3462c2d5 tempest-ProjectMemberTests-1781514586 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0.info is being set with open permissions: ugo+rw Jul 28 10:56:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-457605a9-e09e-4f5b-aa0a-1cee3462c2d5 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:09 devstack sudo[108651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0.info Jul 28 10:56:09 devstack sudo[108651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:09 devstack sudo[108651]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-457605a9-e09e-4f5b-aa0a-1cee3462c2d5 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0.info" returned: 0 in 0.242s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:09 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-457605a9-e09e-4f5b-aa0a-1cee3462c2d5 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.848s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:56:09 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-457605a9-e09e-4f5b-aa0a-1cee3462c2d5 tempest-ProjectMemberTests-1781514586 None] Create snapshot completed successfully Jul 28 10:56:09 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fbd31964-8b62-460a-9ed0-c19b8f369474 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-cba20e62-c801-4614-992d-41cb733b5f77-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:56:09 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fbd31964-8b62-460a-9ed0-c19b8f369474 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-cba20e62-c801-4614-992d-41cb733b5f77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:56:09 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fbd31964-8b62-460a-9ed0-c19b8f369474 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-quobyte-1c91c341-4121-4bec-91e3-2bd9ce63feb0" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:56:09 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fbd31964-8b62-460a-9ed0-c19b8f369474 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-1c91c341-4121-4bec-91e3-2bd9ce63feb0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:56:09 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fbd31964-8b62-460a-9ed0-c19b8f369474 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-quobyte-cba20e62-c801-4614-992d-41cb733b5f77" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:56:09 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fbd31964-8b62-460a-9ed0-c19b8f369474 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-cba20e62-c801-4614-992d-41cb733b5f77" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:56:10 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-fbd31964-8b62-460a-9ed0-c19b8f369474 tempest-ProjectMemberTests-1781514586 None] Deleting offline snapshot cba20e62-c801-4614-992d-41cb733b5f77 of volume 1c91c341-4121-4bec-91e3-2bd9ce63feb0 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:56:10 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-fbd31964-8b62-460a-9ed0-c19b8f369474 tempest-ProjectMemberTests-1781514586 None] snapshot_file for this snap is: volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0.cba20e62-c801-4614-992d-41cb733b5f77 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:56:10 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce86cb6-8295-45dd-9113-250fe9513b8e]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:56:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fbd31964-8b62-460a-9ed0-c19b8f369474 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0.cba20e62-c801-4614-992d-41cb733b5f77 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:10 devstack sudo[108654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0.cba20e62-c801-4614-992d-41cb733b5f77 Jul 28 10:56:10 devstack sudo[108654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:10 devstack sudo[108654]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fbd31964-8b62-460a-9ed0-c19b8f369474 tempest-ProjectMemberTests-1781514586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0.cba20e62-c801-4614-992d-41cb733b5f77" returned: 0 in 0.385s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:10 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-fbd31964-8b62-460a-9ed0-c19b8f369474 tempest-ProjectMemberTests-1781514586 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:56:10 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4cda7e-81b1-4ed4-a972-8beba7fcc20e]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:56:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fbd31964-8b62-460a-9ed0-c19b8f369474 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:10 devstack sudo[108660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0 Jul 28 10:56:10 devstack sudo[108660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:10 devstack sudo[108660]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fbd31964-8b62-460a-9ed0-c19b8f369474 tempest-ProjectMemberTests-1781514586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0" returned: 0 in 0.361s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:10 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fbd31964-8b62-460a-9ed0-c19b8f369474 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0.cba20e62-c801-4614-992d-41cb733b5f77 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:10 devstack sudo[108665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0.cba20e62-c801-4614-992d-41cb733b5f77 Jul 28 10:56:10 devstack sudo[108665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:11 devstack sudo[108665]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fbd31964-8b62-460a-9ed0-c19b8f369474 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0.cba20e62-c801-4614-992d-41cb733b5f77" returned: 0 in 0.345s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fbd31964-8b62-460a-9ed0-c19b8f369474 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0.cba20e62-c801-4614-992d-41cb733b5f77 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:11 devstack sudo[108670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0.cba20e62-c801-4614-992d-41cb733b5f77 Jul 28 10:56:11 devstack sudo[108670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:11 devstack sudo[108670]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:11 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fbd31964-8b62-460a-9ed0-c19b8f369474 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0.cba20e62-c801-4614-992d-41cb733b5f77" returned: 0 in 0.251s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:11 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fbd31964-8b62-460a-9ed0-c19b8f369474 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-cba20e62-c801-4614-992d-41cb733b5f77" released by "_delete_snapshot" :: held 1.442s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:56:11 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fbd31964-8b62-460a-9ed0-c19b8f369474 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-1c91c341-4121-4bec-91e3-2bd9ce63feb0" released by "delete_snapshot" :: held 1.468s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:56:11 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-fbd31964-8b62-460a-9ed0-c19b8f369474 tempest-ProjectMemberTests-1781514586 None] Created reservations ['753bd527-0d81-4001-8ca6-9ec4dc07323f', '0a91d9a3-2bd9-42f9-9345-e93aa421c970', '3f9b79b2-63f7-40d0-9463-ea6c1db3059a', '10723f24-43d9-4acc-a3c1-450221a4b9c7'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:56:11 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-fbd31964-8b62-460a-9ed0-c19b8f369474 tempest-ProjectMemberTests-1781514586 None] Delete snapshot completed successfully. Jul 28 10:56:11 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-fbd31964-8b62-460a-9ed0-c19b8f369474 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-cba20e62-c801-4614-992d-41cb733b5f77-delete_snapshot" released by "delete_snapshot" :: held 1.601s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:56:12 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8cff03c8-6148-4708-8278-ea5185508ff0 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-1c91c341-4121-4bec-91e3-2bd9ce63feb0-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:56:12 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8cff03c8-6148-4708-8278-ea5185508ff0 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-1c91c341-4121-4bec-91e3-2bd9ce63feb0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:56:12 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8cff03c8-6148-4708-8278-ea5185508ff0 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-quobyte-1c91c341-4121-4bec-91e3-2bd9ce63feb0" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:56:12 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8cff03c8-6148-4708-8278-ea5185508ff0 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-1c91c341-4121-4bec-91e3-2bd9ce63feb0" acquired by "delete_volume" :: waited 0.017s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:56:12 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[50da3e54-9177-4259-9dcb-f280d71122ce]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:56:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8cff03c8-6148-4708-8278-ea5185508ff0 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:12 devstack sudo[108673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0 Jul 28 10:56:12 devstack sudo[108673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:12 devstack sudo[108673]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8cff03c8-6148-4708-8278-ea5185508ff0 tempest-ProjectMemberTests-1781514586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0" returned: 0 in 0.365s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8cff03c8-6148-4708-8278-ea5185508ff0 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:12 devstack sudo[108678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0 Jul 28 10:56:12 devstack sudo[108678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:12 devstack sudo[108678]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8cff03c8-6148-4708-8278-ea5185508ff0 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-1c91c341-4121-4bec-91e3-2bd9ce63feb0" returned: 0 in 0.244s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:12 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8cff03c8-6148-4708-8278-ea5185508ff0 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-1c91c341-4121-4bec-91e3-2bd9ce63feb0" released by "delete_volume" :: held 0.665s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:56:12 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-8cff03c8-6148-4708-8278-ea5185508ff0 tempest-ProjectMemberTests-1781514586 None] Created reservations ['24d15e3d-4aa6-4da6-8ec4-7b7ede9c22cc', 'bd9a8483-f74b-4209-ba61-bb42229ac656', '248dc355-385a-4750-afc2-eea86beea09d', '41f1bbed-d46c-4646-b20b-48c1f947208c'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:56:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8cff03c8-6148-4708-8278-ea5185508ff0 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:56:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8cff03c8-6148-4708-8278-ea5185508ff0 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:56:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8cff03c8-6148-4708-8278-ea5185508ff0 tempest-ProjectMemberTests-1781514586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:56:12 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-8cff03c8-6148-4708-8278-ea5185508ff0 tempest-ProjectMemberTests-1781514586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:56:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-8cff03c8-6148-4708-8278-ea5185508ff0 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:56:12 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8cff03c8-6148-4708-8278-ea5185508ff0 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:12 devstack sudo[108681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:56:12 devstack sudo[108681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:13 devstack sudo[108681]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-8cff03c8-6148-4708-8278-ea5185508ff0 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.239s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:13 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-8cff03c8-6148-4708-8278-ea5185508ff0 tempest-ProjectMemberTests-1781514586 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:56:13 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-8cff03c8-6148-4708-8278-ea5185508ff0 tempest-ProjectMemberTests-1781514586 None] Deleted volume successfully. Jul 28 10:56:13 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-8cff03c8-6148-4708-8278-ea5185508ff0 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-1c91c341-4121-4bec-91e3-2bd9ce63feb0-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:56:13 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4dac742-36f0-4cc9-be56-f11c95d7fdef tempest-ProjectMemberTests-1781514586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:56:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c4dac742-36f0-4cc9-be56-f11c95d7fdef tempest-ProjectMemberTests-1781514586 None] Flow 'volume_create_manager' (14feaab9-87b2-4a56-8ce0-3b0185b51568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:56:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c4dac742-36f0-4cc9-be56-f11c95d7fdef tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cbd7b15-5bde-48e3-b740-8d11b506eb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c4dac742-36f0-4cc9-be56-f11c95d7fdef tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cbd7b15-5bde-48e3-b740-8d11b506eb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:56:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-616961052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce033f41-0d67-4717-8768-52bd6f8858bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61e1f2c346a4cddbe7adc3f82eccf01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:56:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:56:14Z,use_quota=True,user_id='443f2e63fd9f4abcbb3569fc8516b13f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c4dac742-36f0-4cc9-be56-f11c95d7fdef tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a898389e-ef87-4ec4-889a-2898ef74f77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c4dac742-36f0-4cc9-be56-f11c95d7fdef tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a898389e-ef87-4ec4-889a-2898ef74f77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c4dac742-36f0-4cc9-be56-f11c95d7fdef tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0241880-96c0-455f-b4e9-1382c1ead09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c4dac742-36f0-4cc9-be56-f11c95d7fdef tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0241880-96c0-455f-b4e9-1382c1ead09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce033f41-0d67-4717-8768-52bd6f8858bc', 'volume_name': 'volume-ce033f41-0d67-4717-8768-52bd6f8858bc', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c4dac742-36f0-4cc9-be56-f11c95d7fdef tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (521450c8-240a-4079-963b-1e40559d3618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c4dac742-36f0-4cc9-be56-f11c95d7fdef tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (521450c8-240a-4079-963b-1e40559d3618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:13 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c4dac742-36f0-4cc9-be56-f11c95d7fdef tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a6694c8-a3ab-48dd-ba9f-e9eec0c68acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:13 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-c4dac742-36f0-4cc9-be56-f11c95d7fdef tempest-ProjectMemberTests-1781514586 None] Volume ce033f41-0d67-4717-8768-52bd6f8858bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce033f41-0d67-4717-8768-52bd6f8858bc', 'volume_size': 1} Jul 28 10:56:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c4dac742-36f0-4cc9-be56-f11c95d7fdef tempest-ProjectMemberTests-1781514586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:56:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c4dac742-36f0-4cc9-be56-f11c95d7fdef tempest-ProjectMemberTests-1781514586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:56:13 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c4dac742-36f0-4cc9-be56-f11c95d7fdef tempest-ProjectMemberTests-1781514586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:56:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-616961052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce033f41-0d67-4717-8768-52bd6f8858bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61e1f2c346a4cddbe7adc3f82eccf01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:56:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:56:14Z,use_quota=True,user_id='443f2e63fd9f4abcbb3569fc8516b13f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:56:13 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-c4dac742-36f0-4cc9-be56-f11c95d7fdef tempest-ProjectMemberTests-1781514586 None] Creating volume ce033f41-0d67-4717-8768-52bd6f8858bc {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:56:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c4dac742-36f0-4cc9-be56-f11c95d7fdef tempest-ProjectMemberTests-1781514586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:56:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c4dac742-36f0-4cc9-be56-f11c95d7fdef tempest-ProjectMemberTests-1781514586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:56:13 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c4dac742-36f0-4cc9-be56-f11c95d7fdef tempest-ProjectMemberTests-1781514586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:56:13 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c4dac742-36f0-4cc9-be56-f11c95d7fdef tempest-ProjectMemberTests-1781514586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:56:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c4dac742-36f0-4cc9-be56-f11c95d7fdef tempest-ProjectMemberTests-1781514586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:56:13 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c4dac742-36f0-4cc9-be56-f11c95d7fdef tempest-ProjectMemberTests-1781514586 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:56:13 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-c4dac742-36f0-4cc9-be56-f11c95d7fdef tempest-ProjectMemberTests-1781514586 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:56:13 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c4dac742-36f0-4cc9-be56-f11c95d7fdef tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:13 devstack sudo[108684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc 1073741824 Jul 28 10:56:13 devstack sudo[108684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:14 devstack sudo[108684]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c4dac742-36f0-4cc9-be56-f11c95d7fdef tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc 1073741824" returned: 0 in 0.420s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c4dac742-36f0-4cc9-be56-f11c95d7fdef tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:14 devstack sudo[108690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc Jul 28 10:56:14 devstack sudo[108690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:14 devstack sudo[108690]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c4dac742-36f0-4cc9-be56-f11c95d7fdef tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc" returned: 0 in 0.253s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:14 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-c4dac742-36f0-4cc9-be56-f11c95d7fdef tempest-ProjectMemberTests-1781514586 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:56:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c4dac742-36f0-4cc9-be56-f11c95d7fdef tempest-ProjectMemberTests-1781514586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:56:14 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c4dac742-36f0-4cc9-be56-f11c95d7fdef tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a6694c8-a3ab-48dd-ba9f-e9eec0c68acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce033f41-0d67-4717-8768-52bd6f8858bc', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:14 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c4dac742-36f0-4cc9-be56-f11c95d7fdef tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7853e70-3328-4922-97ad-5c87583c97ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:14 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-c4dac742-36f0-4cc9-be56-f11c95d7fdef tempest-ProjectMemberTests-1781514586 None] Volume volume-ce033f41-0d67-4717-8768-52bd6f8858bc (ce033f41-0d67-4717-8768-52bd6f8858bc): created successfully Jul 28 10:56:14 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c4dac742-36f0-4cc9-be56-f11c95d7fdef tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7853e70-3328-4922-97ad-5c87583c97ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:14 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-c4dac742-36f0-4cc9-be56-f11c95d7fdef tempest-ProjectMemberTests-1781514586 None] Flow 'volume_create_manager' (14feaab9-87b2-4a56-8ce0-3b0185b51568) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:56:14 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-c4dac742-36f0-4cc9-be56-f11c95d7fdef tempest-ProjectMemberTests-1781514586 None] Created volume successfully. Jul 28 10:56:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-4e543a28-f3a5-41ed-824d-17c39176b145 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:56:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-4e543a28-f3a5-41ed-824d-17c39176b145 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:56:14 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-4e543a28-f3a5-41ed-824d-17c39176b145 tempest-ProjectMemberTests-1781514586 None] Creating offline snapshot 0c0aa0b8-439e-4db3-927f-f296e6868489 of volume ce033f41-0d67-4717-8768-52bd6f8858bc {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:56:14 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcaead2-cd1d-42d5-aa4a-185ce5f4c3d8]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:56:14 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4e543a28-f3a5-41ed-824d-17c39176b145 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:14 devstack sudo[108693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc Jul 28 10:56:14 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:15 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4e543a28-f3a5-41ed-824d-17c39176b145 tempest-ProjectMemberTests-1781514586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc" returned: 0 in 0.351s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4e543a28-f3a5-41ed-824d-17c39176b145 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc.0c0aa0b8-439e-4db3-927f-f296e6868489 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:15 devstack sudo[108698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc.0c0aa0b8-439e-4db3-927f-f296e6868489 1G Jul 28 10:56:15 devstack sudo[108698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:15 devstack sudo[108698]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4e543a28-f3a5-41ed-824d-17c39176b145 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc.0c0aa0b8-439e-4db3-927f-f296e6868489 1G" returned: 0 in 0.393s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4e543a28-f3a5-41ed-824d-17c39176b145 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce033f41-0d67-4717-8768-52bd6f8858bc -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc.0c0aa0b8-439e-4db3-927f-f296e6868489 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:15 devstack sudo[108703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce033f41-0d67-4717-8768-52bd6f8858bc -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc.0c0aa0b8-439e-4db3-927f-f296e6868489 Jul 28 10:56:15 devstack sudo[108703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:15 devstack sudo[108703]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4e543a28-f3a5-41ed-824d-17c39176b145 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce033f41-0d67-4717-8768-52bd6f8858bc -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc.0c0aa0b8-439e-4db3-927f-f296e6868489" returned: 0 in 0.280s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:15 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-4e543a28-f3a5-41ed-824d-17c39176b145 tempest-ProjectMemberTests-1781514586 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc.0c0aa0b8-439e-4db3-927f-f296e6868489 is being set with open permissions: ugo+rw Jul 28 10:56:15 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4e543a28-f3a5-41ed-824d-17c39176b145 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc.0c0aa0b8-439e-4db3-927f-f296e6868489 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:15 devstack sudo[108708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc.0c0aa0b8-439e-4db3-927f-f296e6868489 Jul 28 10:56:15 devstack sudo[108708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:16 devstack sudo[108708]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4e543a28-f3a5-41ed-824d-17c39176b145 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc.0c0aa0b8-439e-4db3-927f-f296e6868489" returned: 0 in 0.240s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4e543a28-f3a5-41ed-824d-17c39176b145 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:16 devstack sudo[108711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc.info Jul 28 10:56:16 devstack sudo[108711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:16 devstack sudo[108711]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4e543a28-f3a5-41ed-824d-17c39176b145 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc.info" returned: 0 in 0.251s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:16 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-4e543a28-f3a5-41ed-824d-17c39176b145 tempest-ProjectMemberTests-1781514586 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc.info is being set with open permissions: ugo+rw Jul 28 10:56:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4e543a28-f3a5-41ed-824d-17c39176b145 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:16 devstack sudo[108714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc.info Jul 28 10:56:16 devstack sudo[108714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:16 devstack sudo[108714]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4e543a28-f3a5-41ed-824d-17c39176b145 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc.info" returned: 0 in 0.238s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:16 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-4e543a28-f3a5-41ed-824d-17c39176b145 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.833s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:56:16 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-4e543a28-f3a5-41ed-824d-17c39176b145 tempest-ProjectMemberTests-1781514586 None] Create snapshot completed successfully Jul 28 10:56:16 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-45b49c80-b647-4e0a-bb11-33f471bc811a tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-0c0aa0b8-439e-4db3-927f-f296e6868489-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:56:16 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-45b49c80-b647-4e0a-bb11-33f471bc811a tempest-ProjectMemberTests-1781514586 None] Lock "cinder-0c0aa0b8-439e-4db3-927f-f296e6868489-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:56:16 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-45b49c80-b647-4e0a-bb11-33f471bc811a tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-quobyte-ce033f41-0d67-4717-8768-52bd6f8858bc" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:56:16 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-45b49c80-b647-4e0a-bb11-33f471bc811a tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-ce033f41-0d67-4717-8768-52bd6f8858bc" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:56:17 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-45b49c80-b647-4e0a-bb11-33f471bc811a tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-quobyte-0c0aa0b8-439e-4db3-927f-f296e6868489" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:56:17 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-45b49c80-b647-4e0a-bb11-33f471bc811a tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-0c0aa0b8-439e-4db3-927f-f296e6868489" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:56:17 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-45b49c80-b647-4e0a-bb11-33f471bc811a tempest-ProjectMemberTests-1781514586 None] Deleting offline snapshot 0c0aa0b8-439e-4db3-927f-f296e6868489 of volume ce033f41-0d67-4717-8768-52bd6f8858bc {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:56:17 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-45b49c80-b647-4e0a-bb11-33f471bc811a tempest-ProjectMemberTests-1781514586 None] snapshot_file for this snap is: volume-ce033f41-0d67-4717-8768-52bd6f8858bc.0c0aa0b8-439e-4db3-927f-f296e6868489 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:56:17 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[674111bb-87c0-413b-85b9-bc083748bd33]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:56:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-45b49c80-b647-4e0a-bb11-33f471bc811a tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc.0c0aa0b8-439e-4db3-927f-f296e6868489 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:17 devstack sudo[108717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc.0c0aa0b8-439e-4db3-927f-f296e6868489 Jul 28 10:56:17 devstack sudo[108717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:17 devstack sudo[108717]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-45b49c80-b647-4e0a-bb11-33f471bc811a tempest-ProjectMemberTests-1781514586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc.0c0aa0b8-439e-4db3-927f-f296e6868489" returned: 0 in 0.355s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:17 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-45b49c80-b647-4e0a-bb11-33f471bc811a tempest-ProjectMemberTests-1781514586 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce033f41-0d67-4717-8768-52bd6f8858bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:56:17 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[c646c62b-5e3d-46d3-ac1b-cd4167d8fd8b]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:56:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-45b49c80-b647-4e0a-bb11-33f471bc811a tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:17 devstack sudo[108722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc Jul 28 10:56:17 devstack sudo[108722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:17 devstack sudo[108722]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-45b49c80-b647-4e0a-bb11-33f471bc811a tempest-ProjectMemberTests-1781514586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc" returned: 0 in 0.351s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-45b49c80-b647-4e0a-bb11-33f471bc811a tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc.0c0aa0b8-439e-4db3-927f-f296e6868489 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:17 devstack sudo[108727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc.0c0aa0b8-439e-4db3-927f-f296e6868489 Jul 28 10:56:17 devstack sudo[108727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:18 devstack sudo[108727]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-45b49c80-b647-4e0a-bb11-33f471bc811a tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc.0c0aa0b8-439e-4db3-927f-f296e6868489" returned: 0 in 0.334s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-45b49c80-b647-4e0a-bb11-33f471bc811a tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc.0c0aa0b8-439e-4db3-927f-f296e6868489 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:18 devstack sudo[108733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc.0c0aa0b8-439e-4db3-927f-f296e6868489 Jul 28 10:56:18 devstack sudo[108733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:18 devstack sudo[108733]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-45b49c80-b647-4e0a-bb11-33f471bc811a tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc.0c0aa0b8-439e-4db3-927f-f296e6868489" returned: 0 in 0.257s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:18 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-45b49c80-b647-4e0a-bb11-33f471bc811a tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-0c0aa0b8-439e-4db3-927f-f296e6868489" released by "_delete_snapshot" :: held 1.393s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:56:18 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-45b49c80-b647-4e0a-bb11-33f471bc811a tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-ce033f41-0d67-4717-8768-52bd6f8858bc" released by "delete_snapshot" :: held 1.415s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:56:18 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-45b49c80-b647-4e0a-bb11-33f471bc811a tempest-ProjectMemberTests-1781514586 None] Created reservations ['2b4e2e0e-ad14-48cd-9476-f2023bbd155d', '0d09fd5e-68ce-4273-8bd0-2d2ae12eca15', '755d9d76-e010-43d4-9f89-fe8cd896154f', '949dff02-52f1-4b6d-942a-f57a04c7e058'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:56:18 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-45b49c80-b647-4e0a-bb11-33f471bc811a tempest-ProjectMemberTests-1781514586 None] Delete snapshot completed successfully. Jul 28 10:56:18 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-45b49c80-b647-4e0a-bb11-33f471bc811a tempest-ProjectMemberTests-1781514586 None] Lock "cinder-0c0aa0b8-439e-4db3-927f-f296e6868489-delete_snapshot" released by "delete_snapshot" :: held 1.540s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:56:19 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-23531753-3f8f-4aed-9c2c-1ea898fdbae6 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-ce033f41-0d67-4717-8768-52bd6f8858bc-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:56:19 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-23531753-3f8f-4aed-9c2c-1ea898fdbae6 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-ce033f41-0d67-4717-8768-52bd6f8858bc-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:56:19 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-23531753-3f8f-4aed-9c2c-1ea898fdbae6 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-quobyte-ce033f41-0d67-4717-8768-52bd6f8858bc" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:56:19 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-23531753-3f8f-4aed-9c2c-1ea898fdbae6 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-ce033f41-0d67-4717-8768-52bd6f8858bc" acquired by "delete_volume" :: waited 0.015s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:56:19 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf570ea4-f277-42af-a579-de1507d475d3]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:56:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-23531753-3f8f-4aed-9c2c-1ea898fdbae6 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:19 devstack sudo[108736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc Jul 28 10:56:19 devstack sudo[108736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:19 devstack sudo[108736]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-23531753-3f8f-4aed-9c2c-1ea898fdbae6 tempest-ProjectMemberTests-1781514586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc" returned: 0 in 0.362s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-23531753-3f8f-4aed-9c2c-1ea898fdbae6 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:19 devstack sudo[108741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc Jul 28 10:56:19 devstack sudo[108741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:19 devstack sudo[108741]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-23531753-3f8f-4aed-9c2c-1ea898fdbae6 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-ce033f41-0d67-4717-8768-52bd6f8858bc" returned: 0 in 0.240s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:19 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-23531753-3f8f-4aed-9c2c-1ea898fdbae6 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-ce033f41-0d67-4717-8768-52bd6f8858bc" released by "delete_volume" :: held 0.666s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:56:19 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-23531753-3f8f-4aed-9c2c-1ea898fdbae6 tempest-ProjectMemberTests-1781514586 None] Created reservations ['4ad09e34-c63e-4de5-b421-b9be16427fa6', 'b5afa381-26c1-4f1e-9fa7-686059483ffc', '4e335947-a069-4837-9a00-85923a0b2166', '72acd307-c0ac-4858-a91e-615a6da0039c'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:56:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-23531753-3f8f-4aed-9c2c-1ea898fdbae6 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:56:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-23531753-3f8f-4aed-9c2c-1ea898fdbae6 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:56:19 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-23531753-3f8f-4aed-9c2c-1ea898fdbae6 tempest-ProjectMemberTests-1781514586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:56:19 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-23531753-3f8f-4aed-9c2c-1ea898fdbae6 tempest-ProjectMemberTests-1781514586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:56:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-23531753-3f8f-4aed-9c2c-1ea898fdbae6 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:56:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-23531753-3f8f-4aed-9c2c-1ea898fdbae6 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:19 devstack sudo[108744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:56:19 devstack sudo[108744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:20 devstack sudo[108744]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-23531753-3f8f-4aed-9c2c-1ea898fdbae6 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.235s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:20 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-23531753-3f8f-4aed-9c2c-1ea898fdbae6 tempest-ProjectMemberTests-1781514586 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:56:20 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-23531753-3f8f-4aed-9c2c-1ea898fdbae6 tempest-ProjectMemberTests-1781514586 None] Deleted volume successfully. Jul 28 10:56:20 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-23531753-3f8f-4aed-9c2c-1ea898fdbae6 tempest-ProjectMemberTests-1781514586 None] Lock "cinder-ce033f41-0d67-4717-8768-52bd6f8858bc-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:56:20 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-14ed8f37-bf12-484e-8dc3-9869e07416e5 tempest-ProjectMemberTests-1781514586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:56:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-14ed8f37-bf12-484e-8dc3-9869e07416e5 tempest-ProjectMemberTests-1781514586 None] Flow 'volume_create_manager' (f07dda4c-5a2a-4020-a52a-78099323cc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:56:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-14ed8f37-bf12-484e-8dc3-9869e07416e5 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02973520-a535-4736-9600-a0b80e9a1fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-14ed8f37-bf12-484e-8dc3-9869e07416e5 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02973520-a535-4736-9600-a0b80e9a1fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1145482043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=678b552d-2b7c-4010-8043-c2e7c6dff427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61e1f2c346a4cddbe7adc3f82eccf01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:56:21Z,use_quota=True,user_id='443f2e63fd9f4abcbb3569fc8516b13f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-14ed8f37-bf12-484e-8dc3-9869e07416e5 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6843d19-d74f-49ce-aaac-98774ed24755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-14ed8f37-bf12-484e-8dc3-9869e07416e5 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6843d19-d74f-49ce-aaac-98774ed24755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-14ed8f37-bf12-484e-8dc3-9869e07416e5 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce078db-a22c-46d1-bee7-3e42cb5e43b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-14ed8f37-bf12-484e-8dc3-9869e07416e5 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce078db-a22c-46d1-bee7-3e42cb5e43b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '678b552d-2b7c-4010-8043-c2e7c6dff427', 'volume_name': 'volume-678b552d-2b7c-4010-8043-c2e7c6dff427', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-14ed8f37-bf12-484e-8dc3-9869e07416e5 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3dc20c8-7bbf-4b59-bd92-961d0791aa27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-14ed8f37-bf12-484e-8dc3-9869e07416e5 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3dc20c8-7bbf-4b59-bd92-961d0791aa27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-14ed8f37-bf12-484e-8dc3-9869e07416e5 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f0fdb83-e5ba-4069-9e61-c4ba82fb2c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:20 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-14ed8f37-bf12-484e-8dc3-9869e07416e5 tempest-ProjectMemberTests-1781514586 None] Volume 678b552d-2b7c-4010-8043-c2e7c6dff427: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-678b552d-2b7c-4010-8043-c2e7c6dff427', 'volume_size': 1} Jul 28 10:56:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-14ed8f37-bf12-484e-8dc3-9869e07416e5 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:56:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-14ed8f37-bf12-484e-8dc3-9869e07416e5 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:56:20 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-14ed8f37-bf12-484e-8dc3-9869e07416e5 tempest-ProjectMemberTests-1781514586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1145482043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=678b552d-2b7c-4010-8043-c2e7c6dff427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61e1f2c346a4cddbe7adc3f82eccf01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:56:21Z,use_quota=True,user_id='443f2e63fd9f4abcbb3569fc8516b13f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:56:20 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-14ed8f37-bf12-484e-8dc3-9869e07416e5 tempest-ProjectMemberTests-1781514586 None] Creating volume 678b552d-2b7c-4010-8043-c2e7c6dff427 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:56:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-14ed8f37-bf12-484e-8dc3-9869e07416e5 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:56:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-14ed8f37-bf12-484e-8dc3-9869e07416e5 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:56:20 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-14ed8f37-bf12-484e-8dc3-9869e07416e5 tempest-ProjectMemberTests-1781514586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:56:20 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-14ed8f37-bf12-484e-8dc3-9869e07416e5 tempest-ProjectMemberTests-1781514586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:56:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-14ed8f37-bf12-484e-8dc3-9869e07416e5 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:56:20 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-14ed8f37-bf12-484e-8dc3-9869e07416e5 tempest-ProjectMemberTests-1781514586 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:56:20 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-14ed8f37-bf12-484e-8dc3-9869e07416e5 tempest-ProjectMemberTests-1781514586 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:56:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-14ed8f37-bf12-484e-8dc3-9869e07416e5 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:20 devstack sudo[108748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427 1073741824 Jul 28 10:56:20 devstack sudo[108748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:21 devstack sudo[108748]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-14ed8f37-bf12-484e-8dc3-9869e07416e5 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427 1073741824" returned: 0 in 0.415s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-14ed8f37-bf12-484e-8dc3-9869e07416e5 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:21 devstack sudo[108754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427 Jul 28 10:56:21 devstack sudo[108754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:21 devstack sudo[108754]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-14ed8f37-bf12-484e-8dc3-9869e07416e5 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427" returned: 0 in 0.243s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:21 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-14ed8f37-bf12-484e-8dc3-9869e07416e5 tempest-ProjectMemberTests-1781514586 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:56:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-14ed8f37-bf12-484e-8dc3-9869e07416e5 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:56:21 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-14ed8f37-bf12-484e-8dc3-9869e07416e5 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f0fdb83-e5ba-4069-9e61-c4ba82fb2c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-678b552d-2b7c-4010-8043-c2e7c6dff427', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:21 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-14ed8f37-bf12-484e-8dc3-9869e07416e5 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (524d3a99-e9a4-4363-9fe4-2bdfcaf0b774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:21 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-14ed8f37-bf12-484e-8dc3-9869e07416e5 tempest-ProjectMemberTests-1781514586 None] Volume volume-678b552d-2b7c-4010-8043-c2e7c6dff427 (678b552d-2b7c-4010-8043-c2e7c6dff427): created successfully Jul 28 10:56:21 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-14ed8f37-bf12-484e-8dc3-9869e07416e5 tempest-ProjectMemberTests-1781514586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (524d3a99-e9a4-4363-9fe4-2bdfcaf0b774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:21 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-14ed8f37-bf12-484e-8dc3-9869e07416e5 tempest-ProjectMemberTests-1781514586 None] Flow 'volume_create_manager' (f07dda4c-5a2a-4020-a52a-78099323cc88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:56:21 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-14ed8f37-bf12-484e-8dc3-9869e07416e5 tempest-ProjectMemberTests-1781514586 None] Created volume successfully. Jul 28 10:56:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-4b03d079-b060-477e-bce4-df7780e33123 tempest-ProjectMemberTests-1781514586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:56:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-4b03d079-b060-477e-bce4-df7780e33123 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:56:21 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-4b03d079-b060-477e-bce4-df7780e33123 tempest-ProjectMemberTests-1781514586 None] Creating offline snapshot 3fec0c2f-03ca-4abe-8b54-0df80d0aca40 of volume 678b552d-2b7c-4010-8043-c2e7c6dff427 {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:56:21 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b33506e-3496-4350-a149-69760b1d8be6]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:56:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4b03d079-b060-477e-bce4-df7780e33123 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:21 devstack sudo[108757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427 Jul 28 10:56:21 devstack sudo[108757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:22 devstack sudo[108757]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4b03d079-b060-477e-bce4-df7780e33123 tempest-ProjectMemberTests-1781514586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427" returned: 0 in 0.376s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4b03d079-b060-477e-bce4-df7780e33123 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427.3fec0c2f-03ca-4abe-8b54-0df80d0aca40 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:22 devstack sudo[108763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427.3fec0c2f-03ca-4abe-8b54-0df80d0aca40 1G Jul 28 10:56:22 devstack sudo[108763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:22 devstack sudo[108763]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4b03d079-b060-477e-bce4-df7780e33123 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427.3fec0c2f-03ca-4abe-8b54-0df80d0aca40 1G" returned: 0 in 0.433s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4b03d079-b060-477e-bce4-df7780e33123 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-678b552d-2b7c-4010-8043-c2e7c6dff427 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427.3fec0c2f-03ca-4abe-8b54-0df80d0aca40 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:22 devstack sudo[108768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-678b552d-2b7c-4010-8043-c2e7c6dff427 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427.3fec0c2f-03ca-4abe-8b54-0df80d0aca40 Jul 28 10:56:22 devstack sudo[108768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:22 devstack sudo[108768]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4b03d079-b060-477e-bce4-df7780e33123 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-678b552d-2b7c-4010-8043-c2e7c6dff427 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427.3fec0c2f-03ca-4abe-8b54-0df80d0aca40" returned: 0 in 0.286s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:22 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-4b03d079-b060-477e-bce4-df7780e33123 tempest-ProjectMemberTests-1781514586 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427.3fec0c2f-03ca-4abe-8b54-0df80d0aca40 is being set with open permissions: ugo+rw Jul 28 10:56:22 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4b03d079-b060-477e-bce4-df7780e33123 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427.3fec0c2f-03ca-4abe-8b54-0df80d0aca40 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:22 devstack sudo[108773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427.3fec0c2f-03ca-4abe-8b54-0df80d0aca40 Jul 28 10:56:22 devstack sudo[108773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:23 devstack sudo[108773]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4b03d079-b060-477e-bce4-df7780e33123 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427.3fec0c2f-03ca-4abe-8b54-0df80d0aca40" returned: 0 in 0.261s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4b03d079-b060-477e-bce4-df7780e33123 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:23 devstack sudo[108776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427.info Jul 28 10:56:23 devstack sudo[108776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:23 devstack sudo[108776]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4b03d079-b060-477e-bce4-df7780e33123 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427.info" returned: 0 in 0.257s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:23 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-4b03d079-b060-477e-bce4-df7780e33123 tempest-ProjectMemberTests-1781514586 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427.info is being set with open permissions: ugo+rw Jul 28 10:56:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4b03d079-b060-477e-bce4-df7780e33123 tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:23 devstack sudo[108779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427.info Jul 28 10:56:23 devstack sudo[108779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:23 devstack sudo[108779]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-4b03d079-b060-477e-bce4-df7780e33123 tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427.info" returned: 0 in 0.237s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:23 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-4b03d079-b060-477e-bce4-df7780e33123 tempest-ProjectMemberTests-1781514586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.929s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:56:23 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-4b03d079-b060-477e-bce4-df7780e33123 tempest-ProjectMemberTests-1781514586 None] Create snapshot completed successfully Jul 28 10:56:24 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7893b2d9-b1f5-4a82-82ca-0a3001a13cff tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-3fec0c2f-03ca-4abe-8b54-0df80d0aca40-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:56:24 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7893b2d9-b1f5-4a82-82ca-0a3001a13cff tempest-ProjectMemberTests-1781514586 None] Lock "cinder-3fec0c2f-03ca-4abe-8b54-0df80d0aca40-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:56:24 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7893b2d9-b1f5-4a82-82ca-0a3001a13cff tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-quobyte-678b552d-2b7c-4010-8043-c2e7c6dff427" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:56:24 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7893b2d9-b1f5-4a82-82ca-0a3001a13cff tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-678b552d-2b7c-4010-8043-c2e7c6dff427" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:56:24 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7893b2d9-b1f5-4a82-82ca-0a3001a13cff tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-quobyte-3fec0c2f-03ca-4abe-8b54-0df80d0aca40" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:56:24 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7893b2d9-b1f5-4a82-82ca-0a3001a13cff tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-3fec0c2f-03ca-4abe-8b54-0df80d0aca40" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:56:24 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-7893b2d9-b1f5-4a82-82ca-0a3001a13cff tempest-ProjectMemberTests-1781514586 None] Deleting offline snapshot 3fec0c2f-03ca-4abe-8b54-0df80d0aca40 of volume 678b552d-2b7c-4010-8043-c2e7c6dff427 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:56:24 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-7893b2d9-b1f5-4a82-82ca-0a3001a13cff tempest-ProjectMemberTests-1781514586 None] snapshot_file for this snap is: volume-678b552d-2b7c-4010-8043-c2e7c6dff427.3fec0c2f-03ca-4abe-8b54-0df80d0aca40 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:56:24 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af3052b-f5fd-402b-a04c-5f465f41e432]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:56:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7893b2d9-b1f5-4a82-82ca-0a3001a13cff tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427.3fec0c2f-03ca-4abe-8b54-0df80d0aca40 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:24 devstack sudo[108782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427.3fec0c2f-03ca-4abe-8b54-0df80d0aca40 Jul 28 10:56:24 devstack sudo[108782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:24 devstack sudo[108782]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7893b2d9-b1f5-4a82-82ca-0a3001a13cff tempest-ProjectMemberTests-1781514586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427.3fec0c2f-03ca-4abe-8b54-0df80d0aca40" returned: 0 in 0.359s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:24 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-7893b2d9-b1f5-4a82-82ca-0a3001a13cff tempest-ProjectMemberTests-1781514586 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-678b552d-2b7c-4010-8043-c2e7c6dff427(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:56:24 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff558973-1904-47d5-86c5-6d6ad31c490d]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:56:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7893b2d9-b1f5-4a82-82ca-0a3001a13cff tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:24 devstack sudo[108787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427 Jul 28 10:56:24 devstack sudo[108787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:24 devstack sudo[108787]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7893b2d9-b1f5-4a82-82ca-0a3001a13cff tempest-ProjectMemberTests-1781514586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427" returned: 0 in 0.361s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:24 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7893b2d9-b1f5-4a82-82ca-0a3001a13cff tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427.3fec0c2f-03ca-4abe-8b54-0df80d0aca40 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:24 devstack sudo[108792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427.3fec0c2f-03ca-4abe-8b54-0df80d0aca40 Jul 28 10:56:24 devstack sudo[108792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:25 devstack sudo[108792]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7893b2d9-b1f5-4a82-82ca-0a3001a13cff tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427.3fec0c2f-03ca-4abe-8b54-0df80d0aca40" returned: 0 in 0.329s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7893b2d9-b1f5-4a82-82ca-0a3001a13cff tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427.3fec0c2f-03ca-4abe-8b54-0df80d0aca40 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:25 devstack sudo[108797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427.3fec0c2f-03ca-4abe-8b54-0df80d0aca40 Jul 28 10:56:25 devstack sudo[108797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:25 devstack sudo[108797]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:25 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7893b2d9-b1f5-4a82-82ca-0a3001a13cff tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427.3fec0c2f-03ca-4abe-8b54-0df80d0aca40" returned: 0 in 0.247s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:25 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7893b2d9-b1f5-4a82-82ca-0a3001a13cff tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-3fec0c2f-03ca-4abe-8b54-0df80d0aca40" released by "_delete_snapshot" :: held 1.386s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:56:25 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7893b2d9-b1f5-4a82-82ca-0a3001a13cff tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-678b552d-2b7c-4010-8043-c2e7c6dff427" released by "delete_snapshot" :: held 1.405s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:56:25 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-7893b2d9-b1f5-4a82-82ca-0a3001a13cff tempest-ProjectMemberTests-1781514586 None] Created reservations ['f78ea316-c81c-4026-a58a-11a0479512c2', '83d4dca8-d889-4429-b156-32ee8cf6b6f9', 'b48ff736-8c27-49c9-8f32-f9f3e247c794', '35dc87ed-1698-4d48-ba57-9b2c418c114c'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:56:25 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-7893b2d9-b1f5-4a82-82ca-0a3001a13cff tempest-ProjectMemberTests-1781514586 None] Delete snapshot completed successfully. Jul 28 10:56:25 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7893b2d9-b1f5-4a82-82ca-0a3001a13cff tempest-ProjectMemberTests-1781514586 None] Lock "cinder-3fec0c2f-03ca-4abe-8b54-0df80d0aca40-delete_snapshot" released by "delete_snapshot" :: held 1.535s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:56:26 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-356dfccb-d818-4f8a-9701-5d5de4e281be tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-678b552d-2b7c-4010-8043-c2e7c6dff427-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:56:26 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-356dfccb-d818-4f8a-9701-5d5de4e281be tempest-ProjectMemberTests-1781514586 None] Lock "cinder-678b552d-2b7c-4010-8043-c2e7c6dff427-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:56:26 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-356dfccb-d818-4f8a-9701-5d5de4e281be tempest-ProjectMemberTests-1781514586 None] Acquiring lock "cinder-quobyte-678b552d-2b7c-4010-8043-c2e7c6dff427" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:56:26 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-356dfccb-d818-4f8a-9701-5d5de4e281be tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-678b552d-2b7c-4010-8043-c2e7c6dff427" acquired by "delete_volume" :: waited 0.014s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:56:26 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[1614e646-db6c-45ec-9f33-8332fe1d6cf7]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:56:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-356dfccb-d818-4f8a-9701-5d5de4e281be tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:26 devstack sudo[108800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427 Jul 28 10:56:26 devstack sudo[108800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:26 devstack sudo[108800]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-356dfccb-d818-4f8a-9701-5d5de4e281be tempest-ProjectMemberTests-1781514586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427" returned: 0 in 0.353s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-356dfccb-d818-4f8a-9701-5d5de4e281be tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:26 devstack sudo[108805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427 Jul 28 10:56:26 devstack sudo[108805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:26 devstack sudo[108805]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:26 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-356dfccb-d818-4f8a-9701-5d5de4e281be tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-678b552d-2b7c-4010-8043-c2e7c6dff427" returned: 0 in 0.265s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:26 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-356dfccb-d818-4f8a-9701-5d5de4e281be tempest-ProjectMemberTests-1781514586 None] Lock "cinder-quobyte-678b552d-2b7c-4010-8043-c2e7c6dff427" released by "delete_volume" :: held 0.671s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:56:26 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-356dfccb-d818-4f8a-9701-5d5de4e281be tempest-ProjectMemberTests-1781514586 None] Created reservations ['d35ce03a-2abd-4684-94d9-fd2478ad363d', '4c45858e-e6de-43c2-a952-2ebcd92e344e', '42ee7292-4857-4e3d-8c6b-bbab63966dc3', '42c123fb-eb26-470c-b551-de74b8916c82'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:56:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-356dfccb-d818-4f8a-9701-5d5de4e281be tempest-ProjectMemberTests-1781514586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:56:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-356dfccb-d818-4f8a-9701-5d5de4e281be tempest-ProjectMemberTests-1781514586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:56:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-356dfccb-d818-4f8a-9701-5d5de4e281be tempest-ProjectMemberTests-1781514586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:56:27 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-356dfccb-d818-4f8a-9701-5d5de4e281be tempest-ProjectMemberTests-1781514586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:56:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-356dfccb-d818-4f8a-9701-5d5de4e281be tempest-ProjectMemberTests-1781514586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:56:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-356dfccb-d818-4f8a-9701-5d5de4e281be tempest-ProjectMemberTests-1781514586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:27 devstack sudo[108808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:56:27 devstack sudo[108808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:27 devstack sudo[108808]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:27 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-356dfccb-d818-4f8a-9701-5d5de4e281be tempest-ProjectMemberTests-1781514586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.237s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:27 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-356dfccb-d818-4f8a-9701-5d5de4e281be tempest-ProjectMemberTests-1781514586 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:56:27 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-356dfccb-d818-4f8a-9701-5d5de4e281be tempest-ProjectMemberTests-1781514586 None] Deleted volume successfully. Jul 28 10:56:27 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-356dfccb-d818-4f8a-9701-5d5de4e281be tempest-ProjectMemberTests-1781514586 None] Lock "cinder-678b552d-2b7c-4010-8043-c2e7c6dff427-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:56:28 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:56:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:56:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:56:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:56:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:56:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:56:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:28 devstack sudo[108811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:56:28 devstack sudo[108811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:28 devstack sudo[108811]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.263s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:28 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:56:28 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager._thread_info {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:56:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread count: 29 {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 10:56:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread info: [<_MainThread(MainThread, started 137939890385024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 10:56:30 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-01fdc887-4d8f-44d1-8da7-0a8cebdca7f3 tempest-ProjectReaderTests-1275809092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:56:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01fdc887-4d8f-44d1-8da7-0a8cebdca7f3 tempest-ProjectReaderTests-1275809092 None] Flow 'volume_create_manager' (bcf14dfc-05d3-49b5-a3ae-47750779b2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:56:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01fdc887-4d8f-44d1-8da7-0a8cebdca7f3 tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b0aec9-10cd-47e2-9eb2-04253cc15bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01fdc887-4d8f-44d1-8da7-0a8cebdca7f3 tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b0aec9-10cd-47e2-9eb2-04253cc15bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-455263063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=487174ba-843c-48d5-9c4d-9e8acfc62bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddabd82ab2a14399812eda79e8b583a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:56:31Z,use_quota=True,user_id='66db51d4d800446f9bba53b671c312e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01fdc887-4d8f-44d1-8da7-0a8cebdca7f3 tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f75f1f-3de1-4cc2-a401-0e8523c3df7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01fdc887-4d8f-44d1-8da7-0a8cebdca7f3 tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f75f1f-3de1-4cc2-a401-0e8523c3df7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01fdc887-4d8f-44d1-8da7-0a8cebdca7f3 tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6334faf5-b0e1-46e1-983c-32f78af0621f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01fdc887-4d8f-44d1-8da7-0a8cebdca7f3 tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6334faf5-b0e1-46e1-983c-32f78af0621f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '487174ba-843c-48d5-9c4d-9e8acfc62bb6', 'volume_name': 'volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01fdc887-4d8f-44d1-8da7-0a8cebdca7f3 tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edf24884-e323-4b4d-88f0-2ce5e9abe808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01fdc887-4d8f-44d1-8da7-0a8cebdca7f3 tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edf24884-e323-4b4d-88f0-2ce5e9abe808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:30 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01fdc887-4d8f-44d1-8da7-0a8cebdca7f3 tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e523e31-c7fd-434f-95ba-0cef08805f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:30 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-01fdc887-4d8f-44d1-8da7-0a8cebdca7f3 tempest-ProjectReaderTests-1275809092 None] Volume 487174ba-843c-48d5-9c4d-9e8acfc62bb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6', 'volume_size': 1} Jul 28 10:56:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01fdc887-4d8f-44d1-8da7-0a8cebdca7f3 tempest-ProjectReaderTests-1275809092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:56:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01fdc887-4d8f-44d1-8da7-0a8cebdca7f3 tempest-ProjectReaderTests-1275809092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:56:30 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01fdc887-4d8f-44d1-8da7-0a8cebdca7f3 tempest-ProjectReaderTests-1275809092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-455263063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=487174ba-843c-48d5-9c4d-9e8acfc62bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddabd82ab2a14399812eda79e8b583a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:56:31Z,use_quota=True,user_id='66db51d4d800446f9bba53b671c312e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:56:30 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-01fdc887-4d8f-44d1-8da7-0a8cebdca7f3 tempest-ProjectReaderTests-1275809092 None] Creating volume 487174ba-843c-48d5-9c4d-9e8acfc62bb6 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:56:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01fdc887-4d8f-44d1-8da7-0a8cebdca7f3 tempest-ProjectReaderTests-1275809092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:56:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01fdc887-4d8f-44d1-8da7-0a8cebdca7f3 tempest-ProjectReaderTests-1275809092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:56:30 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01fdc887-4d8f-44d1-8da7-0a8cebdca7f3 tempest-ProjectReaderTests-1275809092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:56:30 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01fdc887-4d8f-44d1-8da7-0a8cebdca7f3 tempest-ProjectReaderTests-1275809092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:56:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01fdc887-4d8f-44d1-8da7-0a8cebdca7f3 tempest-ProjectReaderTests-1275809092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:56:30 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01fdc887-4d8f-44d1-8da7-0a8cebdca7f3 tempest-ProjectReaderTests-1275809092 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:56:30 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-01fdc887-4d8f-44d1-8da7-0a8cebdca7f3 tempest-ProjectReaderTests-1275809092 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:56:30 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01fdc887-4d8f-44d1-8da7-0a8cebdca7f3 tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:30 devstack sudo[108851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6 1073741824 Jul 28 10:56:30 devstack sudo[108851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:31 devstack sudo[108851]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01fdc887-4d8f-44d1-8da7-0a8cebdca7f3 tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6 1073741824" returned: 0 in 0.406s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01fdc887-4d8f-44d1-8da7-0a8cebdca7f3 tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:31 devstack sudo[108856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6 Jul 28 10:56:31 devstack sudo[108856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:31 devstack sudo[108856]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01fdc887-4d8f-44d1-8da7-0a8cebdca7f3 tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6" returned: 0 in 0.239s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:31 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01fdc887-4d8f-44d1-8da7-0a8cebdca7f3 tempest-ProjectReaderTests-1275809092 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:56:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01fdc887-4d8f-44d1-8da7-0a8cebdca7f3 tempest-ProjectReaderTests-1275809092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:56:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01fdc887-4d8f-44d1-8da7-0a8cebdca7f3 tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e523e31-c7fd-434f-95ba-0cef08805f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01fdc887-4d8f-44d1-8da7-0a8cebdca7f3 tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b44ab6-3af7-486b-928a-5911e4814d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:31 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-01fdc887-4d8f-44d1-8da7-0a8cebdca7f3 tempest-ProjectReaderTests-1275809092 None] Volume volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6 (487174ba-843c-48d5-9c4d-9e8acfc62bb6): created successfully Jul 28 10:56:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01fdc887-4d8f-44d1-8da7-0a8cebdca7f3 tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b44ab6-3af7-486b-928a-5911e4814d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:31 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01fdc887-4d8f-44d1-8da7-0a8cebdca7f3 tempest-ProjectReaderTests-1275809092 None] Flow 'volume_create_manager' (bcf14dfc-05d3-49b5-a3ae-47750779b2c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:56:31 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-01fdc887-4d8f-44d1-8da7-0a8cebdca7f3 tempest-ProjectReaderTests-1275809092 None] Created volume successfully. Jul 28 10:56:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-89e45a51-963d-426e-8116-e34fd6a843e9 tempest-ProjectReaderTests-1275809092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:56:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-89e45a51-963d-426e-8116-e34fd6a843e9 tempest-ProjectReaderTests-1275809092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:56:31 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-89e45a51-963d-426e-8116-e34fd6a843e9 tempest-ProjectReaderTests-1275809092 None] Creating offline snapshot ca652844-0341-43c7-ba98-f8a3d2b41233 of volume 487174ba-843c-48d5-9c4d-9e8acfc62bb6 {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:56:31 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[d990247e-6213-48a0-8240-87e173ea3d39]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:56:31 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-89e45a51-963d-426e-8116-e34fd6a843e9 tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:32 devstack sudo[108859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6 Jul 28 10:56:32 devstack sudo[108859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:32 devstack sudo[108859]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-89e45a51-963d-426e-8116-e34fd6a843e9 tempest-ProjectReaderTests-1275809092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6" returned: 0 in 0.358s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-89e45a51-963d-426e-8116-e34fd6a843e9 tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6.ca652844-0341-43c7-ba98-f8a3d2b41233 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:32 devstack sudo[108864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6.ca652844-0341-43c7-ba98-f8a3d2b41233 1G Jul 28 10:56:32 devstack sudo[108864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:32 devstack sudo[108864]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-89e45a51-963d-426e-8116-e34fd6a843e9 tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6.ca652844-0341-43c7-ba98-f8a3d2b41233 1G" returned: 0 in 0.408s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:32 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-89e45a51-963d-426e-8116-e34fd6a843e9 tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6.ca652844-0341-43c7-ba98-f8a3d2b41233 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:32 devstack sudo[108870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6.ca652844-0341-43c7-ba98-f8a3d2b41233 Jul 28 10:56:32 devstack sudo[108870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:33 devstack sudo[108870]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-89e45a51-963d-426e-8116-e34fd6a843e9 tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6.ca652844-0341-43c7-ba98-f8a3d2b41233" returned: 0 in 0.307s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:33 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-89e45a51-963d-426e-8116-e34fd6a843e9 tempest-ProjectReaderTests-1275809092 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6.ca652844-0341-43c7-ba98-f8a3d2b41233 is being set with open permissions: ugo+rw Jul 28 10:56:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-89e45a51-963d-426e-8116-e34fd6a843e9 tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6.ca652844-0341-43c7-ba98-f8a3d2b41233 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:33 devstack sudo[108875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6.ca652844-0341-43c7-ba98-f8a3d2b41233 Jul 28 10:56:33 devstack sudo[108875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:33 devstack sudo[108875]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-89e45a51-963d-426e-8116-e34fd6a843e9 tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6.ca652844-0341-43c7-ba98-f8a3d2b41233" returned: 0 in 0.237s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-89e45a51-963d-426e-8116-e34fd6a843e9 tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:33 devstack sudo[108878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6.info Jul 28 10:56:33 devstack sudo[108878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:33 devstack sudo[108878]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-89e45a51-963d-426e-8116-e34fd6a843e9 tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6.info" returned: 0 in 0.243s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:33 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-89e45a51-963d-426e-8116-e34fd6a843e9 tempest-ProjectReaderTests-1275809092 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6.info is being set with open permissions: ugo+rw Jul 28 10:56:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-89e45a51-963d-426e-8116-e34fd6a843e9 tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:33 devstack sudo[108881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6.info Jul 28 10:56:33 devstack sudo[108881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:33 devstack sudo[108881]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-89e45a51-963d-426e-8116-e34fd6a843e9 tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6.info" returned: 0 in 0.239s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:33 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-89e45a51-963d-426e-8116-e34fd6a843e9 tempest-ProjectReaderTests-1275809092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.872s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:56:33 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-89e45a51-963d-426e-8116-e34fd6a843e9 tempest-ProjectReaderTests-1275809092 None] Create snapshot completed successfully Jul 28 10:56:34 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-bf3895e0-498d-4709-9d57-097c3d3308f0 tempest-ProjectReaderTests-1275809092 None] Acquiring lock "cinder-ca652844-0341-43c7-ba98-f8a3d2b41233-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:56:34 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-bf3895e0-498d-4709-9d57-097c3d3308f0 tempest-ProjectReaderTests-1275809092 None] Lock "cinder-ca652844-0341-43c7-ba98-f8a3d2b41233-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:56:34 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-bf3895e0-498d-4709-9d57-097c3d3308f0 tempest-ProjectReaderTests-1275809092 None] Acquiring lock "cinder-quobyte-487174ba-843c-48d5-9c4d-9e8acfc62bb6" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:56:34 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-bf3895e0-498d-4709-9d57-097c3d3308f0 tempest-ProjectReaderTests-1275809092 None] Lock "cinder-quobyte-487174ba-843c-48d5-9c4d-9e8acfc62bb6" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:56:34 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-bf3895e0-498d-4709-9d57-097c3d3308f0 tempest-ProjectReaderTests-1275809092 None] Acquiring lock "cinder-quobyte-ca652844-0341-43c7-ba98-f8a3d2b41233" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:56:34 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-bf3895e0-498d-4709-9d57-097c3d3308f0 tempest-ProjectReaderTests-1275809092 None] Lock "cinder-quobyte-ca652844-0341-43c7-ba98-f8a3d2b41233" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:56:34 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-bf3895e0-498d-4709-9d57-097c3d3308f0 tempest-ProjectReaderTests-1275809092 None] Deleting offline snapshot ca652844-0341-43c7-ba98-f8a3d2b41233 of volume 487174ba-843c-48d5-9c4d-9e8acfc62bb6 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:56:34 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-bf3895e0-498d-4709-9d57-097c3d3308f0 tempest-ProjectReaderTests-1275809092 None] snapshot_file for this snap is: volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6.ca652844-0341-43c7-ba98-f8a3d2b41233 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:56:34 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb2af8e-f456-4856-9e93-80cad9ea85eb]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:56:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bf3895e0-498d-4709-9d57-097c3d3308f0 tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6.ca652844-0341-43c7-ba98-f8a3d2b41233 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:34 devstack sudo[108890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6.ca652844-0341-43c7-ba98-f8a3d2b41233 Jul 28 10:56:34 devstack sudo[108890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:34 devstack sudo[108890]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bf3895e0-498d-4709-9d57-097c3d3308f0 tempest-ProjectReaderTests-1275809092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6.ca652844-0341-43c7-ba98-f8a3d2b41233" returned: 0 in 0.362s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:34 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-bf3895e0-498d-4709-9d57-097c3d3308f0 tempest-ProjectReaderTests-1275809092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:56:34 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[619f6e5f-f1ff-4b00-894d-9cf0e57b6b35]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:56:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bf3895e0-498d-4709-9d57-097c3d3308f0 tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:34 devstack sudo[108895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6 Jul 28 10:56:34 devstack sudo[108895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:34 devstack sudo[108895]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bf3895e0-498d-4709-9d57-097c3d3308f0 tempest-ProjectReaderTests-1275809092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6" returned: 0 in 0.352s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:34 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bf3895e0-498d-4709-9d57-097c3d3308f0 tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6.ca652844-0341-43c7-ba98-f8a3d2b41233 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:35 devstack sudo[108900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6.ca652844-0341-43c7-ba98-f8a3d2b41233 Jul 28 10:56:35 devstack sudo[108900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:35 devstack sudo[108900]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bf3895e0-498d-4709-9d57-097c3d3308f0 tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6.ca652844-0341-43c7-ba98-f8a3d2b41233" returned: 0 in 0.337s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bf3895e0-498d-4709-9d57-097c3d3308f0 tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6.ca652844-0341-43c7-ba98-f8a3d2b41233 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:35 devstack sudo[108906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6.ca652844-0341-43c7-ba98-f8a3d2b41233 Jul 28 10:56:35 devstack sudo[108906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:35 devstack sudo[108906]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:35 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-bf3895e0-498d-4709-9d57-097c3d3308f0 tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6.ca652844-0341-43c7-ba98-f8a3d2b41233" returned: 0 in 0.246s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:35 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-bf3895e0-498d-4709-9d57-097c3d3308f0 tempest-ProjectReaderTests-1275809092 None] Lock "cinder-quobyte-ca652844-0341-43c7-ba98-f8a3d2b41233" released by "_delete_snapshot" :: held 1.387s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:56:35 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-bf3895e0-498d-4709-9d57-097c3d3308f0 tempest-ProjectReaderTests-1275809092 None] Lock "cinder-quobyte-487174ba-843c-48d5-9c4d-9e8acfc62bb6" released by "delete_snapshot" :: held 1.406s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:56:35 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-bf3895e0-498d-4709-9d57-097c3d3308f0 tempest-ProjectReaderTests-1275809092 None] Created reservations ['f2aab813-af66-4e55-803a-e251230b2385', '64ac957e-2cb5-4f1d-83d5-5e8b7f7db779', '90fd62c5-b5c0-49ba-a08d-e00afe639b79', '82c92593-7289-4f1f-a9e9-dfa854ddbcfb'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:56:35 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-bf3895e0-498d-4709-9d57-097c3d3308f0 tempest-ProjectReaderTests-1275809092 None] Delete snapshot completed successfully. Jul 28 10:56:35 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-bf3895e0-498d-4709-9d57-097c3d3308f0 tempest-ProjectReaderTests-1275809092 None] Lock "cinder-ca652844-0341-43c7-ba98-f8a3d2b41233-delete_snapshot" released by "delete_snapshot" :: held 1.527s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:56:36 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-563bf828-b27d-4386-9f4d-8a57afa86ba7 tempest-ProjectReaderTests-1275809092 None] Acquiring lock "cinder-487174ba-843c-48d5-9c4d-9e8acfc62bb6-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:56:36 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-563bf828-b27d-4386-9f4d-8a57afa86ba7 tempest-ProjectReaderTests-1275809092 None] Lock "cinder-487174ba-843c-48d5-9c4d-9e8acfc62bb6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:56:36 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-563bf828-b27d-4386-9f4d-8a57afa86ba7 tempest-ProjectReaderTests-1275809092 None] Acquiring lock "cinder-quobyte-487174ba-843c-48d5-9c4d-9e8acfc62bb6" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:56:36 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-563bf828-b27d-4386-9f4d-8a57afa86ba7 tempest-ProjectReaderTests-1275809092 None] Lock "cinder-quobyte-487174ba-843c-48d5-9c4d-9e8acfc62bb6" acquired by "delete_volume" :: waited 0.014s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:56:36 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[943c9f7c-a384-4e23-89de-39b7c30865db]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:56:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-563bf828-b27d-4386-9f4d-8a57afa86ba7 tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:36 devstack sudo[108909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6 Jul 28 10:56:36 devstack sudo[108909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:36 devstack sudo[108909]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-563bf828-b27d-4386-9f4d-8a57afa86ba7 tempest-ProjectReaderTests-1275809092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6" returned: 0 in 0.343s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:36 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-563bf828-b27d-4386-9f4d-8a57afa86ba7 tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:36 devstack sudo[108914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6 Jul 28 10:56:36 devstack sudo[108914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:37 devstack sudo[108914]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-563bf828-b27d-4386-9f4d-8a57afa86ba7 tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-487174ba-843c-48d5-9c4d-9e8acfc62bb6" returned: 0 in 0.237s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:37 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-563bf828-b27d-4386-9f4d-8a57afa86ba7 tempest-ProjectReaderTests-1275809092 None] Lock "cinder-quobyte-487174ba-843c-48d5-9c4d-9e8acfc62bb6" released by "delete_volume" :: held 0.637s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:56:37 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-563bf828-b27d-4386-9f4d-8a57afa86ba7 tempest-ProjectReaderTests-1275809092 None] Created reservations ['00498228-c2f6-4e9c-af24-26903ceb5c29', '6f986515-5cb3-4df3-a344-38219839ec65', 'd78f16f7-3208-47da-96ac-ad89d6908494', '4428f7a3-078b-4d81-a732-48c30714578e'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:56:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-563bf828-b27d-4386-9f4d-8a57afa86ba7 tempest-ProjectReaderTests-1275809092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:56:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-563bf828-b27d-4386-9f4d-8a57afa86ba7 tempest-ProjectReaderTests-1275809092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:56:37 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-563bf828-b27d-4386-9f4d-8a57afa86ba7 tempest-ProjectReaderTests-1275809092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:56:37 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-563bf828-b27d-4386-9f4d-8a57afa86ba7 tempest-ProjectReaderTests-1275809092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:56:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-563bf828-b27d-4386-9f4d-8a57afa86ba7 tempest-ProjectReaderTests-1275809092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:56:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-563bf828-b27d-4386-9f4d-8a57afa86ba7 tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:37 devstack sudo[108917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:56:37 devstack sudo[108917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:37 devstack sudo[108917]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-563bf828-b27d-4386-9f4d-8a57afa86ba7 tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.236s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:37 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-563bf828-b27d-4386-9f4d-8a57afa86ba7 tempest-ProjectReaderTests-1275809092 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:56:37 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-563bf828-b27d-4386-9f4d-8a57afa86ba7 tempest-ProjectReaderTests-1275809092 None] Deleted volume successfully. Jul 28 10:56:37 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-563bf828-b27d-4386-9f4d-8a57afa86ba7 tempest-ProjectReaderTests-1275809092 None] Lock "cinder-487174ba-843c-48d5-9c4d-9e8acfc62bb6-delete_volume" released by "delete_volume" :: held 1.046s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:56:37 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-3abc787b-4db5-4e97-80fa-d822b9616b9a tempest-ProjectReaderTests-1275809092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:56:37 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3abc787b-4db5-4e97-80fa-d822b9616b9a tempest-ProjectReaderTests-1275809092 None] Flow 'volume_create_manager' (0990cb9d-5124-4506-ac05-955a0614d948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:56:37 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3abc787b-4db5-4e97-80fa-d822b9616b9a tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2d45b1d-1e57-4e25-876a-22c4c82d0477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:37 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3abc787b-4db5-4e97-80fa-d822b9616b9a tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2d45b1d-1e57-4e25-876a-22c4c82d0477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-511568792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af2dd4fe-4a27-4108-b08b-36ea7e26b26c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddabd82ab2a14399812eda79e8b583a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:56:38Z,use_quota=True,user_id='66db51d4d800446f9bba53b671c312e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:37 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3abc787b-4db5-4e97-80fa-d822b9616b9a tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95745ec9-a11f-4d1d-b9c0-43665fdc1360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:37 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3abc787b-4db5-4e97-80fa-d822b9616b9a tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95745ec9-a11f-4d1d-b9c0-43665fdc1360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:37 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3abc787b-4db5-4e97-80fa-d822b9616b9a tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c85e707-3bf2-4fd9-95ef-4f2432481529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:37 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3abc787b-4db5-4e97-80fa-d822b9616b9a tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c85e707-3bf2-4fd9-95ef-4f2432481529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af2dd4fe-4a27-4108-b08b-36ea7e26b26c', 'volume_name': 'volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:37 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3abc787b-4db5-4e97-80fa-d822b9616b9a tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1dc892b-8435-4789-89b6-44c4d102b6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:37 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3abc787b-4db5-4e97-80fa-d822b9616b9a tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1dc892b-8435-4789-89b6-44c4d102b6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:37 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3abc787b-4db5-4e97-80fa-d822b9616b9a tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f49e5ef8-f2f5-4bac-8f36-51d2b042ffda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:37 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-3abc787b-4db5-4e97-80fa-d822b9616b9a tempest-ProjectReaderTests-1275809092 None] Volume af2dd4fe-4a27-4108-b08b-36ea7e26b26c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c', 'volume_size': 1} Jul 28 10:56:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3abc787b-4db5-4e97-80fa-d822b9616b9a tempest-ProjectReaderTests-1275809092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:56:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3abc787b-4db5-4e97-80fa-d822b9616b9a tempest-ProjectReaderTests-1275809092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:56:37 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3abc787b-4db5-4e97-80fa-d822b9616b9a tempest-ProjectReaderTests-1275809092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-511568792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af2dd4fe-4a27-4108-b08b-36ea7e26b26c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddabd82ab2a14399812eda79e8b583a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:56:38Z,use_quota=True,user_id='66db51d4d800446f9bba53b671c312e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:56:37 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-3abc787b-4db5-4e97-80fa-d822b9616b9a tempest-ProjectReaderTests-1275809092 None] Creating volume af2dd4fe-4a27-4108-b08b-36ea7e26b26c {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:56:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3abc787b-4db5-4e97-80fa-d822b9616b9a tempest-ProjectReaderTests-1275809092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:56:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3abc787b-4db5-4e97-80fa-d822b9616b9a tempest-ProjectReaderTests-1275809092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:56:37 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3abc787b-4db5-4e97-80fa-d822b9616b9a tempest-ProjectReaderTests-1275809092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:56:37 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3abc787b-4db5-4e97-80fa-d822b9616b9a tempest-ProjectReaderTests-1275809092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:56:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3abc787b-4db5-4e97-80fa-d822b9616b9a tempest-ProjectReaderTests-1275809092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:56:37 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3abc787b-4db5-4e97-80fa-d822b9616b9a tempest-ProjectReaderTests-1275809092 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:56:37 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-3abc787b-4db5-4e97-80fa-d822b9616b9a tempest-ProjectReaderTests-1275809092 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:56:37 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3abc787b-4db5-4e97-80fa-d822b9616b9a tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:37 devstack sudo[108920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c 1073741824 Jul 28 10:56:37 devstack sudo[108920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:38 devstack sudo[108920]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3abc787b-4db5-4e97-80fa-d822b9616b9a tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c 1073741824" returned: 0 in 0.417s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3abc787b-4db5-4e97-80fa-d822b9616b9a tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:38 devstack sudo[108925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c Jul 28 10:56:38 devstack sudo[108925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:38 devstack sudo[108925]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3abc787b-4db5-4e97-80fa-d822b9616b9a tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c" returned: 0 in 0.248s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:38 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3abc787b-4db5-4e97-80fa-d822b9616b9a tempest-ProjectReaderTests-1275809092 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:56:38 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3abc787b-4db5-4e97-80fa-d822b9616b9a tempest-ProjectReaderTests-1275809092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:56:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3abc787b-4db5-4e97-80fa-d822b9616b9a tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f49e5ef8-f2f5-4bac-8f36-51d2b042ffda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3abc787b-4db5-4e97-80fa-d822b9616b9a tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (295ebb46-eaa7-4d0a-a26f-7171df791b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:38 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-3abc787b-4db5-4e97-80fa-d822b9616b9a tempest-ProjectReaderTests-1275809092 None] Volume volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c (af2dd4fe-4a27-4108-b08b-36ea7e26b26c): created successfully Jul 28 10:56:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3abc787b-4db5-4e97-80fa-d822b9616b9a tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (295ebb46-eaa7-4d0a-a26f-7171df791b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:38 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-3abc787b-4db5-4e97-80fa-d822b9616b9a tempest-ProjectReaderTests-1275809092 None] Flow 'volume_create_manager' (0990cb9d-5124-4506-ac05-955a0614d948) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:56:38 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-3abc787b-4db5-4e97-80fa-d822b9616b9a tempest-ProjectReaderTests-1275809092 None] Created volume successfully. Jul 28 10:56:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c21b7c90-2053-453e-9ed6-2011ec04e1eb tempest-ProjectReaderTests-1275809092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:56:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c21b7c90-2053-453e-9ed6-2011ec04e1eb tempest-ProjectReaderTests-1275809092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:56:39 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-c21b7c90-2053-453e-9ed6-2011ec04e1eb tempest-ProjectReaderTests-1275809092 None] Creating offline snapshot ca7106ff-5f16-492c-b946-dfde40ac84e7 of volume af2dd4fe-4a27-4108-b08b-36ea7e26b26c {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:56:39 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b00f717-7875-409d-bb3c-5ab776931b3e]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:56:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c21b7c90-2053-453e-9ed6-2011ec04e1eb tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:39 devstack sudo[108928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c Jul 28 10:56:39 devstack sudo[108928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:39 devstack sudo[108928]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c21b7c90-2053-453e-9ed6-2011ec04e1eb tempest-ProjectReaderTests-1275809092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c" returned: 0 in 0.357s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c21b7c90-2053-453e-9ed6-2011ec04e1eb tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c.ca7106ff-5f16-492c-b946-dfde40ac84e7 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:39 devstack sudo[108933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c.ca7106ff-5f16-492c-b946-dfde40ac84e7 1G Jul 28 10:56:39 devstack sudo[108933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:39 devstack sudo[108933]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c21b7c90-2053-453e-9ed6-2011ec04e1eb tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c.ca7106ff-5f16-492c-b946-dfde40ac84e7 1G" returned: 0 in 0.403s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:39 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c21b7c90-2053-453e-9ed6-2011ec04e1eb tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c.ca7106ff-5f16-492c-b946-dfde40ac84e7 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:39 devstack sudo[108938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c.ca7106ff-5f16-492c-b946-dfde40ac84e7 Jul 28 10:56:39 devstack sudo[108938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:40 devstack sudo[108938]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c21b7c90-2053-453e-9ed6-2011ec04e1eb tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c.ca7106ff-5f16-492c-b946-dfde40ac84e7" returned: 0 in 0.287s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:40 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-c21b7c90-2053-453e-9ed6-2011ec04e1eb tempest-ProjectReaderTests-1275809092 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c.ca7106ff-5f16-492c-b946-dfde40ac84e7 is being set with open permissions: ugo+rw Jul 28 10:56:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c21b7c90-2053-453e-9ed6-2011ec04e1eb tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c.ca7106ff-5f16-492c-b946-dfde40ac84e7 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:40 devstack sudo[108944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c.ca7106ff-5f16-492c-b946-dfde40ac84e7 Jul 28 10:56:40 devstack sudo[108944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:40 devstack sudo[108944]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c21b7c90-2053-453e-9ed6-2011ec04e1eb tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c.ca7106ff-5f16-492c-b946-dfde40ac84e7" returned: 0 in 0.254s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c21b7c90-2053-453e-9ed6-2011ec04e1eb tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:40 devstack sudo[108947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c.info Jul 28 10:56:40 devstack sudo[108947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:40 devstack sudo[108947]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c21b7c90-2053-453e-9ed6-2011ec04e1eb tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c.info" returned: 0 in 0.255s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:40 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-c21b7c90-2053-453e-9ed6-2011ec04e1eb tempest-ProjectReaderTests-1275809092 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c.info is being set with open permissions: ugo+rw Jul 28 10:56:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c21b7c90-2053-453e-9ed6-2011ec04e1eb tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:40 devstack sudo[108950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c.info Jul 28 10:56:40 devstack sudo[108950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:40 devstack sudo[108950]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c21b7c90-2053-453e-9ed6-2011ec04e1eb tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c.info" returned: 0 in 0.243s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:40 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c21b7c90-2053-453e-9ed6-2011ec04e1eb tempest-ProjectReaderTests-1275809092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.873s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:56:40 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-c21b7c90-2053-453e-9ed6-2011ec04e1eb tempest-ProjectReaderTests-1275809092 None] Create snapshot completed successfully Jul 28 10:56:41 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3575d7f7-4125-4e3d-8bf5-8ee100904638 tempest-ProjectReaderTests-1275809092 None] Acquiring lock "cinder-ca7106ff-5f16-492c-b946-dfde40ac84e7-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:56:41 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3575d7f7-4125-4e3d-8bf5-8ee100904638 tempest-ProjectReaderTests-1275809092 None] Lock "cinder-ca7106ff-5f16-492c-b946-dfde40ac84e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:56:41 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3575d7f7-4125-4e3d-8bf5-8ee100904638 tempest-ProjectReaderTests-1275809092 None] Acquiring lock "cinder-quobyte-af2dd4fe-4a27-4108-b08b-36ea7e26b26c" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:56:41 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3575d7f7-4125-4e3d-8bf5-8ee100904638 tempest-ProjectReaderTests-1275809092 None] Lock "cinder-quobyte-af2dd4fe-4a27-4108-b08b-36ea7e26b26c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:56:41 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3575d7f7-4125-4e3d-8bf5-8ee100904638 tempest-ProjectReaderTests-1275809092 None] Acquiring lock "cinder-quobyte-ca7106ff-5f16-492c-b946-dfde40ac84e7" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:56:41 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3575d7f7-4125-4e3d-8bf5-8ee100904638 tempest-ProjectReaderTests-1275809092 None] Lock "cinder-quobyte-ca7106ff-5f16-492c-b946-dfde40ac84e7" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:56:41 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-3575d7f7-4125-4e3d-8bf5-8ee100904638 tempest-ProjectReaderTests-1275809092 None] Deleting offline snapshot ca7106ff-5f16-492c-b946-dfde40ac84e7 of volume af2dd4fe-4a27-4108-b08b-36ea7e26b26c {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:56:41 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-3575d7f7-4125-4e3d-8bf5-8ee100904638 tempest-ProjectReaderTests-1275809092 None] snapshot_file for this snap is: volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c.ca7106ff-5f16-492c-b946-dfde40ac84e7 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:56:41 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[219d1dd9-2577-4d9d-a020-96a1b29c7d19]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:56:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3575d7f7-4125-4e3d-8bf5-8ee100904638 tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c.ca7106ff-5f16-492c-b946-dfde40ac84e7 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:41 devstack sudo[108953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c.ca7106ff-5f16-492c-b946-dfde40ac84e7 Jul 28 10:56:41 devstack sudo[108953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:41 devstack sudo[108953]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3575d7f7-4125-4e3d-8bf5-8ee100904638 tempest-ProjectReaderTests-1275809092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c.ca7106ff-5f16-492c-b946-dfde40ac84e7" returned: 0 in 0.363s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:41 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-3575d7f7-4125-4e3d-8bf5-8ee100904638 tempest-ProjectReaderTests-1275809092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:56:41 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66ababd-016d-4346-9ae5-7b1d392cbe30]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:56:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3575d7f7-4125-4e3d-8bf5-8ee100904638 tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:41 devstack sudo[108958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c Jul 28 10:56:41 devstack sudo[108958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:41 devstack sudo[108958]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3575d7f7-4125-4e3d-8bf5-8ee100904638 tempest-ProjectReaderTests-1275809092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c" returned: 0 in 0.348s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:41 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3575d7f7-4125-4e3d-8bf5-8ee100904638 tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c.ca7106ff-5f16-492c-b946-dfde40ac84e7 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:41 devstack sudo[108963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c.ca7106ff-5f16-492c-b946-dfde40ac84e7 Jul 28 10:56:41 devstack sudo[108963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:42 devstack sudo[108963]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3575d7f7-4125-4e3d-8bf5-8ee100904638 tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c.ca7106ff-5f16-492c-b946-dfde40ac84e7" returned: 0 in 0.335s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3575d7f7-4125-4e3d-8bf5-8ee100904638 tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c.ca7106ff-5f16-492c-b946-dfde40ac84e7 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:42 devstack sudo[108968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c.ca7106ff-5f16-492c-b946-dfde40ac84e7 Jul 28 10:56:42 devstack sudo[108968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:42 devstack sudo[108968]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:42 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3575d7f7-4125-4e3d-8bf5-8ee100904638 tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c.ca7106ff-5f16-492c-b946-dfde40ac84e7" returned: 0 in 0.250s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:42 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3575d7f7-4125-4e3d-8bf5-8ee100904638 tempest-ProjectReaderTests-1275809092 None] Lock "cinder-quobyte-ca7106ff-5f16-492c-b946-dfde40ac84e7" released by "_delete_snapshot" :: held 1.385s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:56:42 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3575d7f7-4125-4e3d-8bf5-8ee100904638 tempest-ProjectReaderTests-1275809092 None] Lock "cinder-quobyte-af2dd4fe-4a27-4108-b08b-36ea7e26b26c" released by "delete_snapshot" :: held 1.405s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:56:42 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-3575d7f7-4125-4e3d-8bf5-8ee100904638 tempest-ProjectReaderTests-1275809092 None] Created reservations ['d5b3bc17-0cd2-477a-a3ee-d4afd40efd1a', '4b830aae-891c-40d9-8d63-d2295c8255cc', 'd1df2dbe-6225-4deb-9129-88c8c4379b9e', '97d84305-4efc-4133-8015-8d3a1d71698d'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:56:42 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-3575d7f7-4125-4e3d-8bf5-8ee100904638 tempest-ProjectReaderTests-1275809092 None] Delete snapshot completed successfully. Jul 28 10:56:42 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3575d7f7-4125-4e3d-8bf5-8ee100904638 tempest-ProjectReaderTests-1275809092 None] Lock "cinder-ca7106ff-5f16-492c-b946-dfde40ac84e7-delete_snapshot" released by "delete_snapshot" :: held 1.529s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:56:43 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3cb97aca-4b39-4e97-81a9-8a93d9ea1e51 tempest-ProjectReaderTests-1275809092 None] Acquiring lock "cinder-af2dd4fe-4a27-4108-b08b-36ea7e26b26c-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:56:43 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3cb97aca-4b39-4e97-81a9-8a93d9ea1e51 tempest-ProjectReaderTests-1275809092 None] Lock "cinder-af2dd4fe-4a27-4108-b08b-36ea7e26b26c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:56:43 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3cb97aca-4b39-4e97-81a9-8a93d9ea1e51 tempest-ProjectReaderTests-1275809092 None] Acquiring lock "cinder-quobyte-af2dd4fe-4a27-4108-b08b-36ea7e26b26c" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:56:43 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3cb97aca-4b39-4e97-81a9-8a93d9ea1e51 tempest-ProjectReaderTests-1275809092 None] Lock "cinder-quobyte-af2dd4fe-4a27-4108-b08b-36ea7e26b26c" acquired by "delete_volume" :: waited 0.017s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:56:43 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[b781b3e7-257e-4bc3-8f23-9c6f2d0aa46b]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:56:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3cb97aca-4b39-4e97-81a9-8a93d9ea1e51 tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:43 devstack sudo[108971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c Jul 28 10:56:43 devstack sudo[108971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:43 devstack sudo[108971]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3cb97aca-4b39-4e97-81a9-8a93d9ea1e51 tempest-ProjectReaderTests-1275809092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c" returned: 0 in 0.360s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:43 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3cb97aca-4b39-4e97-81a9-8a93d9ea1e51 tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:43 devstack sudo[108976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c Jul 28 10:56:43 devstack sudo[108976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:44 devstack sudo[108976]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3cb97aca-4b39-4e97-81a9-8a93d9ea1e51 tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-af2dd4fe-4a27-4108-b08b-36ea7e26b26c" returned: 0 in 0.244s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:44 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3cb97aca-4b39-4e97-81a9-8a93d9ea1e51 tempest-ProjectReaderTests-1275809092 None] Lock "cinder-quobyte-af2dd4fe-4a27-4108-b08b-36ea7e26b26c" released by "delete_volume" :: held 0.661s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:56:44 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-3cb97aca-4b39-4e97-81a9-8a93d9ea1e51 tempest-ProjectReaderTests-1275809092 None] Created reservations ['8e0059a1-d2e4-42ca-ae8d-a68e26b30757', '69125864-b6f6-4e6b-8186-19fbe5f4d007', '1385a780-97d3-4e56-a246-25756cca62dd', 'a3f161da-66d5-4c9d-9dfe-7bbe98ea0163'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:56:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3cb97aca-4b39-4e97-81a9-8a93d9ea1e51 tempest-ProjectReaderTests-1275809092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:56:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3cb97aca-4b39-4e97-81a9-8a93d9ea1e51 tempest-ProjectReaderTests-1275809092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:56:44 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3cb97aca-4b39-4e97-81a9-8a93d9ea1e51 tempest-ProjectReaderTests-1275809092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:56:44 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-3cb97aca-4b39-4e97-81a9-8a93d9ea1e51 tempest-ProjectReaderTests-1275809092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:56:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-3cb97aca-4b39-4e97-81a9-8a93d9ea1e51 tempest-ProjectReaderTests-1275809092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:56:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3cb97aca-4b39-4e97-81a9-8a93d9ea1e51 tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:44 devstack sudo[108979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:56:44 devstack sudo[108979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:44 devstack sudo[108979]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3cb97aca-4b39-4e97-81a9-8a93d9ea1e51 tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.249s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:44 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-3cb97aca-4b39-4e97-81a9-8a93d9ea1e51 tempest-ProjectReaderTests-1275809092 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:56:44 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-3cb97aca-4b39-4e97-81a9-8a93d9ea1e51 tempest-ProjectReaderTests-1275809092 None] Deleted volume successfully. Jul 28 10:56:44 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3cb97aca-4b39-4e97-81a9-8a93d9ea1e51 tempest-ProjectReaderTests-1275809092 None] Lock "cinder-af2dd4fe-4a27-4108-b08b-36ea7e26b26c-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:56:44 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-374eb782-aea4-40d6-aaaa-3cb5c6c58fff tempest-ProjectReaderTests-1275809092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:56:44 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-374eb782-aea4-40d6-aaaa-3cb5c6c58fff tempest-ProjectReaderTests-1275809092 None] Flow 'volume_create_manager' (bed19371-76ee-4bc2-a5d0-651fb36020bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:56:44 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-374eb782-aea4-40d6-aaaa-3cb5c6c58fff tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c65727bb-1a30-4642-a930-841d63284ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:44 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-374eb782-aea4-40d6-aaaa-3cb5c6c58fff tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c65727bb-1a30-4642-a930-841d63284ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-826835930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7846a66d-02ca-4c1e-a633-f9e8dee6099d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddabd82ab2a14399812eda79e8b583a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:56:45Z,use_quota=True,user_id='66db51d4d800446f9bba53b671c312e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:44 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-374eb782-aea4-40d6-aaaa-3cb5c6c58fff tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8425ed46-739c-4b3c-8595-81f1f8b7c636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:44 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-374eb782-aea4-40d6-aaaa-3cb5c6c58fff tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8425ed46-739c-4b3c-8595-81f1f8b7c636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:44 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-374eb782-aea4-40d6-aaaa-3cb5c6c58fff tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (571324fc-b70e-4f80-b150-6150d78348dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:44 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-374eb782-aea4-40d6-aaaa-3cb5c6c58fff tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (571324fc-b70e-4f80-b150-6150d78348dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7846a66d-02ca-4c1e-a633-f9e8dee6099d', 'volume_name': 'volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:44 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-374eb782-aea4-40d6-aaaa-3cb5c6c58fff tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a831c425-f3a1-458d-a757-93f87c16ba8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:44 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-374eb782-aea4-40d6-aaaa-3cb5c6c58fff tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a831c425-f3a1-458d-a757-93f87c16ba8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:44 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-374eb782-aea4-40d6-aaaa-3cb5c6c58fff tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9404c729-d3e8-49c6-8ce3-1903c027ed4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:44 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-374eb782-aea4-40d6-aaaa-3cb5c6c58fff tempest-ProjectReaderTests-1275809092 None] Volume 7846a66d-02ca-4c1e-a633-f9e8dee6099d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d', 'volume_size': 1} Jul 28 10:56:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-374eb782-aea4-40d6-aaaa-3cb5c6c58fff tempest-ProjectReaderTests-1275809092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:56:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-374eb782-aea4-40d6-aaaa-3cb5c6c58fff tempest-ProjectReaderTests-1275809092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:56:44 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-374eb782-aea4-40d6-aaaa-3cb5c6c58fff tempest-ProjectReaderTests-1275809092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-826835930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7846a66d-02ca-4c1e-a633-f9e8dee6099d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddabd82ab2a14399812eda79e8b583a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:56:45Z,use_quota=True,user_id='66db51d4d800446f9bba53b671c312e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:56:44 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-374eb782-aea4-40d6-aaaa-3cb5c6c58fff tempest-ProjectReaderTests-1275809092 None] Creating volume 7846a66d-02ca-4c1e-a633-f9e8dee6099d {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:56:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-374eb782-aea4-40d6-aaaa-3cb5c6c58fff tempest-ProjectReaderTests-1275809092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:56:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-374eb782-aea4-40d6-aaaa-3cb5c6c58fff tempest-ProjectReaderTests-1275809092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:56:44 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-374eb782-aea4-40d6-aaaa-3cb5c6c58fff tempest-ProjectReaderTests-1275809092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:56:44 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-374eb782-aea4-40d6-aaaa-3cb5c6c58fff tempest-ProjectReaderTests-1275809092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:56:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-374eb782-aea4-40d6-aaaa-3cb5c6c58fff tempest-ProjectReaderTests-1275809092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:56:44 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-374eb782-aea4-40d6-aaaa-3cb5c6c58fff tempest-ProjectReaderTests-1275809092 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:56:44 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-374eb782-aea4-40d6-aaaa-3cb5c6c58fff tempest-ProjectReaderTests-1275809092 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:56:44 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-374eb782-aea4-40d6-aaaa-3cb5c6c58fff tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:44 devstack sudo[108982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d 1073741824 Jul 28 10:56:44 devstack sudo[108982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:45 devstack sudo[108982]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-374eb782-aea4-40d6-aaaa-3cb5c6c58fff tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d 1073741824" returned: 0 in 0.415s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-374eb782-aea4-40d6-aaaa-3cb5c6c58fff tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:45 devstack sudo[108987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d Jul 28 10:56:45 devstack sudo[108987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:45 devstack sudo[108987]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-374eb782-aea4-40d6-aaaa-3cb5c6c58fff tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d" returned: 0 in 0.243s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:45 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-374eb782-aea4-40d6-aaaa-3cb5c6c58fff tempest-ProjectReaderTests-1275809092 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:56:45 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-374eb782-aea4-40d6-aaaa-3cb5c6c58fff tempest-ProjectReaderTests-1275809092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:56:45 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-374eb782-aea4-40d6-aaaa-3cb5c6c58fff tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9404c729-d3e8-49c6-8ce3-1903c027ed4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:45 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-374eb782-aea4-40d6-aaaa-3cb5c6c58fff tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaac94da-9526-4f65-88f4-c247285e8d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:45 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-374eb782-aea4-40d6-aaaa-3cb5c6c58fff tempest-ProjectReaderTests-1275809092 None] Volume volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d (7846a66d-02ca-4c1e-a633-f9e8dee6099d): created successfully Jul 28 10:56:45 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-374eb782-aea4-40d6-aaaa-3cb5c6c58fff tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaac94da-9526-4f65-88f4-c247285e8d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:45 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-374eb782-aea4-40d6-aaaa-3cb5c6c58fff tempest-ProjectReaderTests-1275809092 None] Flow 'volume_create_manager' (bed19371-76ee-4bc2-a5d0-651fb36020bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:56:45 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-374eb782-aea4-40d6-aaaa-3cb5c6c58fff tempest-ProjectReaderTests-1275809092 None] Created volume successfully. Jul 28 10:56:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-738d0388-e9a0-405e-8212-3d5b7c360e1d tempest-ProjectReaderTests-1275809092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:56:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-738d0388-e9a0-405e-8212-3d5b7c360e1d tempest-ProjectReaderTests-1275809092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:56:46 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-738d0388-e9a0-405e-8212-3d5b7c360e1d tempest-ProjectReaderTests-1275809092 None] Creating offline snapshot 06957f4c-c2f7-4d12-ba0c-b4cb1ef2872b of volume 7846a66d-02ca-4c1e-a633-f9e8dee6099d {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:56:46 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba579440-d480-48c0-954e-d9e8b37c6adb]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:56:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-738d0388-e9a0-405e-8212-3d5b7c360e1d tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:46 devstack sudo[108990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d Jul 28 10:56:46 devstack sudo[108990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:46 devstack sudo[108990]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-738d0388-e9a0-405e-8212-3d5b7c360e1d tempest-ProjectReaderTests-1275809092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d" returned: 0 in 0.365s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-738d0388-e9a0-405e-8212-3d5b7c360e1d tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d.06957f4c-c2f7-4d12-ba0c-b4cb1ef2872b 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:46 devstack sudo[108995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d.06957f4c-c2f7-4d12-ba0c-b4cb1ef2872b 1G Jul 28 10:56:46 devstack sudo[108995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:46 devstack sudo[108995]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-738d0388-e9a0-405e-8212-3d5b7c360e1d tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d.06957f4c-c2f7-4d12-ba0c-b4cb1ef2872b 1G" returned: 0 in 0.392s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:46 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-738d0388-e9a0-405e-8212-3d5b7c360e1d tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d.06957f4c-c2f7-4d12-ba0c-b4cb1ef2872b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:46 devstack sudo[109000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d.06957f4c-c2f7-4d12-ba0c-b4cb1ef2872b Jul 28 10:56:46 devstack sudo[109000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:47 devstack sudo[109000]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-738d0388-e9a0-405e-8212-3d5b7c360e1d tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d.06957f4c-c2f7-4d12-ba0c-b4cb1ef2872b" returned: 0 in 0.285s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:47 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-738d0388-e9a0-405e-8212-3d5b7c360e1d tempest-ProjectReaderTests-1275809092 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d.06957f4c-c2f7-4d12-ba0c-b4cb1ef2872b is being set with open permissions: ugo+rw Jul 28 10:56:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-738d0388-e9a0-405e-8212-3d5b7c360e1d tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d.06957f4c-c2f7-4d12-ba0c-b4cb1ef2872b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:47 devstack sudo[109005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d.06957f4c-c2f7-4d12-ba0c-b4cb1ef2872b Jul 28 10:56:47 devstack sudo[109005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:47 devstack sudo[109005]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-738d0388-e9a0-405e-8212-3d5b7c360e1d tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d.06957f4c-c2f7-4d12-ba0c-b4cb1ef2872b" returned: 0 in 0.238s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-738d0388-e9a0-405e-8212-3d5b7c360e1d tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:47 devstack sudo[109008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d.info Jul 28 10:56:47 devstack sudo[109008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:47 devstack sudo[109008]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-738d0388-e9a0-405e-8212-3d5b7c360e1d tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d.info" returned: 0 in 0.262s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:47 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-738d0388-e9a0-405e-8212-3d5b7c360e1d tempest-ProjectReaderTests-1275809092 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d.info is being set with open permissions: ugo+rw Jul 28 10:56:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-738d0388-e9a0-405e-8212-3d5b7c360e1d tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:47 devstack sudo[109011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d.info Jul 28 10:56:47 devstack sudo[109011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:47 devstack sudo[109011]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-738d0388-e9a0-405e-8212-3d5b7c360e1d tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d.info" returned: 0 in 0.238s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:47 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-738d0388-e9a0-405e-8212-3d5b7c360e1d tempest-ProjectReaderTests-1275809092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.858s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:56:47 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-738d0388-e9a0-405e-8212-3d5b7c360e1d tempest-ProjectReaderTests-1275809092 None] Create snapshot completed successfully Jul 28 10:56:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-5d878a0a-c998-4ff8-b521-1baac9508c6e tempest-ProjectReaderTests-1275809092 None] Acquiring lock "cinder-06957f4c-c2f7-4d12-ba0c-b4cb1ef2872b-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:56:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-5d878a0a-c998-4ff8-b521-1baac9508c6e tempest-ProjectReaderTests-1275809092 None] Lock "cinder-06957f4c-c2f7-4d12-ba0c-b4cb1ef2872b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:56:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-5d878a0a-c998-4ff8-b521-1baac9508c6e tempest-ProjectReaderTests-1275809092 None] Acquiring lock "cinder-quobyte-7846a66d-02ca-4c1e-a633-f9e8dee6099d" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:56:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-5d878a0a-c998-4ff8-b521-1baac9508c6e tempest-ProjectReaderTests-1275809092 None] Lock "cinder-quobyte-7846a66d-02ca-4c1e-a633-f9e8dee6099d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:56:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-5d878a0a-c998-4ff8-b521-1baac9508c6e tempest-ProjectReaderTests-1275809092 None] Acquiring lock "cinder-quobyte-06957f4c-c2f7-4d12-ba0c-b4cb1ef2872b" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:56:48 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-5d878a0a-c998-4ff8-b521-1baac9508c6e tempest-ProjectReaderTests-1275809092 None] Lock "cinder-quobyte-06957f4c-c2f7-4d12-ba0c-b4cb1ef2872b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:56:48 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-5d878a0a-c998-4ff8-b521-1baac9508c6e tempest-ProjectReaderTests-1275809092 None] Deleting offline snapshot 06957f4c-c2f7-4d12-ba0c-b4cb1ef2872b of volume 7846a66d-02ca-4c1e-a633-f9e8dee6099d {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:56:48 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-5d878a0a-c998-4ff8-b521-1baac9508c6e tempest-ProjectReaderTests-1275809092 None] snapshot_file for this snap is: volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d.06957f4c-c2f7-4d12-ba0c-b4cb1ef2872b {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:56:48 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[de60ddf1-0c37-4a4e-905c-44556cdfa053]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:56:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5d878a0a-c998-4ff8-b521-1baac9508c6e tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d.06957f4c-c2f7-4d12-ba0c-b4cb1ef2872b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:48 devstack sudo[109014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d.06957f4c-c2f7-4d12-ba0c-b4cb1ef2872b Jul 28 10:56:48 devstack sudo[109014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:48 devstack sudo[109014]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5d878a0a-c998-4ff8-b521-1baac9508c6e tempest-ProjectReaderTests-1275809092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d.06957f4c-c2f7-4d12-ba0c-b4cb1ef2872b" returned: 0 in 0.346s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:48 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-5d878a0a-c998-4ff8-b521-1baac9508c6e tempest-ProjectReaderTests-1275809092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:56:48 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab1e8e7-7cea-44d6-b795-82feec77f8c5]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:56:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5d878a0a-c998-4ff8-b521-1baac9508c6e tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:48 devstack sudo[109019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d Jul 28 10:56:48 devstack sudo[109019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:48 devstack sudo[109019]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5d878a0a-c998-4ff8-b521-1baac9508c6e tempest-ProjectReaderTests-1275809092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d" returned: 0 in 0.356s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:48 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5d878a0a-c998-4ff8-b521-1baac9508c6e tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d.06957f4c-c2f7-4d12-ba0c-b4cb1ef2872b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:48 devstack sudo[109024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d.06957f4c-c2f7-4d12-ba0c-b4cb1ef2872b Jul 28 10:56:48 devstack sudo[109024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:49 devstack sudo[109024]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5d878a0a-c998-4ff8-b521-1baac9508c6e tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d.06957f4c-c2f7-4d12-ba0c-b4cb1ef2872b" returned: 0 in 0.342s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5d878a0a-c998-4ff8-b521-1baac9508c6e tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d.06957f4c-c2f7-4d12-ba0c-b4cb1ef2872b {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:49 devstack sudo[109029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d.06957f4c-c2f7-4d12-ba0c-b4cb1ef2872b Jul 28 10:56:49 devstack sudo[109029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:49 devstack sudo[109029]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:49 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-5d878a0a-c998-4ff8-b521-1baac9508c6e tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d.06957f4c-c2f7-4d12-ba0c-b4cb1ef2872b" returned: 0 in 0.241s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:49 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-5d878a0a-c998-4ff8-b521-1baac9508c6e tempest-ProjectReaderTests-1275809092 None] Lock "cinder-quobyte-06957f4c-c2f7-4d12-ba0c-b4cb1ef2872b" released by "_delete_snapshot" :: held 1.375s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:56:49 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-5d878a0a-c998-4ff8-b521-1baac9508c6e tempest-ProjectReaderTests-1275809092 None] Lock "cinder-quobyte-7846a66d-02ca-4c1e-a633-f9e8dee6099d" released by "delete_snapshot" :: held 1.396s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:56:49 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-5d878a0a-c998-4ff8-b521-1baac9508c6e tempest-ProjectReaderTests-1275809092 None] Created reservations ['7ef08818-93a7-49f5-9924-c09f3771522e', 'c4460925-d3f5-4ac8-a45b-959438a69065', '0b16164f-af78-47be-95a0-084848c08eb1', 'f9847a6c-edea-469a-8e82-6e2fa5781e06'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:56:49 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-5d878a0a-c998-4ff8-b521-1baac9508c6e tempest-ProjectReaderTests-1275809092 None] Delete snapshot completed successfully. Jul 28 10:56:49 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-5d878a0a-c998-4ff8-b521-1baac9508c6e tempest-ProjectReaderTests-1275809092 None] Lock "cinder-06957f4c-c2f7-4d12-ba0c-b4cb1ef2872b-delete_snapshot" released by "delete_snapshot" :: held 1.533s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:56:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-49ecccb8-d7ba-424d-b789-fd0d6ec7409d tempest-ProjectReaderTests-1275809092 None] Acquiring lock "cinder-7846a66d-02ca-4c1e-a633-f9e8dee6099d-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:56:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-49ecccb8-d7ba-424d-b789-fd0d6ec7409d tempest-ProjectReaderTests-1275809092 None] Lock "cinder-7846a66d-02ca-4c1e-a633-f9e8dee6099d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:56:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-49ecccb8-d7ba-424d-b789-fd0d6ec7409d tempest-ProjectReaderTests-1275809092 None] Acquiring lock "cinder-quobyte-7846a66d-02ca-4c1e-a633-f9e8dee6099d" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:56:50 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-49ecccb8-d7ba-424d-b789-fd0d6ec7409d tempest-ProjectReaderTests-1275809092 None] Lock "cinder-quobyte-7846a66d-02ca-4c1e-a633-f9e8dee6099d" acquired by "delete_volume" :: waited 0.017s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:56:50 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cb5578-17b3-4e31-9f4c-51ba902a4eb8]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:56:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-49ecccb8-d7ba-424d-b789-fd0d6ec7409d tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:50 devstack sudo[109033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d Jul 28 10:56:50 devstack sudo[109033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:50 devstack sudo[109033]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-49ecccb8-d7ba-424d-b789-fd0d6ec7409d tempest-ProjectReaderTests-1275809092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d" returned: 0 in 0.351s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:50 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-49ecccb8-d7ba-424d-b789-fd0d6ec7409d tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:50 devstack sudo[109038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d Jul 28 10:56:50 devstack sudo[109038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:51 devstack sudo[109038]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-49ecccb8-d7ba-424d-b789-fd0d6ec7409d tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-7846a66d-02ca-4c1e-a633-f9e8dee6099d" returned: 0 in 0.249s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-49ecccb8-d7ba-424d-b789-fd0d6ec7409d tempest-ProjectReaderTests-1275809092 None] Lock "cinder-quobyte-7846a66d-02ca-4c1e-a633-f9e8dee6099d" released by "delete_volume" :: held 0.656s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:56:51 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-49ecccb8-d7ba-424d-b789-fd0d6ec7409d tempest-ProjectReaderTests-1275809092 None] Created reservations ['f65fcc4f-e479-4777-a738-52570a787da2', '36ffacd7-d5bf-4f12-b56c-dd44a8444500', 'f1808ea7-7898-4c11-9c25-164433c01dec', 'd9ec6959-84c2-4b00-966f-dc8dd5af8948'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:56:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-49ecccb8-d7ba-424d-b789-fd0d6ec7409d tempest-ProjectReaderTests-1275809092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:56:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-49ecccb8-d7ba-424d-b789-fd0d6ec7409d tempest-ProjectReaderTests-1275809092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:56:51 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-49ecccb8-d7ba-424d-b789-fd0d6ec7409d tempest-ProjectReaderTests-1275809092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:56:51 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-49ecccb8-d7ba-424d-b789-fd0d6ec7409d tempest-ProjectReaderTests-1275809092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:56:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-49ecccb8-d7ba-424d-b789-fd0d6ec7409d tempest-ProjectReaderTests-1275809092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:56:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-49ecccb8-d7ba-424d-b789-fd0d6ec7409d tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:51 devstack sudo[109041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:56:51 devstack sudo[109041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:51 devstack sudo[109041]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-49ecccb8-d7ba-424d-b789-fd0d6ec7409d tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.263s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:51 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-49ecccb8-d7ba-424d-b789-fd0d6ec7409d tempest-ProjectReaderTests-1275809092 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:56:51 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-49ecccb8-d7ba-424d-b789-fd0d6ec7409d tempest-ProjectReaderTests-1275809092 None] Deleted volume successfully. Jul 28 10:56:51 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-49ecccb8-d7ba-424d-b789-fd0d6ec7409d tempest-ProjectReaderTests-1275809092 None] Lock "cinder-7846a66d-02ca-4c1e-a633-f9e8dee6099d-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:56:51 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-0febb334-dcb8-486f-b1c4-c8b0766c6837 tempest-ProjectReaderTests-1275809092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:56:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0febb334-dcb8-486f-b1c4-c8b0766c6837 tempest-ProjectReaderTests-1275809092 None] Flow 'volume_create_manager' (24ed3e90-d3ea-4513-b59a-d4504c6813ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:56:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0febb334-dcb8-486f-b1c4-c8b0766c6837 tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5b259a2-089a-47ab-b9f0-ef8faa8f4bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0febb334-dcb8-486f-b1c4-c8b0766c6837 tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5b259a2-089a-47ab-b9f0-ef8faa8f4bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:56:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1555806871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f931eb01-b225-48af-8628-f10a23bc6623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddabd82ab2a14399812eda79e8b583a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:56:52Z,use_quota=True,user_id='66db51d4d800446f9bba53b671c312e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0febb334-dcb8-486f-b1c4-c8b0766c6837 tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (775f1de7-1f5b-44d9-94be-f2462e4a14b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0febb334-dcb8-486f-b1c4-c8b0766c6837 tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (775f1de7-1f5b-44d9-94be-f2462e4a14b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0febb334-dcb8-486f-b1c4-c8b0766c6837 tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f441233-6918-4a71-a8cf-58ffe0909645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0febb334-dcb8-486f-b1c4-c8b0766c6837 tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f441233-6918-4a71-a8cf-58ffe0909645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f931eb01-b225-48af-8628-f10a23bc6623', 'volume_name': 'volume-f931eb01-b225-48af-8628-f10a23bc6623', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0febb334-dcb8-486f-b1c4-c8b0766c6837 tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeffddfa-caa8-4ce7-95dd-5b8feeb0ec22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0febb334-dcb8-486f-b1c4-c8b0766c6837 tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeffddfa-caa8-4ce7-95dd-5b8feeb0ec22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:51 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0febb334-dcb8-486f-b1c4-c8b0766c6837 tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66025561-76d6-4f02-a478-753065876b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:51 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-0febb334-dcb8-486f-b1c4-c8b0766c6837 tempest-ProjectReaderTests-1275809092 None] Volume f931eb01-b225-48af-8628-f10a23bc6623: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f931eb01-b225-48af-8628-f10a23bc6623', 'volume_size': 1} Jul 28 10:56:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0febb334-dcb8-486f-b1c4-c8b0766c6837 tempest-ProjectReaderTests-1275809092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:56:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0febb334-dcb8-486f-b1c4-c8b0766c6837 tempest-ProjectReaderTests-1275809092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:56:51 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0febb334-dcb8-486f-b1c4-c8b0766c6837 tempest-ProjectReaderTests-1275809092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:56:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1555806871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f931eb01-b225-48af-8628-f10a23bc6623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddabd82ab2a14399812eda79e8b583a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:56:52Z,use_quota=True,user_id='66db51d4d800446f9bba53b671c312e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:56:51 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-0febb334-dcb8-486f-b1c4-c8b0766c6837 tempest-ProjectReaderTests-1275809092 None] Creating volume f931eb01-b225-48af-8628-f10a23bc6623 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:56:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0febb334-dcb8-486f-b1c4-c8b0766c6837 tempest-ProjectReaderTests-1275809092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:56:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0febb334-dcb8-486f-b1c4-c8b0766c6837 tempest-ProjectReaderTests-1275809092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:56:51 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0febb334-dcb8-486f-b1c4-c8b0766c6837 tempest-ProjectReaderTests-1275809092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:56:51 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0febb334-dcb8-486f-b1c4-c8b0766c6837 tempest-ProjectReaderTests-1275809092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:56:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0febb334-dcb8-486f-b1c4-c8b0766c6837 tempest-ProjectReaderTests-1275809092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:56:51 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0febb334-dcb8-486f-b1c4-c8b0766c6837 tempest-ProjectReaderTests-1275809092 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:56:51 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-0febb334-dcb8-486f-b1c4-c8b0766c6837 tempest-ProjectReaderTests-1275809092 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:56:51 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0febb334-dcb8-486f-b1c4-c8b0766c6837 tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:52 devstack sudo[109044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623 1073741824 Jul 28 10:56:52 devstack sudo[109044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:52 devstack sudo[109044]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0febb334-dcb8-486f-b1c4-c8b0766c6837 tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623 1073741824" returned: 0 in 0.419s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0febb334-dcb8-486f-b1c4-c8b0766c6837 tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:52 devstack sudo[109050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623 Jul 28 10:56:52 devstack sudo[109050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:52 devstack sudo[109050]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-0febb334-dcb8-486f-b1c4-c8b0766c6837 tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623" returned: 0 in 0.261s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:52 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-0febb334-dcb8-486f-b1c4-c8b0766c6837 tempest-ProjectReaderTests-1275809092 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:56:52 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-0febb334-dcb8-486f-b1c4-c8b0766c6837 tempest-ProjectReaderTests-1275809092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:56:52 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0febb334-dcb8-486f-b1c4-c8b0766c6837 tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66025561-76d6-4f02-a478-753065876b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f931eb01-b225-48af-8628-f10a23bc6623', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:52 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0febb334-dcb8-486f-b1c4-c8b0766c6837 tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32d6d011-3925-496e-88fb-f0a75915cc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:52 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-0febb334-dcb8-486f-b1c4-c8b0766c6837 tempest-ProjectReaderTests-1275809092 None] Volume volume-f931eb01-b225-48af-8628-f10a23bc6623 (f931eb01-b225-48af-8628-f10a23bc6623): created successfully Jul 28 10:56:52 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0febb334-dcb8-486f-b1c4-c8b0766c6837 tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32d6d011-3925-496e-88fb-f0a75915cc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:52 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-0febb334-dcb8-486f-b1c4-c8b0766c6837 tempest-ProjectReaderTests-1275809092 None] Flow 'volume_create_manager' (24ed3e90-d3ea-4513-b59a-d4504c6813ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:56:52 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-0febb334-dcb8-486f-b1c4-c8b0766c6837 tempest-ProjectReaderTests-1275809092 None] Created volume successfully. Jul 28 10:56:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fbcc7ba0-e0fa-48f1-907b-48c823373a9a tempest-ProjectReaderTests-1275809092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:56:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fbcc7ba0-e0fa-48f1-907b-48c823373a9a tempest-ProjectReaderTests-1275809092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:56:53 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-fbcc7ba0-e0fa-48f1-907b-48c823373a9a tempest-ProjectReaderTests-1275809092 None] Creating offline snapshot 27b03796-fa2e-412e-a3be-41b3ef0aedea of volume f931eb01-b225-48af-8628-f10a23bc6623 {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:56:53 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda1645e-057d-4d28-81ab-931095bf950b]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:56:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fbcc7ba0-e0fa-48f1-907b-48c823373a9a tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:53 devstack sudo[109053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623 Jul 28 10:56:53 devstack sudo[109053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:53 devstack sudo[109053]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fbcc7ba0-e0fa-48f1-907b-48c823373a9a tempest-ProjectReaderTests-1275809092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623" returned: 0 in 0.348s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fbcc7ba0-e0fa-48f1-907b-48c823373a9a tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623.27b03796-fa2e-412e-a3be-41b3ef0aedea 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:53 devstack sudo[109058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623.27b03796-fa2e-412e-a3be-41b3ef0aedea 1G Jul 28 10:56:53 devstack sudo[109058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:53 devstack sudo[109058]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fbcc7ba0-e0fa-48f1-907b-48c823373a9a tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623.27b03796-fa2e-412e-a3be-41b3ef0aedea 1G" returned: 0 in 0.410s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:53 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fbcc7ba0-e0fa-48f1-907b-48c823373a9a tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f931eb01-b225-48af-8628-f10a23bc6623 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623.27b03796-fa2e-412e-a3be-41b3ef0aedea {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:53 devstack sudo[109063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f931eb01-b225-48af-8628-f10a23bc6623 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623.27b03796-fa2e-412e-a3be-41b3ef0aedea Jul 28 10:56:53 devstack sudo[109063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:54 devstack sudo[109063]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fbcc7ba0-e0fa-48f1-907b-48c823373a9a tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f931eb01-b225-48af-8628-f10a23bc6623 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623.27b03796-fa2e-412e-a3be-41b3ef0aedea" returned: 0 in 0.282s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:54 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-fbcc7ba0-e0fa-48f1-907b-48c823373a9a tempest-ProjectReaderTests-1275809092 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623.27b03796-fa2e-412e-a3be-41b3ef0aedea is being set with open permissions: ugo+rw Jul 28 10:56:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fbcc7ba0-e0fa-48f1-907b-48c823373a9a tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623.27b03796-fa2e-412e-a3be-41b3ef0aedea {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:54 devstack sudo[109068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623.27b03796-fa2e-412e-a3be-41b3ef0aedea Jul 28 10:56:54 devstack sudo[109068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:54 devstack sudo[109068]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fbcc7ba0-e0fa-48f1-907b-48c823373a9a tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623.27b03796-fa2e-412e-a3be-41b3ef0aedea" returned: 0 in 0.240s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fbcc7ba0-e0fa-48f1-907b-48c823373a9a tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:54 devstack sudo[109071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623.info Jul 28 10:56:54 devstack sudo[109071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:54 devstack sudo[109071]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fbcc7ba0-e0fa-48f1-907b-48c823373a9a tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623.info" returned: 0 in 0.246s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:54 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-fbcc7ba0-e0fa-48f1-907b-48c823373a9a tempest-ProjectReaderTests-1275809092 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623.info is being set with open permissions: ugo+rw Jul 28 10:56:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fbcc7ba0-e0fa-48f1-907b-48c823373a9a tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:54 devstack sudo[109074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623.info Jul 28 10:56:54 devstack sudo[109074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:54 devstack sudo[109074]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-fbcc7ba0-e0fa-48f1-907b-48c823373a9a tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623.info" returned: 0 in 0.240s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:54 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-fbcc7ba0-e0fa-48f1-907b-48c823373a9a tempest-ProjectReaderTests-1275809092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.844s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:56:54 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-fbcc7ba0-e0fa-48f1-907b-48c823373a9a tempest-ProjectReaderTests-1275809092 None] Create snapshot completed successfully Jul 28 10:56:55 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e27c8471-d016-4cab-960a-cce5ab70d685 tempest-ProjectReaderTests-1275809092 None] Acquiring lock "cinder-27b03796-fa2e-412e-a3be-41b3ef0aedea-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:56:55 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e27c8471-d016-4cab-960a-cce5ab70d685 tempest-ProjectReaderTests-1275809092 None] Lock "cinder-27b03796-fa2e-412e-a3be-41b3ef0aedea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:56:55 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e27c8471-d016-4cab-960a-cce5ab70d685 tempest-ProjectReaderTests-1275809092 None] Acquiring lock "cinder-quobyte-f931eb01-b225-48af-8628-f10a23bc6623" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:56:55 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e27c8471-d016-4cab-960a-cce5ab70d685 tempest-ProjectReaderTests-1275809092 None] Lock "cinder-quobyte-f931eb01-b225-48af-8628-f10a23bc6623" acquired by "delete_snapshot" :: waited 0.013s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:56:55 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e27c8471-d016-4cab-960a-cce5ab70d685 tempest-ProjectReaderTests-1275809092 None] Acquiring lock "cinder-quobyte-27b03796-fa2e-412e-a3be-41b3ef0aedea" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:56:55 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e27c8471-d016-4cab-960a-cce5ab70d685 tempest-ProjectReaderTests-1275809092 None] Lock "cinder-quobyte-27b03796-fa2e-412e-a3be-41b3ef0aedea" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:56:55 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-e27c8471-d016-4cab-960a-cce5ab70d685 tempest-ProjectReaderTests-1275809092 None] Deleting offline snapshot 27b03796-fa2e-412e-a3be-41b3ef0aedea of volume f931eb01-b225-48af-8628-f10a23bc6623 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:56:55 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-e27c8471-d016-4cab-960a-cce5ab70d685 tempest-ProjectReaderTests-1275809092 None] snapshot_file for this snap is: volume-f931eb01-b225-48af-8628-f10a23bc6623.27b03796-fa2e-412e-a3be-41b3ef0aedea {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:56:55 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[509982af-5161-4be3-813c-5b90c9a0322e]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:56:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e27c8471-d016-4cab-960a-cce5ab70d685 tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623.27b03796-fa2e-412e-a3be-41b3ef0aedea {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:55 devstack sudo[109077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623.27b03796-fa2e-412e-a3be-41b3ef0aedea Jul 28 10:56:55 devstack sudo[109077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:55 devstack sudo[109077]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e27c8471-d016-4cab-960a-cce5ab70d685 tempest-ProjectReaderTests-1275809092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623.27b03796-fa2e-412e-a3be-41b3ef0aedea" returned: 0 in 0.354s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:55 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-e27c8471-d016-4cab-960a-cce5ab70d685 tempest-ProjectReaderTests-1275809092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f931eb01-b225-48af-8628-f10a23bc6623(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:56:55 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5159f86-9640-4e70-9e92-77b0e4255cd7]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:56:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e27c8471-d016-4cab-960a-cce5ab70d685 tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:55 devstack sudo[109082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623 Jul 28 10:56:55 devstack sudo[109082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:55 devstack sudo[109082]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e27c8471-d016-4cab-960a-cce5ab70d685 tempest-ProjectReaderTests-1275809092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623" returned: 0 in 0.345s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:55 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e27c8471-d016-4cab-960a-cce5ab70d685 tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623.27b03796-fa2e-412e-a3be-41b3ef0aedea {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:55 devstack sudo[109087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623.27b03796-fa2e-412e-a3be-41b3ef0aedea Jul 28 10:56:55 devstack sudo[109087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:56 devstack sudo[109087]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e27c8471-d016-4cab-960a-cce5ab70d685 tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623.27b03796-fa2e-412e-a3be-41b3ef0aedea" returned: 0 in 0.326s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e27c8471-d016-4cab-960a-cce5ab70d685 tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623.27b03796-fa2e-412e-a3be-41b3ef0aedea {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:56 devstack sudo[109092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623.27b03796-fa2e-412e-a3be-41b3ef0aedea Jul 28 10:56:56 devstack sudo[109092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:56 devstack sudo[109092]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:56 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-e27c8471-d016-4cab-960a-cce5ab70d685 tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623.27b03796-fa2e-412e-a3be-41b3ef0aedea" returned: 0 in 0.252s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:56 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e27c8471-d016-4cab-960a-cce5ab70d685 tempest-ProjectReaderTests-1275809092 None] Lock "cinder-quobyte-27b03796-fa2e-412e-a3be-41b3ef0aedea" released by "_delete_snapshot" :: held 1.368s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:56:56 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e27c8471-d016-4cab-960a-cce5ab70d685 tempest-ProjectReaderTests-1275809092 None] Lock "cinder-quobyte-f931eb01-b225-48af-8628-f10a23bc6623" released by "delete_snapshot" :: held 1.391s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:56:56 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-e27c8471-d016-4cab-960a-cce5ab70d685 tempest-ProjectReaderTests-1275809092 None] Created reservations ['a3489eb0-067c-446f-8aa6-498a6e010eca', 'c4ba79a6-ee02-47f7-b766-afa3a88a846b', 'c343475f-366e-406d-ae6d-f0f42916b817', 'b0132610-76ec-48bc-814d-dcca6d53f72a'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:56:56 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-e27c8471-d016-4cab-960a-cce5ab70d685 tempest-ProjectReaderTests-1275809092 None] Delete snapshot completed successfully. Jul 28 10:56:56 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-e27c8471-d016-4cab-960a-cce5ab70d685 tempest-ProjectReaderTests-1275809092 None] Lock "cinder-27b03796-fa2e-412e-a3be-41b3ef0aedea-delete_snapshot" released by "delete_snapshot" :: held 1.518s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:56:57 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ae0ae8e9-b316-4b54-8fb4-e8fbef1cd39d tempest-ProjectReaderTests-1275809092 None] Acquiring lock "cinder-f931eb01-b225-48af-8628-f10a23bc6623-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:56:57 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ae0ae8e9-b316-4b54-8fb4-e8fbef1cd39d tempest-ProjectReaderTests-1275809092 None] Lock "cinder-f931eb01-b225-48af-8628-f10a23bc6623-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:56:57 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ae0ae8e9-b316-4b54-8fb4-e8fbef1cd39d tempest-ProjectReaderTests-1275809092 None] Acquiring lock "cinder-quobyte-f931eb01-b225-48af-8628-f10a23bc6623" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:56:57 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ae0ae8e9-b316-4b54-8fb4-e8fbef1cd39d tempest-ProjectReaderTests-1275809092 None] Lock "cinder-quobyte-f931eb01-b225-48af-8628-f10a23bc6623" acquired by "delete_volume" :: waited 0.017s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:56:57 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6b7099-2f0e-4888-8942-0057e5fb74d3]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:56:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ae0ae8e9-b316-4b54-8fb4-e8fbef1cd39d tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:57 devstack sudo[109095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623 Jul 28 10:56:57 devstack sudo[109095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:57 devstack sudo[109095]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ae0ae8e9-b316-4b54-8fb4-e8fbef1cd39d tempest-ProjectReaderTests-1275809092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623" returned: 0 in 0.342s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:57 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ae0ae8e9-b316-4b54-8fb4-e8fbef1cd39d tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:57 devstack sudo[109100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623 Jul 28 10:56:57 devstack sudo[109100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:57 devstack sudo[109100]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ae0ae8e9-b316-4b54-8fb4-e8fbef1cd39d tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-f931eb01-b225-48af-8628-f10a23bc6623" returned: 0 in 0.238s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:58 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ae0ae8e9-b316-4b54-8fb4-e8fbef1cd39d tempest-ProjectReaderTests-1275809092 None] Lock "cinder-quobyte-f931eb01-b225-48af-8628-f10a23bc6623" released by "delete_volume" :: held 0.637s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:56:58 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-ae0ae8e9-b316-4b54-8fb4-e8fbef1cd39d tempest-ProjectReaderTests-1275809092 None] Created reservations ['af17907b-73b2-45ba-8f1e-91ec5b63d9ae', '4104a0fb-31db-4ae7-8dc7-929c9c687678', 'ceaf377a-818c-4291-8091-0d7a4fcf5d93', 'a62821c4-9b05-4a9b-af13-7b591c3ee94b'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:56:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ae0ae8e9-b316-4b54-8fb4-e8fbef1cd39d tempest-ProjectReaderTests-1275809092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:56:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ae0ae8e9-b316-4b54-8fb4-e8fbef1cd39d tempest-ProjectReaderTests-1275809092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:56:58 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-ae0ae8e9-b316-4b54-8fb4-e8fbef1cd39d tempest-ProjectReaderTests-1275809092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:56:58 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-ae0ae8e9-b316-4b54-8fb4-e8fbef1cd39d tempest-ProjectReaderTests-1275809092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:56:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ae0ae8e9-b316-4b54-8fb4-e8fbef1cd39d tempest-ProjectReaderTests-1275809092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:56:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ae0ae8e9-b316-4b54-8fb4-e8fbef1cd39d tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:58 devstack sudo[109104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:56:58 devstack sudo[109104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:58 devstack sudo[109104]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ae0ae8e9-b316-4b54-8fb4-e8fbef1cd39d tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.240s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:58 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-ae0ae8e9-b316-4b54-8fb4-e8fbef1cd39d tempest-ProjectReaderTests-1275809092 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:56:58 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-ae0ae8e9-b316-4b54-8fb4-e8fbef1cd39d tempest-ProjectReaderTests-1275809092 None] Deleted volume successfully. Jul 28 10:56:58 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ae0ae8e9-b316-4b54-8fb4-e8fbef1cd39d tempest-ProjectReaderTests-1275809092 None] Lock "cinder-f931eb01-b225-48af-8628-f10a23bc6623-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:56:58 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cac75e2-ca2a-46a2-a101-a1f5eae25c32 tempest-ProjectReaderTests-1275809092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:56:58 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1cac75e2-ca2a-46a2-a101-a1f5eae25c32 tempest-ProjectReaderTests-1275809092 None] Flow 'volume_create_manager' (55a81dd3-cd76-4e0d-ae18-eafc6827baba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:56:58 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1cac75e2-ca2a-46a2-a101-a1f5eae25c32 tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d95c3132-5492-46f7-9408-41e5912a408b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:58 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1cac75e2-ca2a-46a2-a101-a1f5eae25c32 tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d95c3132-5492-46f7-9408-41e5912a408b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1660785451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=608dff1c-be16-4ea6-ba42-95fe8b02d684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddabd82ab2a14399812eda79e8b583a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:56:59Z,use_quota=True,user_id='66db51d4d800446f9bba53b671c312e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:58 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1cac75e2-ca2a-46a2-a101-a1f5eae25c32 tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6112ea6-ccf6-4b0b-aded-a3ea81fb6707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:58 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1cac75e2-ca2a-46a2-a101-a1f5eae25c32 tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6112ea6-ccf6-4b0b-aded-a3ea81fb6707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:58 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1cac75e2-ca2a-46a2-a101-a1f5eae25c32 tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55158f1d-59d7-40c1-a5d1-9b1b5473ccc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:58 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1cac75e2-ca2a-46a2-a101-a1f5eae25c32 tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55158f1d-59d7-40c1-a5d1-9b1b5473ccc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '608dff1c-be16-4ea6-ba42-95fe8b02d684', 'volume_name': 'volume-608dff1c-be16-4ea6-ba42-95fe8b02d684', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:58 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1cac75e2-ca2a-46a2-a101-a1f5eae25c32 tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e2b8958-a54a-4dfd-8a1e-8a7895e8bbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:58 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1cac75e2-ca2a-46a2-a101-a1f5eae25c32 tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e2b8958-a54a-4dfd-8a1e-8a7895e8bbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:58 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1cac75e2-ca2a-46a2-a101-a1f5eae25c32 tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bccbaab9-8646-4179-b5d9-4fa61d560ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:58 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-1cac75e2-ca2a-46a2-a101-a1f5eae25c32 tempest-ProjectReaderTests-1275809092 None] Volume 608dff1c-be16-4ea6-ba42-95fe8b02d684: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-608dff1c-be16-4ea6-ba42-95fe8b02d684', 'volume_size': 1} Jul 28 10:56:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1cac75e2-ca2a-46a2-a101-a1f5eae25c32 tempest-ProjectReaderTests-1275809092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:56:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1cac75e2-ca2a-46a2-a101-a1f5eae25c32 tempest-ProjectReaderTests-1275809092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:56:58 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-1cac75e2-ca2a-46a2-a101-a1f5eae25c32 tempest-ProjectReaderTests-1275809092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1660785451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=608dff1c-be16-4ea6-ba42-95fe8b02d684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddabd82ab2a14399812eda79e8b583a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:56:59Z,use_quota=True,user_id='66db51d4d800446f9bba53b671c312e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:56:58 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-1cac75e2-ca2a-46a2-a101-a1f5eae25c32 tempest-ProjectReaderTests-1275809092 None] Creating volume 608dff1c-be16-4ea6-ba42-95fe8b02d684 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:56:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1cac75e2-ca2a-46a2-a101-a1f5eae25c32 tempest-ProjectReaderTests-1275809092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:56:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1cac75e2-ca2a-46a2-a101-a1f5eae25c32 tempest-ProjectReaderTests-1275809092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:56:58 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-1cac75e2-ca2a-46a2-a101-a1f5eae25c32 tempest-ProjectReaderTests-1275809092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:56:58 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-1cac75e2-ca2a-46a2-a101-a1f5eae25c32 tempest-ProjectReaderTests-1275809092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:56:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1cac75e2-ca2a-46a2-a101-a1f5eae25c32 tempest-ProjectReaderTests-1275809092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:56:58 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-1cac75e2-ca2a-46a2-a101-a1f5eae25c32 tempest-ProjectReaderTests-1275809092 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:56:58 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-1cac75e2-ca2a-46a2-a101-a1f5eae25c32 tempest-ProjectReaderTests-1275809092 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:56:58 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1cac75e2-ca2a-46a2-a101-a1f5eae25c32 tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:59 devstack sudo[109107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684 1073741824 Jul 28 10:56:59 devstack sudo[109107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:59 devstack sudo[109107]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1cac75e2-ca2a-46a2-a101-a1f5eae25c32 tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684 1073741824" returned: 0 in 0.408s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1cac75e2-ca2a-46a2-a101-a1f5eae25c32 tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:56:59 devstack sudo[109113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684 Jul 28 10:56:59 devstack sudo[109113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:56:59 devstack sudo[109113]: pam_unix(sudo:session): session closed for user root Jul 28 10:56:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-1cac75e2-ca2a-46a2-a101-a1f5eae25c32 tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684" returned: 0 in 0.257s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:56:59 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-1cac75e2-ca2a-46a2-a101-a1f5eae25c32 tempest-ProjectReaderTests-1275809092 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:56:59 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-1cac75e2-ca2a-46a2-a101-a1f5eae25c32 tempest-ProjectReaderTests-1275809092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:56:59 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1cac75e2-ca2a-46a2-a101-a1f5eae25c32 tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bccbaab9-8646-4179-b5d9-4fa61d560ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-608dff1c-be16-4ea6-ba42-95fe8b02d684', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:59 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1cac75e2-ca2a-46a2-a101-a1f5eae25c32 tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a756845c-07c3-4518-8705-017833c86e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:56:59 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-1cac75e2-ca2a-46a2-a101-a1f5eae25c32 tempest-ProjectReaderTests-1275809092 None] Volume volume-608dff1c-be16-4ea6-ba42-95fe8b02d684 (608dff1c-be16-4ea6-ba42-95fe8b02d684): created successfully Jul 28 10:56:59 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1cac75e2-ca2a-46a2-a101-a1f5eae25c32 tempest-ProjectReaderTests-1275809092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a756845c-07c3-4518-8705-017833c86e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:56:59 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-1cac75e2-ca2a-46a2-a101-a1f5eae25c32 tempest-ProjectReaderTests-1275809092 None] Flow 'volume_create_manager' (55a81dd3-cd76-4e0d-ae18-eafc6827baba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:56:59 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-1cac75e2-ca2a-46a2-a101-a1f5eae25c32 tempest-ProjectReaderTests-1275809092 None] Created volume successfully. Jul 28 10:57:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c91dac13-2770-4cfa-8207-4f5a7502f07e tempest-ProjectReaderTests-1275809092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:57:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c91dac13-2770-4cfa-8207-4f5a7502f07e tempest-ProjectReaderTests-1275809092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:57:00 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-c91dac13-2770-4cfa-8207-4f5a7502f07e tempest-ProjectReaderTests-1275809092 None] Creating offline snapshot b720032f-704c-4fe0-974f-4fc113b0f0c7 of volume 608dff1c-be16-4ea6-ba42-95fe8b02d684 {{(pid=88413) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 10:57:00 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f21c4c1-e63d-493c-b92d-d30062b48e56]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:57:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c91dac13-2770-4cfa-8207-4f5a7502f07e tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:57:00 devstack sudo[109116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684 Jul 28 10:57:00 devstack sudo[109116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:57:00 devstack sudo[109116]: pam_unix(sudo:session): session closed for user root Jul 28 10:57:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c91dac13-2770-4cfa-8207-4f5a7502f07e tempest-ProjectReaderTests-1275809092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684" returned: 0 in 0.358s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:57:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c91dac13-2770-4cfa-8207-4f5a7502f07e tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684.b720032f-704c-4fe0-974f-4fc113b0f0c7 1G {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:57:00 devstack sudo[109122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684.b720032f-704c-4fe0-974f-4fc113b0f0c7 1G Jul 28 10:57:00 devstack sudo[109122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:57:00 devstack sudo[109122]: pam_unix(sudo:session): session closed for user root Jul 28 10:57:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c91dac13-2770-4cfa-8207-4f5a7502f07e tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684.b720032f-704c-4fe0-974f-4fc113b0f0c7 1G" returned: 0 in 0.391s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:57:00 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c91dac13-2770-4cfa-8207-4f5a7502f07e tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-608dff1c-be16-4ea6-ba42-95fe8b02d684 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684.b720032f-704c-4fe0-974f-4fc113b0f0c7 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:57:00 devstack sudo[109129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-608dff1c-be16-4ea6-ba42-95fe8b02d684 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684.b720032f-704c-4fe0-974f-4fc113b0f0c7 Jul 28 10:57:00 devstack sudo[109129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:57:01 devstack sudo[109129]: pam_unix(sudo:session): session closed for user root Jul 28 10:57:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c91dac13-2770-4cfa-8207-4f5a7502f07e tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-608dff1c-be16-4ea6-ba42-95fe8b02d684 -F qcow2 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684.b720032f-704c-4fe0-974f-4fc113b0f0c7" returned: 0 in 0.294s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:57:01 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-c91dac13-2770-4cfa-8207-4f5a7502f07e tempest-ProjectReaderTests-1275809092 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684.b720032f-704c-4fe0-974f-4fc113b0f0c7 is being set with open permissions: ugo+rw Jul 28 10:57:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c91dac13-2770-4cfa-8207-4f5a7502f07e tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684.b720032f-704c-4fe0-974f-4fc113b0f0c7 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:57:01 devstack sudo[109135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684.b720032f-704c-4fe0-974f-4fc113b0f0c7 Jul 28 10:57:01 devstack sudo[109135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:57:01 devstack sudo[109135]: pam_unix(sudo:session): session closed for user root Jul 28 10:57:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c91dac13-2770-4cfa-8207-4f5a7502f07e tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684.b720032f-704c-4fe0-974f-4fc113b0f0c7" returned: 0 in 0.241s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:57:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c91dac13-2770-4cfa-8207-4f5a7502f07e tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:57:01 devstack sudo[109138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684.info Jul 28 10:57:01 devstack sudo[109138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:57:01 devstack sudo[109138]: pam_unix(sudo:session): session closed for user root Jul 28 10:57:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c91dac13-2770-4cfa-8207-4f5a7502f07e tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684.info" returned: 0 in 0.246s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:57:01 devstack cinder-volume[88413]: WARNING cinder.volume.drivers.remotefs [None req-c91dac13-2770-4cfa-8207-4f5a7502f07e tempest-ProjectReaderTests-1275809092 None] /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684.info is being set with open permissions: ugo+rw Jul 28 10:57:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c91dac13-2770-4cfa-8207-4f5a7502f07e tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684.info {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:57:01 devstack sudo[109141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684.info Jul 28 10:57:01 devstack sudo[109141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:57:01 devstack sudo[109141]: pam_unix(sudo:session): session closed for user root Jul 28 10:57:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-c91dac13-2770-4cfa-8207-4f5a7502f07e tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684.info" returned: 0 in 0.236s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:57:01 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-c91dac13-2770-4cfa-8207-4f5a7502f07e tempest-ProjectReaderTests-1275809092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.842s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:57:01 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-c91dac13-2770-4cfa-8207-4f5a7502f07e tempest-ProjectReaderTests-1275809092 None] Create snapshot completed successfully Jul 28 10:57:02 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3bf84f19-aba8-444e-9fcd-29ab75da9011 tempest-ProjectReaderTests-1275809092 None] Acquiring lock "cinder-b720032f-704c-4fe0-974f-4fc113b0f0c7-delete_snapshot" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:57:02 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3bf84f19-aba8-444e-9fcd-29ab75da9011 tempest-ProjectReaderTests-1275809092 None] Lock "cinder-b720032f-704c-4fe0-974f-4fc113b0f0c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:57:02 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3bf84f19-aba8-444e-9fcd-29ab75da9011 tempest-ProjectReaderTests-1275809092 None] Acquiring lock "cinder-quobyte-608dff1c-be16-4ea6-ba42-95fe8b02d684" by "delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:57:02 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3bf84f19-aba8-444e-9fcd-29ab75da9011 tempest-ProjectReaderTests-1275809092 None] Lock "cinder-quobyte-608dff1c-be16-4ea6-ba42-95fe8b02d684" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:57:02 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3bf84f19-aba8-444e-9fcd-29ab75da9011 tempest-ProjectReaderTests-1275809092 None] Acquiring lock "cinder-quobyte-b720032f-704c-4fe0-974f-4fc113b0f0c7" by "_delete_snapshot" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:57:02 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3bf84f19-aba8-444e-9fcd-29ab75da9011 tempest-ProjectReaderTests-1275809092 None] Lock "cinder-quobyte-b720032f-704c-4fe0-974f-4fc113b0f0c7" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:57:02 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-3bf84f19-aba8-444e-9fcd-29ab75da9011 tempest-ProjectReaderTests-1275809092 None] Deleting offline snapshot b720032f-704c-4fe0-974f-4fc113b0f0c7 of volume 608dff1c-be16-4ea6-ba42-95fe8b02d684 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 10:57:02 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-3bf84f19-aba8-444e-9fcd-29ab75da9011 tempest-ProjectReaderTests-1275809092 None] snapshot_file for this snap is: volume-608dff1c-be16-4ea6-ba42-95fe8b02d684.b720032f-704c-4fe0-974f-4fc113b0f0c7 {{(pid=88413) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 10:57:02 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ca49f9-edc9-4e75-96bc-520e5cd006bf]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:57:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3bf84f19-aba8-444e-9fcd-29ab75da9011 tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684.b720032f-704c-4fe0-974f-4fc113b0f0c7 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:57:02 devstack sudo[109144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684.b720032f-704c-4fe0-974f-4fc113b0f0c7 Jul 28 10:57:02 devstack sudo[109144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:57:02 devstack sudo[109144]: pam_unix(sudo:session): session closed for user root Jul 28 10:57:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3bf84f19-aba8-444e-9fcd-29ab75da9011 tempest-ProjectReaderTests-1275809092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684.b720032f-704c-4fe0-974f-4fc113b0f0c7" returned: 0 in 0.359s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:57:02 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-3bf84f19-aba8-444e-9fcd-29ab75da9011 tempest-ProjectReaderTests-1275809092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-608dff1c-be16-4ea6-ba42-95fe8b02d684(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88413) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 10:57:02 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a0879e-44b4-4f3f-99ef-4b2dcf6fe57f]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:57:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3bf84f19-aba8-444e-9fcd-29ab75da9011 tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:57:02 devstack sudo[109149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684 Jul 28 10:57:02 devstack sudo[109149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:57:02 devstack sudo[109149]: pam_unix(sudo:session): session closed for user root Jul 28 10:57:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3bf84f19-aba8-444e-9fcd-29ab75da9011 tempest-ProjectReaderTests-1275809092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684" returned: 0 in 0.358s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:57:02 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3bf84f19-aba8-444e-9fcd-29ab75da9011 tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684.b720032f-704c-4fe0-974f-4fc113b0f0c7 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:57:03 devstack sudo[109154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684.b720032f-704c-4fe0-974f-4fc113b0f0c7 Jul 28 10:57:03 devstack sudo[109154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:57:03 devstack sudo[109154]: pam_unix(sudo:session): session closed for user root Jul 28 10:57:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3bf84f19-aba8-444e-9fcd-29ab75da9011 tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684.b720032f-704c-4fe0-974f-4fc113b0f0c7" returned: 0 in 0.332s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:57:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3bf84f19-aba8-444e-9fcd-29ab75da9011 tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684.b720032f-704c-4fe0-974f-4fc113b0f0c7 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:57:03 devstack sudo[109159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684.b720032f-704c-4fe0-974f-4fc113b0f0c7 Jul 28 10:57:03 devstack sudo[109159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:57:03 devstack sudo[109159]: pam_unix(sudo:session): session closed for user root Jul 28 10:57:03 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-3bf84f19-aba8-444e-9fcd-29ab75da9011 tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684.b720032f-704c-4fe0-974f-4fc113b0f0c7" returned: 0 in 0.246s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:57:03 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3bf84f19-aba8-444e-9fcd-29ab75da9011 tempest-ProjectReaderTests-1275809092 None] Lock "cinder-quobyte-b720032f-704c-4fe0-974f-4fc113b0f0c7" released by "_delete_snapshot" :: held 1.383s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:57:03 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3bf84f19-aba8-444e-9fcd-29ab75da9011 tempest-ProjectReaderTests-1275809092 None] Lock "cinder-quobyte-608dff1c-be16-4ea6-ba42-95fe8b02d684" released by "delete_snapshot" :: held 1.405s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:57:03 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-3bf84f19-aba8-444e-9fcd-29ab75da9011 tempest-ProjectReaderTests-1275809092 None] Created reservations ['18bb0490-1d0a-4e00-b0a3-03130413c998', 'd9a3ba0c-6135-4ed1-845a-6621d7031e93', 'd681b5bc-4639-4df5-af15-fcebf7cc01d4', '309f18fb-8806-48c6-9694-e9222a0998fc'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:57:03 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-3bf84f19-aba8-444e-9fcd-29ab75da9011 tempest-ProjectReaderTests-1275809092 None] Delete snapshot completed successfully. Jul 28 10:57:03 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-3bf84f19-aba8-444e-9fcd-29ab75da9011 tempest-ProjectReaderTests-1275809092 None] Lock "cinder-b720032f-704c-4fe0-974f-4fc113b0f0c7-delete_snapshot" released by "delete_snapshot" :: held 1.547s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:57:04 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9db98622-f6fb-436b-9e4d-904e631433c8 tempest-ProjectReaderTests-1275809092 None] Acquiring lock "cinder-608dff1c-be16-4ea6-ba42-95fe8b02d684-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:57:04 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9db98622-f6fb-436b-9e4d-904e631433c8 tempest-ProjectReaderTests-1275809092 None] Lock "cinder-608dff1c-be16-4ea6-ba42-95fe8b02d684-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:57:04 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9db98622-f6fb-436b-9e4d-904e631433c8 tempest-ProjectReaderTests-1275809092 None] Acquiring lock "cinder-quobyte-608dff1c-be16-4ea6-ba42-95fe8b02d684" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:57:04 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9db98622-f6fb-436b-9e4d-904e631433c8 tempest-ProjectReaderTests-1275809092 None] Lock "cinder-quobyte-608dff1c-be16-4ea6-ba42-95fe8b02d684" acquired by "delete_volume" :: waited 0.016s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:57:04 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[0708d174-b964-40f4-a5c4-76a65d9822c1]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:57:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9db98622-f6fb-436b-9e4d-904e631433c8 tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:57:04 devstack sudo[109162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684 Jul 28 10:57:04 devstack sudo[109162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:57:04 devstack sudo[109162]: pam_unix(sudo:session): session closed for user root Jul 28 10:57:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9db98622-f6fb-436b-9e4d-904e631433c8 tempest-ProjectReaderTests-1275809092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684" returned: 0 in 0.351s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:57:04 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9db98622-f6fb-436b-9e4d-904e631433c8 tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:57:04 devstack sudo[109167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684 Jul 28 10:57:04 devstack sudo[109167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:57:05 devstack sudo[109167]: pam_unix(sudo:session): session closed for user root Jul 28 10:57:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9db98622-f6fb-436b-9e4d-904e631433c8 tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-608dff1c-be16-4ea6-ba42-95fe8b02d684" returned: 0 in 0.239s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:57:05 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9db98622-f6fb-436b-9e4d-904e631433c8 tempest-ProjectReaderTests-1275809092 None] Lock "cinder-quobyte-608dff1c-be16-4ea6-ba42-95fe8b02d684" released by "delete_volume" :: held 0.645s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:57:05 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-9db98622-f6fb-436b-9e4d-904e631433c8 tempest-ProjectReaderTests-1275809092 None] Created reservations ['da906fe6-9aec-4cbd-b901-f18e024878ee', 'a9fbf2b5-213a-4806-9dbd-19d00de716e7', 'aa7dfdac-ebd9-4959-8dc7-efc53da5e66d', 'fbf75c61-628c-4c92-902d-9dcee804998f'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:57:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9db98622-f6fb-436b-9e4d-904e631433c8 tempest-ProjectReaderTests-1275809092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:57:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9db98622-f6fb-436b-9e4d-904e631433c8 tempest-ProjectReaderTests-1275809092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:57:05 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9db98622-f6fb-436b-9e4d-904e631433c8 tempest-ProjectReaderTests-1275809092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:57:05 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-9db98622-f6fb-436b-9e4d-904e631433c8 tempest-ProjectReaderTests-1275809092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:57:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-9db98622-f6fb-436b-9e4d-904e631433c8 tempest-ProjectReaderTests-1275809092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:57:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9db98622-f6fb-436b-9e4d-904e631433c8 tempest-ProjectReaderTests-1275809092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:57:05 devstack sudo[109170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:57:05 devstack sudo[109170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:57:05 devstack sudo[109170]: pam_unix(sudo:session): session closed for user root Jul 28 10:57:05 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-9db98622-f6fb-436b-9e4d-904e631433c8 tempest-ProjectReaderTests-1275809092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.247s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:57:05 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-9db98622-f6fb-436b-9e4d-904e631433c8 tempest-ProjectReaderTests-1275809092 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:57:05 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-9db98622-f6fb-436b-9e4d-904e631433c8 tempest-ProjectReaderTests-1275809092 None] Deleted volume successfully. Jul 28 10:57:05 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-9db98622-f6fb-436b-9e4d-904e631433c8 tempest-ProjectReaderTests-1275809092 None] Lock "cinder-608dff1c-be16-4ea6-ba42-95fe8b02d684-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:57:13 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=105,cinder:INSERT=37,cinder:UPDATE=146,cinder:DELETE=11 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:57:13 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=115,cinder:UPDATE=136,cinder:DELETE=12,cinder:INSERT=42 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:57:17 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-b33b4def-05c3-4118-8be2-63a825c4e6ca tempest-ProjectReaderTests-2026680296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:57:17 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b33b4def-05c3-4118-8be2-63a825c4e6ca tempest-ProjectReaderTests-2026680296 None] Flow 'volume_create_manager' (e37d47c1-c5f3-4d3a-8df9-3f69483f2d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:57:17 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b33b4def-05c3-4118-8be2-63a825c4e6ca tempest-ProjectReaderTests-2026680296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d087e1f8-4c18-47de-862e-010755965c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:57:17 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b33b4def-05c3-4118-8be2-63a825c4e6ca tempest-ProjectReaderTests-2026680296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d087e1f8-4c18-47de-862e-010755965c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1338795216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6e1678a-f7fb-400e-8478-b9ace923b985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d54eea7caff4dae8d240dec16b4a3b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:57:17Z,use_quota=True,user_id='604fa1b32f1c4f83933e40c602a67c43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:57:17 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b33b4def-05c3-4118-8be2-63a825c4e6ca tempest-ProjectReaderTests-2026680296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a48899c-fb6b-4c83-ab15-78648bdb01c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:57:17 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b33b4def-05c3-4118-8be2-63a825c4e6ca tempest-ProjectReaderTests-2026680296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a48899c-fb6b-4c83-ab15-78648bdb01c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:57:17 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b33b4def-05c3-4118-8be2-63a825c4e6ca tempest-ProjectReaderTests-2026680296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4322112c-d6ee-4e9b-b13e-4623f2c77d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:57:17 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b33b4def-05c3-4118-8be2-63a825c4e6ca tempest-ProjectReaderTests-2026680296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4322112c-d6ee-4e9b-b13e-4623f2c77d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6e1678a-f7fb-400e-8478-b9ace923b985', 'volume_name': 'volume-c6e1678a-f7fb-400e-8478-b9ace923b985', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:57:17 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b33b4def-05c3-4118-8be2-63a825c4e6ca tempest-ProjectReaderTests-2026680296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97874beb-ecb5-4ca8-92bc-2274d1390bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:57:17 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b33b4def-05c3-4118-8be2-63a825c4e6ca tempest-ProjectReaderTests-2026680296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97874beb-ecb5-4ca8-92bc-2274d1390bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:57:17 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b33b4def-05c3-4118-8be2-63a825c4e6ca tempest-ProjectReaderTests-2026680296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ca1239-08d9-42d7-9e46-2b4e06b54ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:57:17 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-b33b4def-05c3-4118-8be2-63a825c4e6ca tempest-ProjectReaderTests-2026680296 None] Volume c6e1678a-f7fb-400e-8478-b9ace923b985: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6e1678a-f7fb-400e-8478-b9ace923b985', 'volume_size': 1} Jul 28 10:57:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b33b4def-05c3-4118-8be2-63a825c4e6ca tempest-ProjectReaderTests-2026680296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:57:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b33b4def-05c3-4118-8be2-63a825c4e6ca tempest-ProjectReaderTests-2026680296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:57:17 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b33b4def-05c3-4118-8be2-63a825c4e6ca tempest-ProjectReaderTests-2026680296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1338795216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6e1678a-f7fb-400e-8478-b9ace923b985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d54eea7caff4dae8d240dec16b4a3b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:57:17Z,use_quota=True,user_id='604fa1b32f1c4f83933e40c602a67c43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:57:17 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-b33b4def-05c3-4118-8be2-63a825c4e6ca tempest-ProjectReaderTests-2026680296 None] Creating volume c6e1678a-f7fb-400e-8478-b9ace923b985 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:57:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b33b4def-05c3-4118-8be2-63a825c4e6ca tempest-ProjectReaderTests-2026680296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:57:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b33b4def-05c3-4118-8be2-63a825c4e6ca tempest-ProjectReaderTests-2026680296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:57:17 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b33b4def-05c3-4118-8be2-63a825c4e6ca tempest-ProjectReaderTests-2026680296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:57:17 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b33b4def-05c3-4118-8be2-63a825c4e6ca tempest-ProjectReaderTests-2026680296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:57:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b33b4def-05c3-4118-8be2-63a825c4e6ca tempest-ProjectReaderTests-2026680296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:57:17 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b33b4def-05c3-4118-8be2-63a825c4e6ca tempest-ProjectReaderTests-2026680296 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:57:17 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-b33b4def-05c3-4118-8be2-63a825c4e6ca tempest-ProjectReaderTests-2026680296 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:57:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b33b4def-05c3-4118-8be2-63a825c4e6ca tempest-ProjectReaderTests-2026680296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c6e1678a-f7fb-400e-8478-b9ace923b985 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:57:17 devstack sudo[109175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c6e1678a-f7fb-400e-8478-b9ace923b985 1073741824 Jul 28 10:57:17 devstack sudo[109175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:57:17 devstack sudo[109175]: pam_unix(sudo:session): session closed for user root Jul 28 10:57:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b33b4def-05c3-4118-8be2-63a825c4e6ca tempest-ProjectReaderTests-2026680296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c6e1678a-f7fb-400e-8478-b9ace923b985 1073741824" returned: 0 in 0.436s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:57:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b33b4def-05c3-4118-8be2-63a825c4e6ca tempest-ProjectReaderTests-2026680296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c6e1678a-f7fb-400e-8478-b9ace923b985 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:57:17 devstack sudo[109181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c6e1678a-f7fb-400e-8478-b9ace923b985 Jul 28 10:57:17 devstack sudo[109181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:57:17 devstack sudo[109181]: pam_unix(sudo:session): session closed for user root Jul 28 10:57:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-b33b4def-05c3-4118-8be2-63a825c4e6ca tempest-ProjectReaderTests-2026680296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c6e1678a-f7fb-400e-8478-b9ace923b985" returned: 0 in 0.248s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:57:17 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-b33b4def-05c3-4118-8be2-63a825c4e6ca tempest-ProjectReaderTests-2026680296 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:57:17 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-b33b4def-05c3-4118-8be2-63a825c4e6ca tempest-ProjectReaderTests-2026680296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:57:17 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b33b4def-05c3-4118-8be2-63a825c4e6ca tempest-ProjectReaderTests-2026680296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ca1239-08d9-42d7-9e46-2b4e06b54ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6e1678a-f7fb-400e-8478-b9ace923b985', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:57:17 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b33b4def-05c3-4118-8be2-63a825c4e6ca tempest-ProjectReaderTests-2026680296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eff9941-09cb-4670-9fb8-1df0df92a1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:57:17 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-b33b4def-05c3-4118-8be2-63a825c4e6ca tempest-ProjectReaderTests-2026680296 None] Volume volume-c6e1678a-f7fb-400e-8478-b9ace923b985 (c6e1678a-f7fb-400e-8478-b9ace923b985): created successfully Jul 28 10:57:17 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b33b4def-05c3-4118-8be2-63a825c4e6ca tempest-ProjectReaderTests-2026680296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eff9941-09cb-4670-9fb8-1df0df92a1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:57:17 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-b33b4def-05c3-4118-8be2-63a825c4e6ca tempest-ProjectReaderTests-2026680296 None] Flow 'volume_create_manager' (e37d47c1-c5f3-4d3a-8df9-3f69483f2d98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:57:17 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-b33b4def-05c3-4118-8be2-63a825c4e6ca tempest-ProjectReaderTests-2026680296 None] Created volume successfully. Jul 28 10:57:18 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ff559598-c39e-48ca-bb0c-9a053d0f364c tempest-ProjectReaderTests-2026680296 None] Acquiring lock "cinder-c6e1678a-f7fb-400e-8478-b9ace923b985-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:57:18 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ff559598-c39e-48ca-bb0c-9a053d0f364c tempest-ProjectReaderTests-2026680296 None] Lock "cinder-c6e1678a-f7fb-400e-8478-b9ace923b985-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:57:18 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ff559598-c39e-48ca-bb0c-9a053d0f364c tempest-ProjectReaderTests-2026680296 None] Acquiring lock "cinder-quobyte-c6e1678a-f7fb-400e-8478-b9ace923b985" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:57:18 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ff559598-c39e-48ca-bb0c-9a053d0f364c tempest-ProjectReaderTests-2026680296 None] Lock "cinder-quobyte-c6e1678a-f7fb-400e-8478-b9ace923b985" acquired by "delete_volume" :: waited 0.014s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:57:18 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[4507e1f8-20b0-4a86-896f-e5be35f3cc7f]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:57:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ff559598-c39e-48ca-bb0c-9a053d0f364c tempest-ProjectReaderTests-2026680296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c6e1678a-f7fb-400e-8478-b9ace923b985 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:57:18 devstack sudo[109184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c6e1678a-f7fb-400e-8478-b9ace923b985 Jul 28 10:57:18 devstack sudo[109184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:57:18 devstack sudo[109184]: pam_unix(sudo:session): session closed for user root Jul 28 10:57:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ff559598-c39e-48ca-bb0c-9a053d0f364c tempest-ProjectReaderTests-2026680296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c6e1678a-f7fb-400e-8478-b9ace923b985" returned: 0 in 0.356s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:57:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ff559598-c39e-48ca-bb0c-9a053d0f364c tempest-ProjectReaderTests-2026680296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c6e1678a-f7fb-400e-8478-b9ace923b985 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:57:18 devstack sudo[109189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c6e1678a-f7fb-400e-8478-b9ace923b985 Jul 28 10:57:18 devstack sudo[109189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:57:18 devstack sudo[109189]: pam_unix(sudo:session): session closed for user root Jul 28 10:57:18 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ff559598-c39e-48ca-bb0c-9a053d0f364c tempest-ProjectReaderTests-2026680296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-c6e1678a-f7fb-400e-8478-b9ace923b985" returned: 0 in 0.243s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:57:18 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ff559598-c39e-48ca-bb0c-9a053d0f364c tempest-ProjectReaderTests-2026680296 None] Lock "cinder-quobyte-c6e1678a-f7fb-400e-8478-b9ace923b985" released by "delete_volume" :: held 0.637s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:57:19 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-ff559598-c39e-48ca-bb0c-9a053d0f364c tempest-ProjectReaderTests-2026680296 None] Created reservations ['a15ddb47-34ae-4afc-923e-aa2be8b8757a', '6d1b8da1-67d7-4baa-8358-2dfefbd1a05b', '0653531e-5a24-4eea-8ed7-ed08f33997e6', 'f92416ce-43bc-42a3-8747-e3370bc0f80b'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:57:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ff559598-c39e-48ca-bb0c-9a053d0f364c tempest-ProjectReaderTests-2026680296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:57:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ff559598-c39e-48ca-bb0c-9a053d0f364c tempest-ProjectReaderTests-2026680296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:57:19 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-ff559598-c39e-48ca-bb0c-9a053d0f364c tempest-ProjectReaderTests-2026680296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:57:19 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-ff559598-c39e-48ca-bb0c-9a053d0f364c tempest-ProjectReaderTests-2026680296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:57:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-ff559598-c39e-48ca-bb0c-9a053d0f364c tempest-ProjectReaderTests-2026680296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:57:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ff559598-c39e-48ca-bb0c-9a053d0f364c tempest-ProjectReaderTests-2026680296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:57:19 devstack sudo[109192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:57:19 devstack sudo[109192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:57:19 devstack sudo[109192]: pam_unix(sudo:session): session closed for user root Jul 28 10:57:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-ff559598-c39e-48ca-bb0c-9a053d0f364c tempest-ProjectReaderTests-2026680296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.253s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:57:19 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-ff559598-c39e-48ca-bb0c-9a053d0f364c tempest-ProjectReaderTests-2026680296 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:57:19 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-ff559598-c39e-48ca-bb0c-9a053d0f364c tempest-ProjectReaderTests-2026680296 None] Deleted volume successfully. Jul 28 10:57:19 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-ff559598-c39e-48ca-bb0c-9a053d0f364c tempest-ProjectReaderTests-2026680296 None] Lock "cinder-c6e1678a-f7fb-400e-8478-b9ace923b985-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:57:19 devstack cinder-volume[88413]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3606dcb-1491-4cec-b0f0-b22bec33675c tempest-ProjectReaderTests-2026680296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88413) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 10:57:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d3606dcb-1491-4cec-b0f0-b22bec33675c tempest-ProjectReaderTests-2026680296 None] Flow 'volume_create_manager' (707b1054-f6e4-4301-8292-65b5464e4b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:57:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d3606dcb-1491-4cec-b0f0-b22bec33675c tempest-ProjectReaderTests-2026680296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d24bec85-aedb-470c-a20b-51c11955c484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:57:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d3606dcb-1491-4cec-b0f0-b22bec33675c tempest-ProjectReaderTests-2026680296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d24bec85-aedb-470c-a20b-51c11955c484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:57:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-656969535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0508ff9f-f5e3-4b3e-8db7-f80af7729b71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d54eea7caff4dae8d240dec16b4a3b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:57:20Z,use_quota=True,user_id='604fa1b32f1c4f83933e40c602a67c43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:57:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d3606dcb-1491-4cec-b0f0-b22bec33675c tempest-ProjectReaderTests-2026680296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67bd7446-3b30-4b72-a2aa-4631ae44a406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:57:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d3606dcb-1491-4cec-b0f0-b22bec33675c tempest-ProjectReaderTests-2026680296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67bd7446-3b30-4b72-a2aa-4631ae44a406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:57:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d3606dcb-1491-4cec-b0f0-b22bec33675c tempest-ProjectReaderTests-2026680296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b005327-e09e-478a-b7b8-805084728405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:57:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d3606dcb-1491-4cec-b0f0-b22bec33675c tempest-ProjectReaderTests-2026680296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b005327-e09e-478a-b7b8-805084728405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0508ff9f-f5e3-4b3e-8db7-f80af7729b71', 'volume_name': 'volume-0508ff9f-f5e3-4b3e-8db7-f80af7729b71', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:57:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d3606dcb-1491-4cec-b0f0-b22bec33675c tempest-ProjectReaderTests-2026680296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ef92f66-2550-468e-8c68-c4573424a266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:57:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d3606dcb-1491-4cec-b0f0-b22bec33675c tempest-ProjectReaderTests-2026680296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ef92f66-2550-468e-8c68-c4573424a266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:57:19 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d3606dcb-1491-4cec-b0f0-b22bec33675c tempest-ProjectReaderTests-2026680296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ef14e53-92bd-4431-a43c-5b2fb4ef46d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:57:19 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-d3606dcb-1491-4cec-b0f0-b22bec33675c tempest-ProjectReaderTests-2026680296 None] Volume 0508ff9f-f5e3-4b3e-8db7-f80af7729b71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0508ff9f-f5e3-4b3e-8db7-f80af7729b71', 'volume_size': 1} Jul 28 10:57:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d3606dcb-1491-4cec-b0f0-b22bec33675c tempest-ProjectReaderTests-2026680296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:57:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d3606dcb-1491-4cec-b0f0-b22bec33675c tempest-ProjectReaderTests-2026680296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:57:19 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-d3606dcb-1491-4cec-b0f0-b22bec33675c tempest-ProjectReaderTests-2026680296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T08:57:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-656969535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0508ff9f-f5e3-4b3e-8db7-f80af7729b71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d54eea7caff4dae8d240dec16b4a3b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T08:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T08:57:20Z,use_quota=True,user_id='604fa1b32f1c4f83933e40c602a67c43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08fe1001-2520-434c-bb76-3d36df237c32),volume_type_id=08fe1001-2520-434c-bb76-3d36df237c32)}" {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 10:57:19 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.remotefs [None req-d3606dcb-1491-4cec-b0f0-b22bec33675c tempest-ProjectReaderTests-2026680296 None] Creating volume 0508ff9f-f5e3-4b3e-8db7-f80af7729b71 {{(pid=88413) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 10:57:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d3606dcb-1491-4cec-b0f0-b22bec33675c tempest-ProjectReaderTests-2026680296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:57:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d3606dcb-1491-4cec-b0f0-b22bec33675c tempest-ProjectReaderTests-2026680296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:57:19 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-d3606dcb-1491-4cec-b0f0-b22bec33675c tempest-ProjectReaderTests-2026680296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:57:19 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-d3606dcb-1491-4cec-b0f0-b22bec33675c tempest-ProjectReaderTests-2026680296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:57:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d3606dcb-1491-4cec-b0f0-b22bec33675c tempest-ProjectReaderTests-2026680296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:57:19 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-d3606dcb-1491-4cec-b0f0-b22bec33675c tempest-ProjectReaderTests-2026680296 None] Selected osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 as target Quobyte volume. {{(pid=88413) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 10:57:19 devstack cinder-volume[88413]: INFO cinder.volume.drivers.remotefs [None req-d3606dcb-1491-4cec-b0f0-b22bec33675c tempest-ProjectReaderTests-2026680296 None] casted to osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7 Jul 28 10:57:19 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d3606dcb-1491-4cec-b0f0-b22bec33675c tempest-ProjectReaderTests-2026680296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0508ff9f-f5e3-4b3e-8db7-f80af7729b71 1073741824 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:57:19 devstack sudo[109195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0508ff9f-f5e3-4b3e-8db7-f80af7729b71 1073741824 Jul 28 10:57:19 devstack sudo[109195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:57:20 devstack sudo[109195]: pam_unix(sudo:session): session closed for user root Jul 28 10:57:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d3606dcb-1491-4cec-b0f0-b22bec33675c tempest-ProjectReaderTests-2026680296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0508ff9f-f5e3-4b3e-8db7-f80af7729b71 1073741824" returned: 0 in 0.413s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:57:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d3606dcb-1491-4cec-b0f0-b22bec33675c tempest-ProjectReaderTests-2026680296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0508ff9f-f5e3-4b3e-8db7-f80af7729b71 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:57:20 devstack sudo[109201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0508ff9f-f5e3-4b3e-8db7-f80af7729b71 Jul 28 10:57:20 devstack sudo[109201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:57:20 devstack sudo[109201]: pam_unix(sudo:session): session closed for user root Jul 28 10:57:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-d3606dcb-1491-4cec-b0f0-b22bec33675c tempest-ProjectReaderTests-2026680296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0508ff9f-f5e3-4b3e-8db7-f80af7729b71" returned: 0 in 0.247s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:57:20 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-d3606dcb-1491-4cec-b0f0-b22bec33675c tempest-ProjectReaderTests-2026680296 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'} {{(pid=88413) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 10:57:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-d3606dcb-1491-4cec-b0f0-b22bec33675c tempest-ProjectReaderTests-2026680296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:57:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d3606dcb-1491-4cec-b0f0-b22bec33675c tempest-ProjectReaderTests-2026680296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ef14e53-92bd-4431-a43c-5b2fb4ef46d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0508ff9f-f5e3-4b3e-8db7-f80af7729b71', 'volume_size': 1}' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:57:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d3606dcb-1491-4cec-b0f0-b22bec33675c tempest-ProjectReaderTests-2026680296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56bd0134-13ed-4a63-b374-75c703e5122b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 10:57:20 devstack cinder-volume[88413]: INFO cinder.volume.flows.manager.create_volume [None req-d3606dcb-1491-4cec-b0f0-b22bec33675c tempest-ProjectReaderTests-2026680296 None] Volume volume-0508ff9f-f5e3-4b3e-8db7-f80af7729b71 (0508ff9f-f5e3-4b3e-8db7-f80af7729b71): created successfully Jul 28 10:57:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d3606dcb-1491-4cec-b0f0-b22bec33675c tempest-ProjectReaderTests-2026680296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56bd0134-13ed-4a63-b374-75c703e5122b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88413) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 10:57:20 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-d3606dcb-1491-4cec-b0f0-b22bec33675c tempest-ProjectReaderTests-2026680296 None] Flow 'volume_create_manager' (707b1054-f6e4-4301-8292-65b5464e4b25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88413) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 10:57:20 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-d3606dcb-1491-4cec-b0f0-b22bec33675c tempest-ProjectReaderTests-2026680296 None] Created volume successfully. Jul 28 10:57:20 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7f2d1af2-3281-4432-a4fe-f5c302596b73 tempest-ProjectReaderTests-2026680296 None] Acquiring lock "cinder-0508ff9f-f5e3-4b3e-8db7-f80af7729b71-delete_volume" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:57:20 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7f2d1af2-3281-4432-a4fe-f5c302596b73 tempest-ProjectReaderTests-2026680296 None] Lock "cinder-0508ff9f-f5e3-4b3e-8db7-f80af7729b71-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:57:20 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7f2d1af2-3281-4432-a4fe-f5c302596b73 tempest-ProjectReaderTests-2026680296 None] Acquiring lock "cinder-quobyte-0508ff9f-f5e3-4b3e-8db7-f80af7729b71" by "delete_volume" {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 10:57:20 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7f2d1af2-3281-4432-a4fe-f5c302596b73 tempest-ProjectReaderTests-2026680296 None] Lock "cinder-quobyte-0508ff9f-f5e3-4b3e-8db7-f80af7729b71" acquired by "delete_volume" :: waited 0.012s {{(pid=88413) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 10:57:20 devstack cinder-volume[88413]: DEBUG oslo.privsep.daemon [-] privsep: reply[96013feb-aef1-4600-b70c-252a1d82d1ab]: (4, 'qcow2') {{(pid=89968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 10:57:20 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7f2d1af2-3281-4432-a4fe-f5c302596b73 tempest-ProjectReaderTests-2026680296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0508ff9f-f5e3-4b3e-8db7-f80af7729b71 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:57:21 devstack sudo[109204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0508ff9f-f5e3-4b3e-8db7-f80af7729b71 Jul 28 10:57:21 devstack sudo[109204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:57:21 devstack sudo[109204]: pam_unix(sudo:session): session closed for user root Jul 28 10:57:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7f2d1af2-3281-4432-a4fe-f5c302596b73 tempest-ProjectReaderTests-2026680296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0508ff9f-f5e3-4b3e-8db7-f80af7729b71" returned: 0 in 0.358s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:57:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7f2d1af2-3281-4432-a4fe-f5c302596b73 tempest-ProjectReaderTests-2026680296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0508ff9f-f5e3-4b3e-8db7-f80af7729b71 {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:57:21 devstack sudo[109209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0508ff9f-f5e3-4b3e-8db7-f80af7729b71 Jul 28 10:57:21 devstack sudo[109209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:57:21 devstack sudo[109209]: pam_unix(sudo:session): session closed for user root Jul 28 10:57:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7f2d1af2-3281-4432-a4fe-f5c302596b73 tempest-ProjectReaderTests-2026680296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f/volume-0508ff9f-f5e3-4b3e-8db7-f80af7729b71" returned: 0 in 0.241s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:57:21 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7f2d1af2-3281-4432-a4fe-f5c302596b73 tempest-ProjectReaderTests-2026680296 None] Lock "cinder-quobyte-0508ff9f-f5e3-4b3e-8db7-f80af7729b71" released by "delete_volume" :: held 0.642s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:57:21 devstack cinder-volume[88413]: DEBUG cinder.quota [None req-7f2d1af2-3281-4432-a4fe-f5c302596b73 tempest-ProjectReaderTests-2026680296 None] Created reservations ['f53d83a8-8e4f-4372-a9bf-63a28ffed376', '85400fcc-84e7-445d-b291-3dfa71a1b046', '3bb2ad01-ce04-4e5e-a046-ea46cd6fac15', 'f66a2c31-5d03-4dd6-8dab-072388e58987'] {{(pid=88413) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 10:57:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7f2d1af2-3281-4432-a4fe-f5c302596b73 tempest-ProjectReaderTests-2026680296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:57:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7f2d1af2-3281-4432-a4fe-f5c302596b73 tempest-ProjectReaderTests-2026680296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:57:21 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7f2d1af2-3281-4432-a4fe-f5c302596b73 tempest-ProjectReaderTests-2026680296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:57:21 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-7f2d1af2-3281-4432-a4fe-f5c302596b73 tempest-ProjectReaderTests-2026680296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:57:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-7f2d1af2-3281-4432-a4fe-f5c302596b73 tempest-ProjectReaderTests-2026680296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:57:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7f2d1af2-3281-4432-a4fe-f5c302596b73 tempest-ProjectReaderTests-2026680296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:57:21 devstack sudo[109212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:57:21 devstack sudo[109212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:57:21 devstack sudo[109212]: pam_unix(sudo:session): session closed for user root Jul 28 10:57:21 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-7f2d1af2-3281-4432-a4fe-f5c302596b73 tempest-ProjectReaderTests-2026680296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.244s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:57:21 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-7f2d1af2-3281-4432-a4fe-f5c302596b73 tempest-ProjectReaderTests-2026680296 None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:57:21 devstack cinder-volume[88413]: INFO cinder.volume.manager [None req-7f2d1af2-3281-4432-a4fe-f5c302596b73 tempest-ProjectReaderTests-2026680296 None] Deleted volume successfully. Jul 28 10:57:21 devstack cinder-volume[88413]: DEBUG cinder.coordination [None req-7f2d1af2-3281-4432-a4fe-f5c302596b73 tempest-ProjectReaderTests-2026680296 None] Lock "cinder-0508ff9f-f5e3-4b3e-8db7-f80af7729b71-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=88413) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 10:57:28 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:57:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 10:57:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 10:57:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7': None} {{(pid=88413) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 10:57:28 devstack cinder-volume[88413]: DEBUG cinder.volume.drivers.quobyte [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63f61d39-6f75-4bbd-be1f-515cf27592c7'] {{(pid=88413) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 10:57:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.lockutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88413) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 10:57:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 10:57:28 devstack sudo[109220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f Jul 28 10:57:28 devstack sudo[109220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 10:57:28 devstack sudo[109220]: pam_unix(sudo:session): session closed for user root Jul 28 10:57:28 devstack cinder-volume[88413]: DEBUG oslo_concurrency.processutils [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1b4ff1581dc95ea00be9e1617ac671f" returned: 0 in 0.242s {{(pid=88413) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 10:57:28 devstack cinder-volume[88413]: DEBUG cinder.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Notifying Schedulers of capabilities ... {{(pid=88413) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 10:57:28 devstack cinder-volume[88413]: DEBUG oslo_service.periodic_task [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] Running periodic task VolumeManager._thread_info {{(pid=88413) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 10:57:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread count: 29 {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 10:57:28 devstack cinder-volume[88413]: DEBUG cinder.volume.manager [None req-01765e68-5fec-4195-8e5b-4ff2518bf669 None None] thread info: [<_MainThread(MainThread, started 137939890385024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88413) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 10:57:31 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=15,cinder:UPDATE=25,cinder:DELETE=3,cinder:INSERT=3 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 10:57:31 devstack cinder-volume[88413]: DEBUG dbcounter [-] [88413] Writing DB stats cinder:SELECT=13,cinder:UPDATE=19,cinder:INSERT=7,cinder:DELETE=1 {{(pid=88413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}